Aug 31 15:06:30 devstack cinder-volume[75013]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 31 15:06:30 devstack cinder-volume[75013]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 31 15:06:30 devstack cinder-volume[75013]: we strongly recommend against using it for new projects. Aug 31 15:06:30 devstack cinder-volume[75013]: If you are already using Eventlet, we recommend migrating to a different Aug 31 15:06:30 devstack cinder-volume[75013]: framework. For more detail see Aug 31 15:06:30 devstack cinder-volume[75013]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 31 15:06:30 devstack cinder-volume[75013]: import eventlet # noqa Aug 31 15:06:33 devstack cinder-volume[75013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75013) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 31 15:06:33 devstack cinder-volume[75013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75013) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 31 15:06:33 devstack cinder-volume[75013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75013) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 31 15:06:34 devstack cinder-volume[75013]: INFO dbcounter [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] Registered counter for database cinder Aug 31 15:06:34 devstack cinder-volume[75013]: DEBUG oslo_db.sqlalchemy.engines [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75013) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 31 15:06:34 devstack cinder-volume[75013]: DEBUG dbcounter [-] [75013] Writer thread running {{(pid=75013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 31 15:06:34 devstack cinder-volume[75013]: INFO cinder.rpc [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 31 15:06:34 devstack cinder-volume[75013]: INFO cinder.rpc [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 31 15:06:34 devstack cinder-volume[75013]: DEBUG oslo_db.sqlalchemy.engines [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75013) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 31 15:06:34 devstack cinder-volume[75013]: INFO cinder.volume.manager [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] Determined volume DB was empty at startup. Aug 31 15:06:34 devstack cinder-volume[75013]: DEBUG cinder.volume.manager [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75013) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 31 15:06:34 devstack cinder-volume[75013]: INFO cinder.volume.manager [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 31 15:06:34 devstack cinder-volume[75013]: WARNING stevedore.named [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 31 15:06:34 devstack cinder-volume[75013]: WARNING castellan.key_manager [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 31 15:06:34 devstack cinder-volume[75013]: WARNING cinder.keymgr.conf_key_mgr [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 31 15:06:34 devstack cinder-volume[75013]: DEBUG cinder.volume.drivers.lvm [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75013) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Aug 31 15:06:34 devstack cinder-volume[75013]: DEBUG oslo_concurrency.processutils [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_concurrency.processutils [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] CMD "cinder-rtstool verify" returned: 0 in 0.430s {{(pid=75013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_db.sqlalchemy.engines [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75013) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 31 15:06:35 devstack cinder-volume[75013]: INFO cinder.rpc [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Aug 31 15:06:35 devstack cinder-volume[75013]: INFO cinder.rpc [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Aug 31 15:06:35 devstack cinder-volume[75013]: WARNING stevedore.named [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 31 15:06:35 devstack cinder-volume[75013]: WARNING castellan.key_manager [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 31 15:06:35 devstack cinder-volume[75013]: INFO cinder.volume.manager [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] Image-volume cache enabled for host devstack@lvmdriver-1. Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_db.sqlalchemy.engines [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75013) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 31 15:06:35 devstack cinder-volume[75013]: INFO oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] Starting 1 workers Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] Started child 75175 {{(pid=75013) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] Full set of CONF: {{(pid=75013) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] ******************************************************************************** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] Configuration options gathered from: {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] ================================================================================ {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] allow_availability_zone_fallback = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] allow_compression_on_image_upload = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] allowed_direct_url_schemes = [] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] api_rate_limit = True {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] auth_strategy = keystone {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] az_cache_duration = 3600 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_availability_zone = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_host = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_name = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_stats_polling_interval = 60 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backup_api_class = cinder.backup.api.API {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backup_name_template = backup-%s {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backup_use_same_host = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backup_use_temp_snapshot = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] chap_password = **** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] chap_username = {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cinder_internal_tenant_project_id = d5515742ca7548c2b7491fdf4bf97ae9 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cinder_internal_tenant_user_id = 3aaa775e6f5b4bb78fc2223c402fc625 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cloned_volume_same_az = True {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cluster = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] compression_format = gzip {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] compute_api_class = cinder.compute.nova.API {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] config_dir = [] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] config_source = [] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] control_exchange = openstack {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] debug = True {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] default_availability_zone = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] default_group_type = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] default_volume_type = lvmdriver-1 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] disk_geometry = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] driver_client_cert = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] driver_client_cert_key = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] driver_data_namespace = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] driver_ssl_cert_path = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] driver_ssl_cert_verify = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] driver_use_ssl = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75175]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] enable_force_upload = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] enable_new_services = True {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] enable_unsupported_driver = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] enabled_backends = ['lvmdriver-1'] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] enforce_multipath_for_image_xfer = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] filter_function = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] glance_api_insecure = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] glance_api_servers = ['http://192.168.122.232/image'] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] glance_api_ssl_compression = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] glance_ca_certificates_file = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] glance_catalog_info = image:glance:publicURL {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] glance_certfile = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] glance_keyfile = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] glance_num_retries = 3 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] glance_request_timeout = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] goodness_function = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] graceful_shutdown_timeout = 5 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] group_api_class = cinder.group.api.API {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] host = devstack {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] image_compress_on_upload = True {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] image_conversion_address_space_limit = 1 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] image_conversion_cpu_limit = 60 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] image_conversion_disable = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] image_upload_use_cinder_backend = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] image_upload_use_internal_tenant = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] image_volume_cache_enabled = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] image_volume_cache_max_count = 0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] image_volume_cache_max_size_gb = 0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] init_host_max_objects_retrieval = 0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] instance_format = [instance: %(uuid)s] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] iscsi_target_flags = {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] iscsi_write_cache = on {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] iser_helper = tgtadm {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] iser_ip_address = 192.168.122.232 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] iser_port = 3260 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] log_color = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] log_config_append = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] log_dir = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] log_file = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] log_options = True {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] log_rotate_interval = 1 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] log_rotate_interval_type = days {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] log_rotation_type = none {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] max_age = 0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] max_logfile_count = 30 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] max_logfile_size_mb = 200 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] max_over_subscription_ratio = 20.0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] message_reap_interval = 86400 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] message_ttl = 2592000 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] migration_create_volume_timeout_secs = 300 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] monkey_patch = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] monkey_patch_modules = [] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] my_ip = 192.168.122.232 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] no_snapshot_gb_quota = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] num_iser_scan_tries = 3 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] num_shell_tries = 3 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] num_volume_device_scan_tries = 3 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] nvmeof_conn_info_version = 1 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] nvmet_ns_id = 10 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] nvmet_port_id = 1 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] osapi_max_limit = 1000 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] osapi_volume_ext_list = [] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] osapi_volume_listen = 0.0.0.0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] osapi_volume_listen_port = 8776 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] osapi_volume_use_ssl = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] osapi_volume_workers = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] per_volume_size_limit = -1 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] periodic_fuzzy_delay = 60 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] periodic_interval = 60 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] project_id_regex = [0-9a-f\-]+ {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] public_endpoint = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] publish_errors = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] quota_backup_gigabytes = 1000 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] quota_backups = 10 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] quota_gigabytes = 1000 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] quota_groups = 10 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] quota_snapshots = 10 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] quota_volumes = 10 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] rate_limit_burst = 0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] rate_limit_except_level = CRITICAL {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] rate_limit_interval = 0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] reinit_driver_count = 3 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] replication_device = **** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] report_discard_supported = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] report_interval = 120 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] reservation_clean_interval = 86400 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] reservation_expire = 86400 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] reserved_image_namespaces = [] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] reserved_percentage = 0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] rpc_response_timeout = 120 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] run_external_periodic_tasks = True {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] scst_target_driver = iscsi {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] scst_target_iqn_name = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] service_down_time = 720 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] shell_completion = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] snapshot_name_template = snapshot-%s {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] snapshot_same_host = True {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] split_loggers = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] state_path = /opt/stack/data/cinder {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] storage_availability_zone = nova {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] storage_protocol = iSCSI {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] syslog_log_facility = LOG_USER {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] target_helper = lioadm {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] target_ip_address = 192.168.122.232 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] target_port = 3260 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] target_protocol = iscsi {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] target_secondary_ip_addresses = [] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] trace_flags = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] transfer_api_class = cinder.transfer.api.API {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] transport_url = **** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] until_refresh = 0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] use_chap_auth = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] use_default_quota_class = True {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] use_journal = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] use_json = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] use_multipath_for_image_xfer = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] use_stderr = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] use_syslog = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] verify_glance_signatures = enabled {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] volume_api_class = cinder.volume.api.API {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] volume_backend_name = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] volume_clear = zero {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] volume_clear_ionice = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] volume_clear_size = 0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] volume_copy_bps_limit = 0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] volume_dd_blocksize = 1M {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] volume_name_template = volume-%s {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] volume_service_inithost_offload = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] volume_usage_audit_period = month {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] zoning_mode = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_concurrency.disable_process_locking = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] keystone_authtoken.auth_section = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] keystone_authtoken.auth_type = password {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] keystone_authtoken.auth_version = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] keystone_authtoken.cache = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] keystone_authtoken.certfile = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] keystone_authtoken.delay_auth_decision = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] keystone_authtoken.http_connect_timeout = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] keystone_authtoken.include_service_catalog = True {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] keystone_authtoken.insecure = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] keystone_authtoken.interface = public {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] keystone_authtoken.keyfile = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] keystone_authtoken.memcache_password = **** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] keystone_authtoken.memcache_username = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] keystone_authtoken.region_name = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] keystone_authtoken.service_token_roles_required = True {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] keystone_authtoken.service_type = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] keystone_authtoken.token_cache_time = 300 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.232/identity {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cache.backend = dogpile.cache.null {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cache.backend_argument = **** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cache.backend_expiration_time = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cache.config_prefix = cache.oslo {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cache.debug_cache_backend = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cache.enable_retry_client = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cache.enable_socket_keepalive = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cache.enabled = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cache.expiration_time = 600 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cache.hashclient_retry_attempts = 2 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cache.memcache_dead_retry = 300 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cache.memcache_pool_maxsize = 10 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cache.memcache_sasl_enabled = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cache.password = **** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cache.proxies = [] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cache.redis_db = 0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cache.redis_sentinel_service_name = mymaster {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75175]: INFO cinder.volume.manager [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Starting volume driver LVMVolumeDriver (3.0.0) Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cache.redis_server = localhost:6379 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cache.retry_attempts = 2 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cache.retry_delay = 0.0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cache.socket_keepalive_count = 1 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cache.socket_keepalive_idle = 1 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cache.socket_keepalive_interval = 1 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cache.socket_timeout = 1.0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cache.tls_allowed_ciphers = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cache.tls_cafile = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cache.tls_certfile = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cache.tls_enabled = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cache.tls_keyfile = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cache.username = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] coordination.backend_url = **** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] database.asyncio_connection = **** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] database.asyncio_slave_connection = **** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] database.backend = sqlalchemy {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] database.connection = **** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] database.connection_debug = 0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] database.connection_parameters = {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] database.connection_recycle_time = 3600 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] database.connection_trace = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] database.db_inc_retry_interval = True {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] database.db_max_retries = 20 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] database.db_max_retry_interval = 10 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] database.db_retry_interval = 1 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] database.max_overflow = 50 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] database.max_pool_size = 5 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] database.max_retries = 10 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] database.mysql_wsrep_sync_wait = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] database.pool_timeout = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] database.retry_interval = 10 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] database.slave_connection = **** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] database.sqlite_synchronous = True {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] database.synchronous_reader = True {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] database.use_db_reconnect = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_tracing.insecure = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] profiler.connection_string = messaging:// {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] profiler.enabled = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] profiler.es_doc_type = notification {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] profiler.es_scroll_size = 10000 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] profiler.es_scroll_time = 2m {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] profiler.filter_error_trace = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] profiler.hmac_keys = **** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] profiler.sentinel_service_name = mymaster {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] profiler.socket_timeout = 0.1 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] profiler.trace_requests = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] profiler.trace_sqlalchemy = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] profiler_jaeger.process_tags = {} {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] profiler_jaeger.service_name_prefix = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] profiler_otlp.service_name_prefix = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_policy.enforce_new_defaults = True {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_policy.policy_default_rule = default {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_policy.policy_file = policy.yaml {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_policy.remote_timeout = 60.0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] privsep_osbrick.group = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] privsep_osbrick.helper_command = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] privsep_osbrick.user = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cinder_sys_admin.group = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cinder_sys_admin.helper_command = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] cinder_sys_admin.user = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] service_user.auth_section = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] service_user.auth_type = password {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] service_user.cafile = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] service_user.certfile = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] service_user.collect_timing = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] service_user.insecure = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] service_user.keyfile = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] service_user.send_service_user_token = True {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] service_user.split_loggers = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] service_user.timeout = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] glance.auth_section = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] glance.auth_type = password {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] glance.certfile = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] glance.collect_timing = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] glance.insecure = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] glance.keyfile = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] glance.region_name = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] glance.split_loggers = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.049s {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] glance.timeout = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.backend_availability_zone = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.chap_password = **** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.chap_username = {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.disk_geometry = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.driver_client_cert = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.driver_client_cert_key = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.driver_data_namespace = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.driver_use_ssl = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.enable_unsupported_driver = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.extra_capabilities = {} {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.filter_function = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.goodness_function = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.iscsi_target_flags = {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.iscsi_write_cache = on {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.iser_helper = tgtadm {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.iser_ip_address = 192.168.122.232 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.iser_port = 3260 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.lvm_mirrors = 0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.lvm_share_target = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.lvm_type = auto {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.num_shell_tries = 3 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.nvmet_port_id = 1 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.replication_device = **** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.report_discard_supported = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.reserved_percentage = 0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.scst_target_driver = iscsi {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.scst_target_iqn_name = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.storage_protocol = iSCSI {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.target_helper = tgtadm {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.target_ip_address = 192.168.122.232 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.target_port = 3260 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.target_protocol = iscsi {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.trace_flags = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.unique_fqdn_network = True {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.use_chap_auth = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.volume_backend_name = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.volume_clear = zero {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.volume_clear_ionice = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.volume_clear_size = 0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.volume_group = cinder-volumes {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_reports.file_event_handler = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_reports.log_dir = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.backend_availability_zone = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.backend_host = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.chap_password = **** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.chap_username = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.chiscsi_conf = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.disk_geometry = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.driver_client_cert = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.driver_data_namespace = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.driver_use_ssl = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:06:35 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.extra_capabilities = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.filter_function = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.goodness_function = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.iser_helper = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.iser_ip_address = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.iser_port = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.iser_target_prefix = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.lvm_conf_file = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.lvm_mirrors = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.lvm_share_target = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.lvm_type = auto {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.num_shell_tries = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.nvmet_port_id = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.replication_device = **** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.report_discard_supported = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.reserved_percentage = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.scst_target_driver = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.storage_protocol = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.target_helper = lioadm {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.target_ip_address = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.target_port = 3260 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.target_protocol = iscsi {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.trace_flags = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.use_chap_auth = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.volume_clear = zero {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.volume_clear_size = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] lvmdriver-1.volumes_dir = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_rabbit.ssl = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_rabbit.ssl_version = {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_notifications.driver = [] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_notifications.retry = -1 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] oslo_messaging_notifications.transport_url = **** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] key_manager.fixed_key = **** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] barbican.barbican_api_version = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] barbican.barbican_endpoint = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] barbican.barbican_endpoint_type = public {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] barbican.barbican_region_name = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] barbican.cafile = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] barbican.certfile = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] barbican.collect_timing = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] barbican.insecure = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] barbican.keyfile = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] barbican.number_of_retries = 60 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] barbican.retry_delay = 1 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] barbican.send_service_user_token = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] barbican.split_loggers = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] barbican.timeout = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] barbican.verify_ssl = True {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] barbican.verify_ssl_path = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] barbican_service_user.auth_section = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] barbican_service_user.auth_type = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] barbican_service_user.cafile = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] barbican_service_user.certfile = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] barbican_service_user.collect_timing = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] barbican_service_user.insecure = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] barbican_service_user.keyfile = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack sudo[75179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Aug 31 15:06:35 devstack sudo[75179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] barbican_service_user.split_loggers = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] barbican_service_user.timeout = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] vault.approle_role_id = **** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] vault.approle_secret_id = **** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] vault.auth_method = approle {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] vault.auth_path = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] vault.kv_mountpoint = secret {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] vault.kv_path = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] vault.kv_version = 2 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] vault.namespace = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] vault.root_token_id = **** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] vault.ssl_ca_crt_file = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] vault.timeout = 60.0 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] vault.token_file = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] vault.token_role = None {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] vault.use_ssl = False {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:06:35 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] ******************************************************************************** {{(pid=75013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 31 15:06:36 devstack sudo[75179]: pam_unix(sudo:session): session closed for user root Aug 31 15:06:36 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.355s {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:06:36 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:06:36 devstack sudo[75251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 31 15:06:36 devstack sudo[75251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:06:36 devstack sudo[75251]: pam_unix(sudo:session): session closed for user root Aug 31 15:06:36 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.267s {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:06:36 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 31 15:06:36 devstack cinder-volume[75175]: INFO cinder.brick.local_dev.lvm [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Aug 31 15:06:36 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:06:36 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:06:36 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:06:36 devstack sudo[75358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 31 15:06:36 devstack sudo[75358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:06:36 devstack sudo[75358]: pam_unix(sudo:session): session closed for user root Aug 31 15:06:36 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:06:36 devstack cinder-volume[75175]: DEBUG cinder.brick.local_dev.lvm [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75175) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Aug 31 15:06:36 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:06:36 devstack sudo[75441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 31 15:06:36 devstack sudo[75441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:06:37 devstack sudo[75441]: pam_unix(sudo:session): session closed for user root Aug 31 15:06:37 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.497s {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:06:37 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:06:37 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:06:37 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:06:37 devstack sudo[75633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 31 15:06:37 devstack sudo[75633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:06:37 devstack sudo[75633]: pam_unix(sudo:session): session closed for user root Aug 31 15:06:37 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.282s {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:06:37 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:06:37 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:06:37 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:06:37 devstack sudo[75710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Aug 31 15:06:37 devstack sudo[75710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:06:37 devstack sudo[75710]: pam_unix(sudo:session): session closed for user root Aug 31 15:06:37 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.304s {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:06:37 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:06:37 devstack sudo[75788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 31 15:06:37 devstack sudo[75788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:06:38 devstack sudo[75788]: pam_unix(sudo:session): session closed for user root Aug 31 15:06:38 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:06:38 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:06:38 devstack sudo[75796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 31 15:06:38 devstack sudo[75796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:06:38 devstack sudo[75796]: pam_unix(sudo:session): session closed for user root Aug 31 15:06:38 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.390s {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:06:38 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:06:38 devstack sudo[75874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 31 15:06:38 devstack sudo[75874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:06:38 devstack sudo[75874]: pam_unix(sudo:session): session closed for user root Aug 31 15:06:38 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.316s {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:06:38 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:06:38 devstack sudo[75898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 31 15:06:38 devstack sudo[75898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:06:39 devstack sudo[75898]: pam_unix(sudo:session): session closed for user root Aug 31 15:06:39 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.318s {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:06:39 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:06:39 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:06:39 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:06:39 devstack sudo[75974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 31 15:06:39 devstack sudo[75974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:06:39 devstack sudo[75974]: pam_unix(sudo:session): session closed for user root Aug 31 15:06:39 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:06:39 devstack cinder-volume[75175]: INFO cinder.volume.drivers.lvm [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Enabling LVM thin provisioning by default because a thin pool exists. Aug 31 15:06:39 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:06:39 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:06:39 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:06:39 devstack sudo[75978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 31 15:06:39 devstack sudo[75978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:06:39 devstack sudo[75978]: pam_unix(sudo:session): session closed for user root Aug 31 15:06:39 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.232s {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:06:39 devstack cinder-volume[75175]: DEBUG cinder.volume.drivers.lvm [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Updating volume stats {{(pid=75175) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 31 15:06:39 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:06:39 devstack sudo[75981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 31 15:06:39 devstack sudo[75981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:06:39 devstack sudo[75981]: pam_unix(sudo:session): session closed for user root Aug 31 15:06:40 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.240s {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:06:40 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:06:40 devstack sudo[75984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 31 15:06:40 devstack sudo[75984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:06:40 devstack sudo[75984]: pam_unix(sudo:session): session closed for user root Aug 31 15:06:40 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:06:40 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:06:40 devstack sudo[75987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 31 15:06:40 devstack sudo[75987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:06:40 devstack sudo[75987]: pam_unix(sudo:session): session closed for user root Aug 31 15:06:40 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:06:40 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:06:40 devstack sudo[75990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 31 15:06:40 devstack sudo[75990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:06:40 devstack sudo[75990]: pam_unix(sudo:session): session closed for user root Aug 31 15:06:40 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.232s {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:06:40 devstack cinder-volume[75175]: INFO cinder.volume.driver [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Driver hasn't implemented _init_vendor_properties() Aug 31 15:06:40 devstack cinder-volume[75175]: DEBUG cinder.volume.driver [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75175) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 31 15:06:40 devstack cinder-volume[75175]: DEBUG oslo_db.sqlalchemy.engines [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75175) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 31 15:06:40 devstack cinder-volume[75175]: DEBUG dbcounter [-] [75175] Writer thread running {{(pid=75175) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 31 15:06:40 devstack cinder-volume[75175]: DEBUG cinder.db.api [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Building query based on filter {{(pid=75175) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 31 15:06:40 devstack cinder-volume[75175]: DEBUG cinder.image.image_utils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75175) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 31 15:06:40 devstack cinder-volume[75175]: INFO cinder.keymgr.migration [None req-a85df16b-219c-40d8-84b2-d71b0f75ea27 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 31 15:06:40 devstack cinder-volume[75175]: DEBUG cinder.volume.drivers.lvm [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Updating volume stats {{(pid=75175) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 31 15:06:40 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:06:40 devstack sudo[75993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 31 15:06:40 devstack sudo[75993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:06:41 devstack sudo[75993]: pam_unix(sudo:session): session closed for user root Aug 31 15:06:41 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:06:41 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:06:41 devstack sudo[75996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 31 15:06:41 devstack sudo[75996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:06:41 devstack sudo[75996]: pam_unix(sudo:session): session closed for user root Aug 31 15:06:41 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:06:41 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:06:41 devstack sudo[76002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 31 15:06:41 devstack sudo[76002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:06:41 devstack sudo[76002]: pam_unix(sudo:session): session closed for user root Aug 31 15:06:41 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.303s {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:06:41 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:06:41 devstack sudo[76005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 31 15:06:41 devstack sudo[76005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:06:41 devstack sudo[76005]: pam_unix(sudo:session): session closed for user root Aug 31 15:06:41 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:06:41 devstack cinder-volume[75175]: DEBUG cinder.manager [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Notifying Schedulers of capabilities ... {{(pid=75175) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:06:42 devstack cinder-volume[75175]: INFO cinder.volume.manager [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Driver initialization completed successfully. Aug 31 15:06:42 devstack cinder-volume[75175]: INFO cinder.manager [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Initiating service 2 cleanup Aug 31 15:06:42 devstack cinder-volume[75175]: INFO cinder.manager [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Service 2 cleanup completed. Aug 31 15:06:42 devstack cinder-volume[75175]: DEBUG cinder.service [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Creating RPC server for service cinder-volume {{(pid=75175) start /opt/stack/cinder/cinder/service.py:231}} Aug 31 15:06:42 devstack cinder-volume[75175]: DEBUG cinder.service [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75175) start /opt/stack/cinder/cinder/service.py:237}} Aug 31 15:06:42 devstack cinder-volume[75175]: INFO cinder.volume.manager [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Aug 31 15:06:42 devstack cinder-volume[75175]: DEBUG cinder.volume.drivers.lvm [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Updating volume stats {{(pid=75175) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 31 15:06:42 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:06:42 devstack sudo[76008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 31 15:06:42 devstack sudo[76008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:06:42 devstack sudo[76008]: pam_unix(sudo:session): session closed for user root Aug 31 15:06:42 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.325s {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:06:42 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:06:42 devstack sudo[76014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 31 15:06:42 devstack sudo[76014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:06:42 devstack sudo[76014]: pam_unix(sudo:session): session closed for user root Aug 31 15:06:42 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:06:42 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:06:42 devstack sudo[76019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 31 15:06:42 devstack sudo[76019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:06:43 devstack sudo[76019]: pam_unix(sudo:session): session closed for user root Aug 31 15:06:43 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.290s {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:06:43 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:06:43 devstack sudo[76022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 31 15:06:43 devstack sudo[76022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:06:43 devstack sudo[76022]: pam_unix(sudo:session): session closed for user root Aug 31 15:06:43 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:06:43 devstack cinder-volume[75175]: INFO cinder.volume.manager [None req-bc1ef276-0702-49c8-a72a-e42199bbd321 None None] Driver post RPC initialization completed successfully. Aug 31 15:06:45 devstack cinder-volume[75013]: DEBUG dbcounter [-] [75013] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:06:53 devstack cinder-volume[75175]: DEBUG dbcounter [-] [75175] Writing DB stats cinder:SELECT=3 {{(pid=75175) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:06:53 devstack cinder-volume[75175]: DEBUG dbcounter [-] [75175] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75175) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:07:06 devstack cinder-volume[75175]: DEBUG oslo_service.periodic_task [None req-7fdda53e-4823-4406-acbd-019227652029 None None] Running periodic task VolumeManager._thread_info {{(pid=75175) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:07:06 devstack cinder-volume[75175]: DEBUG cinder.volume.manager [None req-7fdda53e-4823-4406-acbd-019227652029 None None] thread count: 6 {{(pid=75175) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 31 15:07:06 devstack cinder-volume[75175]: DEBUG cinder.volume.manager [None req-7fdda53e-4823-4406-acbd-019227652029 None None] thread info: [<_MainThread(MainThread, started 133064138502272)>, , , , , ] {{(pid=75175) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 31 15:08:06 devstack cinder-volume[75175]: DEBUG oslo_service.periodic_task [None req-7fdda53e-4823-4406-acbd-019227652029 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75175) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:08:06 devstack cinder-volume[75175]: DEBUG cinder.volume.drivers.lvm [None req-7fdda53e-4823-4406-acbd-019227652029 None None] Updating volume stats {{(pid=75175) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 31 15:08:06 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-7fdda53e-4823-4406-acbd-019227652029 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:08:06 devstack sudo[78691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 31 15:08:06 devstack sudo[78691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:08:06 devstack sudo[78691]: pam_unix(sudo:session): session closed for user root Aug 31 15:08:06 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-7fdda53e-4823-4406-acbd-019227652029 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:08:06 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-7fdda53e-4823-4406-acbd-019227652029 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:08:06 devstack sudo[78694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 31 15:08:06 devstack sudo[78694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:08:06 devstack sudo[78694]: pam_unix(sudo:session): session closed for user root Aug 31 15:08:06 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-7fdda53e-4823-4406-acbd-019227652029 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.237s {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:08:06 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-7fdda53e-4823-4406-acbd-019227652029 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:08:06 devstack sudo[78697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 31 15:08:06 devstack sudo[78697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:08:07 devstack sudo[78697]: pam_unix(sudo:session): session closed for user root Aug 31 15:08:07 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-7fdda53e-4823-4406-acbd-019227652029 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:08:07 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-7fdda53e-4823-4406-acbd-019227652029 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:08:07 devstack sudo[78700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 31 15:08:07 devstack sudo[78700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:08:07 devstack sudo[78700]: pam_unix(sudo:session): session closed for user root Aug 31 15:08:07 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-7fdda53e-4823-4406-acbd-019227652029 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:08:07 devstack cinder-volume[75175]: DEBUG cinder.manager [None req-7fdda53e-4823-4406-acbd-019227652029 None None] Notifying Schedulers of capabilities ... {{(pid=75175) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:08:07 devstack cinder-volume[75175]: DEBUG oslo_service.periodic_task [None req-7fdda53e-4823-4406-acbd-019227652029 None None] Running periodic task VolumeManager._thread_info {{(pid=75175) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:08:07 devstack cinder-volume[75175]: DEBUG cinder.volume.manager [None req-7fdda53e-4823-4406-acbd-019227652029 None None] thread count: 6 {{(pid=75175) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 31 15:08:07 devstack cinder-volume[75175]: DEBUG cinder.volume.manager [None req-7fdda53e-4823-4406-acbd-019227652029 None None] thread info: [<_MainThread(MainThread, started 133064138502272)>, , , , , ] {{(pid=75175) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 31 15:08:53 devstack cinder-volume[75175]: DEBUG dbcounter [-] [75175] Writing DB stats cinder:SELECT=1 {{(pid=75175) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:08:53 devstack cinder-volume[75175]: DEBUG dbcounter [-] [75175] Writing DB stats cinder:UPDATE=1 {{(pid=75175) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:09:06 devstack cinder-volume[75175]: DEBUG oslo_service.periodic_task [None req-7fdda53e-4823-4406-acbd-019227652029 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75175) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:09:06 devstack cinder-volume[75175]: DEBUG cinder.volume.drivers.lvm [None req-7fdda53e-4823-4406-acbd-019227652029 None None] Updating volume stats {{(pid=75175) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 31 15:09:06 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-7fdda53e-4823-4406-acbd-019227652029 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:09:06 devstack sudo[82310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 31 15:09:06 devstack sudo[82310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:09:06 devstack sudo[82310]: pam_unix(sudo:session): session closed for user root Aug 31 15:09:06 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-7fdda53e-4823-4406-acbd-019227652029 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:09:06 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-7fdda53e-4823-4406-acbd-019227652029 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:09:06 devstack sudo[82313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 31 15:09:06 devstack sudo[82313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:09:06 devstack sudo[82313]: pam_unix(sudo:session): session closed for user root Aug 31 15:09:06 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-7fdda53e-4823-4406-acbd-019227652029 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.240s {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:09:06 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-7fdda53e-4823-4406-acbd-019227652029 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:09:06 devstack sudo[82316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 31 15:09:06 devstack sudo[82316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:09:07 devstack sudo[82316]: pam_unix(sudo:session): session closed for user root Aug 31 15:09:07 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-7fdda53e-4823-4406-acbd-019227652029 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:09:07 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-7fdda53e-4823-4406-acbd-019227652029 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:09:07 devstack sudo[82356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 31 15:09:07 devstack sudo[82356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:09:07 devstack sudo[82356]: pam_unix(sudo:session): session closed for user root Aug 31 15:09:07 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-7fdda53e-4823-4406-acbd-019227652029 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:09:07 devstack cinder-volume[75175]: DEBUG cinder.manager [None req-7fdda53e-4823-4406-acbd-019227652029 None None] Notifying Schedulers of capabilities ... {{(pid=75175) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:10:06 devstack cinder-volume[75175]: DEBUG oslo_service.periodic_task [None req-7fdda53e-4823-4406-acbd-019227652029 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75175) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:10:06 devstack cinder-volume[75175]: DEBUG cinder.volume.drivers.lvm [None req-7fdda53e-4823-4406-acbd-019227652029 None None] Updating volume stats {{(pid=75175) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 31 15:10:06 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-7fdda53e-4823-4406-acbd-019227652029 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:10:06 devstack sudo[84032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 31 15:10:06 devstack sudo[84032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:10:06 devstack sudo[84032]: pam_unix(sudo:session): session closed for user root Aug 31 15:10:06 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-7fdda53e-4823-4406-acbd-019227652029 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:10:06 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-7fdda53e-4823-4406-acbd-019227652029 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:10:06 devstack sudo[84074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 31 15:10:06 devstack sudo[84074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:10:06 devstack sudo[84074]: pam_unix(sudo:session): session closed for user root Aug 31 15:10:06 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-7fdda53e-4823-4406-acbd-019227652029 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:10:07 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-7fdda53e-4823-4406-acbd-019227652029 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:10:07 devstack sudo[84080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 31 15:10:07 devstack sudo[84080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:10:07 devstack sudo[84080]: pam_unix(sudo:session): session closed for user root Aug 31 15:10:07 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-7fdda53e-4823-4406-acbd-019227652029 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:10:07 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-7fdda53e-4823-4406-acbd-019227652029 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:10:07 devstack sudo[84083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 31 15:10:07 devstack sudo[84083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:10:07 devstack sudo[84083]: pam_unix(sudo:session): session closed for user root Aug 31 15:10:07 devstack cinder-volume[75175]: DEBUG oslo_concurrency.processutils [None req-7fdda53e-4823-4406-acbd-019227652029 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75175) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:10:07 devstack cinder-volume[75175]: DEBUG cinder.manager [None req-7fdda53e-4823-4406-acbd-019227652029 None None] Notifying Schedulers of capabilities ... {{(pid=75175) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:10:07 devstack cinder-volume[75175]: DEBUG oslo_service.periodic_task [None req-7fdda53e-4823-4406-acbd-019227652029 None None] Running periodic task VolumeManager._thread_info {{(pid=75175) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:10:07 devstack cinder-volume[75175]: DEBUG cinder.volume.manager [None req-7fdda53e-4823-4406-acbd-019227652029 None None] thread count: 6 {{(pid=75175) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 31 15:10:07 devstack cinder-volume[75175]: DEBUG cinder.volume.manager [None req-7fdda53e-4823-4406-acbd-019227652029 None None] thread info: [<_MainThread(MainThread, started 133064138502272)>, , , , , ] {{(pid=75175) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 31 15:10:53 devstack cinder-volume[75175]: DEBUG dbcounter [-] [75175] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75175) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:10:56 devstack cinder-volume[75013]: INFO oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] Caught SIGTERM, stopping children Aug 31 15:10:56 devstack cinder-volume[75013]: DEBUG oslo_concurrency.lockutils [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] Acquiring lock "singleton_lock" {{(pid=75013) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 31 15:10:56 devstack cinder-volume[75013]: DEBUG oslo_concurrency.lockutils [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] Acquired lock "singleton_lock" {{(pid=75013) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 31 15:10:56 devstack cinder-volume[75013]: DEBUG oslo_concurrency.lockutils [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] Releasing lock "singleton_lock" {{(pid=75013) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 31 15:10:56 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] Stop services. {{(pid=75013) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 31 15:10:56 devstack cinder-volume[75013]: DEBUG oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] Killing children. {{(pid=75013) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 31 15:10:56 devstack cinder-volume[75013]: INFO oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] Waiting on 1 children to exit Aug 31 15:10:57 devstack cinder-volume[75175]: DEBUG oslo_concurrency.lockutils [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] Acquiring lock "singleton_lock" {{(pid=75175) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 31 15:10:57 devstack cinder-volume[75175]: DEBUG oslo_concurrency.lockutils [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] Acquired lock "singleton_lock" {{(pid=75175) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 31 15:10:57 devstack cinder-volume[75175]: DEBUG oslo_concurrency.lockutils [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] Releasing lock "singleton_lock" {{(pid=75175) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 31 15:10:57 devstack cinder-volume[75175]: WARNING amqp [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 31 15:10:57 devstack cinder-volume[75175]: WARNING amqp [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 31 15:10:57 devstack cinder-volume[75013]: INFO oslo_service.backend._eventlet.service [None req-45321473-beed-470b-8b43-ef189b0ecccc None None] Child 75175 exited with status 0 Aug 31 15:10:57 devstack cinder-volume[85118]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 31 15:10:57 devstack cinder-volume[85118]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 31 15:10:57 devstack cinder-volume[85118]: we strongly recommend against using it for new projects. Aug 31 15:10:57 devstack cinder-volume[85118]: If you are already using Eventlet, we recommend migrating to a different Aug 31 15:10:57 devstack cinder-volume[85118]: framework. For more detail see Aug 31 15:10:57 devstack cinder-volume[85118]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 31 15:10:57 devstack cinder-volume[85118]: import eventlet # noqa Aug 31 15:10:59 devstack cinder-volume[85118]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85118) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 31 15:10:59 devstack cinder-volume[85118]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85118) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 31 15:10:59 devstack cinder-volume[85118]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85118) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 31 15:11:00 devstack cinder-volume[85118]: INFO dbcounter [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] Registered counter for database cinder Aug 31 15:11:00 devstack cinder-volume[85118]: DEBUG oslo_db.sqlalchemy.engines [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85118) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 31 15:11:00 devstack cinder-volume[85118]: DEBUG dbcounter [-] [85118] Writer thread running {{(pid=85118) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 31 15:11:00 devstack cinder-volume[85118]: INFO cinder.rpc [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 31 15:11:00 devstack cinder-volume[85118]: INFO cinder.rpc [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 31 15:11:00 devstack cinder-volume[85118]: DEBUG oslo_db.sqlalchemy.engines [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85118) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 31 15:11:00 devstack cinder-volume[85118]: INFO cinder.volume.manager [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] Determined volume DB was empty at startup. Aug 31 15:11:00 devstack cinder-volume[85118]: DEBUG cinder.volume.manager [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85118) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 31 15:11:00 devstack cinder-volume[85118]: INFO cinder.volume.manager [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 31 15:11:00 devstack cinder-volume[85118]: WARNING stevedore.named [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 31 15:11:00 devstack cinder-volume[85118]: WARNING castellan.key_manager [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 31 15:11:00 devstack cinder-volume[85118]: WARNING cinder.keymgr.conf_key_mgr [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 31 15:11:00 devstack cinder-volume[85118]: INFO cinder.volume.manager [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 31 15:11:00 devstack cinder-volume[85118]: DEBUG oslo_db.sqlalchemy.engines [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85118) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 31 15:11:00 devstack cinder-volume[85118]: INFO oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] Starting 1 workers Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] Started child 85363 {{(pid=85118) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] Full set of CONF: {{(pid=85118) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] ******************************************************************************** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] Configuration options gathered from: {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] ================================================================================ {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] allow_availability_zone_fallback = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] allow_compression_on_image_upload = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] allowed_direct_url_schemes = [] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] api_rate_limit = True {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] auth_strategy = keystone {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_availability_zone = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_host = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_name = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_stats_polling_interval = 60 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backup_api_class = cinder.backup.api.API {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backup_name_template = backup-%s {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85363]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backup_use_same_host = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backup_use_temp_snapshot = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] chap_password = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] chap_username = {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cinder_internal_tenant_project_id = d5515742ca7548c2b7491fdf4bf97ae9 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cinder_internal_tenant_user_id = 3aaa775e6f5b4bb78fc2223c402fc625 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cluster = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] compression_format = gzip {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] compute_api_class = cinder.compute.nova.API {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] config_dir = [] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] config_source = [] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] control_exchange = openstack {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] debug = True {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] default_availability_zone = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] default_group_type = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] default_volume_type = QuobyteHD {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] disk_geometry = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] driver_client_cert = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] driver_client_cert_key = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] driver_data_namespace = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] driver_ssl_cert_path = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] driver_ssl_cert_verify = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] driver_use_ssl = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] enable_new_services = True {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] enable_unsupported_driver = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] enabled_backends = ['QuobyteHD'] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] enforce_multipath_for_image_xfer = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] filter_function = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] glance_api_insecure = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] glance_api_servers = ['http://192.168.122.232/image'] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] glance_api_ssl_compression = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] glance_ca_certificates_file = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] glance_catalog_info = image:glance:publicURL {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] glance_certfile = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] glance_keyfile = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] glance_num_retries = 3 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] glance_request_timeout = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] goodness_function = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] graceful_shutdown_timeout = 5 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] group_api_class = cinder.group.api.API {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] host = devstack {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] image_compress_on_upload = True {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] image_conversion_address_space_limit = 1 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] image_conversion_cpu_limit = 60 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] image_conversion_disable = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] image_upload_use_cinder_backend = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] image_upload_use_internal_tenant = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] image_volume_cache_enabled = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] image_volume_cache_max_count = 0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] image_volume_cache_max_size_gb = 0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] init_host_max_objects_retrieval = 0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] instance_format = [instance: %(uuid)s] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] iscsi_target_flags = {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] iscsi_write_cache = on {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] iser_helper = tgtadm {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] iser_ip_address = 192.168.122.232 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] iser_port = 3260 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] log_color = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] log_config_append = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] log_dir = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] log_file = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] log_options = True {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] log_rotate_interval = 1 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] log_rotate_interval_type = days {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] log_rotation_type = none {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] max_age = 0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] max_logfile_count = 30 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] max_logfile_size_mb = 200 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] max_over_subscription_ratio = 20.0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] message_reap_interval = 86400 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] message_ttl = 2592000 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] migration_create_volume_timeout_secs = 300 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] monkey_patch = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] monkey_patch_modules = [] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] my_ip = 192.168.122.232 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85363]: INFO cinder.volume.manager [None req-07186165-42c6-4408-80d0-6f8369b374c8 None None] Starting volume driver QuobyteDriver (1.2.1) Aug 31 15:11:01 devstack cinder-volume[85363]: DEBUG cinder.volume.drivers.remotefs [None req-07186165-42c6-4408-80d0-6f8369b374c8 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85363) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] no_snapshot_gb_quota = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] num_iser_scan_tries = 3 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] num_shell_tries = 3 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] num_volume_device_scan_tries = 3 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] nvmeof_conn_info_version = 1 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] nvmet_ns_id = 10 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] nvmet_port_id = 1 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] osapi_max_limit = 1000 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] osapi_volume_ext_list = [] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] osapi_volume_listen_port = 8776 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] osapi_volume_use_ssl = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] osapi_volume_workers = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] per_volume_size_limit = -1 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] periodic_fuzzy_delay = 60 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] periodic_interval = 60 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] public_endpoint = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] publish_errors = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] quota_backup_gigabytes = 1000 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] quota_backups = 10 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] quota_gigabytes = 1000 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] quota_groups = 10 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] quota_snapshots = 10 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] quota_volumes = 10 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] rate_limit_burst = 0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] rate_limit_except_level = CRITICAL {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] rate_limit_interval = 0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] reinit_driver_count = 3 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] replication_device = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] report_discard_supported = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] report_interval = 120 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] reservation_clean_interval = 86400 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] reservation_expire = 86400 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] reserved_image_namespaces = [] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] reserved_percentage = 0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] rpc_response_timeout = 120 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] run_external_periodic_tasks = True {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] scst_target_driver = iscsi {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] scst_target_iqn_name = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] service_down_time = 720 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] shell_completion = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] snapshot_name_template = snapshot-%s {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] split_loggers = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] state_path = /opt/stack/data/cinder {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] storage_availability_zone = nova {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] storage_protocol = iSCSI {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] syslog_log_facility = LOG_USER {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] target_helper = lioadm {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] target_ip_address = 192.168.122.232 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] target_port = 3260 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] target_protocol = iscsi {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] target_secondary_ip_addresses = [] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] trace_flags = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] transport_url = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] until_refresh = 0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] use_chap_auth = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] use_default_quota_class = True {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] use_journal = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] use_json = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] use_multipath_for_image_xfer = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] use_stderr = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] use_syslog = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] verify_glance_signatures = enabled {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] volume_api_class = cinder.volume.api.API {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] volume_backend_name = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] volume_clear = zero {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] volume_clear_ionice = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] volume_clear_size = 0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] volume_copy_bps_limit = 0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] volume_dd_blocksize = 1M {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] volume_name_template = volume-%s {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] volume_service_inithost_offload = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] volume_usage_audit_period = month {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] zoning_mode = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_concurrency.disable_process_locking = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] keystone_authtoken.auth_section = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] keystone_authtoken.auth_type = password {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] keystone_authtoken.auth_version = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] keystone_authtoken.cache = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] keystone_authtoken.certfile = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] keystone_authtoken.include_service_catalog = True {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] keystone_authtoken.insecure = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] keystone_authtoken.interface = public {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] keystone_authtoken.keyfile = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] keystone_authtoken.memcache_password = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] keystone_authtoken.memcache_username = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] keystone_authtoken.region_name = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] keystone_authtoken.service_type = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.232/identity {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cache.backend = dogpile.cache.null {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cache.backend_argument = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cache.backend_expiration_time = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cache.config_prefix = cache.oslo {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cache.debug_cache_backend = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cache.enable_retry_client = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cache.enable_socket_keepalive = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cache.enabled = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cache.expiration_time = 600 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cache.hashclient_retry_attempts = 2 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cache.memcache_dead_retry = 300 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cache.memcache_pool_maxsize = 10 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cache.memcache_sasl_enabled = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cache.password = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cache.proxies = [] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cache.redis_db = 0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cache.redis_server = localhost:6379 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cache.retry_attempts = 2 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cache.retry_delay = 0.0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cache.socket_keepalive_count = 1 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cache.socket_keepalive_idle = 1 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cache.socket_keepalive_interval = 1 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cache.socket_timeout = 1.0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cache.tls_allowed_ciphers = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cache.tls_cafile = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cache.tls_certfile = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85363]: DEBUG cinder.volume.drivers.quobyte [None req-07186165-42c6-4408-80d0-6f8369b374c8 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85363) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cache.tls_enabled = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cache.tls_keyfile = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cache.username = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] coordination.backend_url = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] database.asyncio_connection = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] database.asyncio_slave_connection = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] database.backend = sqlalchemy {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85363]: WARNING cinder.volume.drivers.quobyte [None req-07186165-42c6-4408-80d0-6f8369b374c8 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] database.connection = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] database.connection_debug = 0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] database.connection_parameters = {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] database.connection_recycle_time = 3600 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] database.connection_trace = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85363]: WARNING cinder.volume.drivers.quobyte [None req-07186165-42c6-4408-80d0-6f8369b374c8 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] database.db_inc_retry_interval = True {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] database.db_max_retries = 20 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] database.db_max_retry_interval = 10 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] database.db_retry_interval = 1 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] database.max_overflow = 50 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] database.max_pool_size = 5 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] database.max_retries = 10 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] database.mysql_wsrep_sync_wait = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] database.pool_timeout = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] database.retry_interval = 10 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] database.slave_connection = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] database.sqlite_synchronous = True {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] database.synchronous_reader = True {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] database.use_db_reconnect = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_tracing.insecure = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] profiler.connection_string = messaging:// {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] profiler.enabled = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] profiler.es_doc_type = notification {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] profiler.es_scroll_size = 10000 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] profiler.es_scroll_time = 2m {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] profiler.filter_error_trace = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] profiler.hmac_keys = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] profiler.sentinel_service_name = mymaster {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] profiler.socket_timeout = 0.1 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] profiler.trace_requests = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] profiler.trace_sqlalchemy = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] profiler_jaeger.process_tags = {} {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] profiler_jaeger.service_name_prefix = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] profiler_otlp.service_name_prefix = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_policy.enforce_new_defaults = True {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_policy.policy_default_rule = default {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_policy.policy_file = policy.yaml {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] privsep_osbrick.group = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] privsep_osbrick.helper_command = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] privsep_osbrick.user = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cinder_sys_admin.group = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cinder_sys_admin.helper_command = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] cinder_sys_admin.user = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] service_user.auth_section = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] service_user.auth_type = password {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] service_user.cafile = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] service_user.certfile = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] service_user.collect_timing = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] service_user.insecure = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] service_user.keyfile = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] service_user.send_service_user_token = True {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] service_user.split_loggers = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] service_user.timeout = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] glance.auth_section = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] glance.auth_type = password {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] glance.certfile = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] glance.collect_timing = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] glance.insecure = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] glance.keyfile = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] glance.region_name = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] glance.split_loggers = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] glance.timeout = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.backend_availability_zone = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.chap_password = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.chap_username = {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.disk_geometry = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.driver_client_cert = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.driver_client_cert_key = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.driver_data_namespace = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.driver_use_ssl = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.extra_capabilities = {} {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.filter_function = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.goodness_function = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.iscsi_target_flags = {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.iscsi_write_cache = on {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85363]: DEBUG oslo_concurrency.processutils [None req-07186165-42c6-4408-80d0-6f8369b374c8 None None] Running cmd (subprocess): mount.quobyte {{(pid=85363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.iser_helper = tgtadm {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.iser_ip_address = 192.168.122.232 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.iser_port = 3260 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.nas_host = {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.nas_login = admin {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.nas_mount_options = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.nas_password = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.nas_private_key = {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.nas_share_path = {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.num_shell_tries = 3 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.quobyte_volume_url = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.replication_device = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.report_discard_supported = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.reserved_percentage = 0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.target_helper = tgtadm {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.target_ip_address = 192.168.122.232 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.target_port = 3260 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.target_protocol = iscsi {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.trace_flags = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.unique_fqdn_network = True {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.use_chap_auth = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.volume_backend_name = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.volume_clear = zero {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.volume_clear_ionice = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.volume_clear_size = 0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_reports.file_event_handler = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_reports.log_dir = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.backend_availability_zone = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.backend_host = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.chap_password = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.chap_username = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.chiscsi_conf = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.disk_geometry = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.driver_client_cert = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.driver_data_namespace = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.driver_use_ssl = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.extra_capabilities = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.filter_function = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.goodness_function = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.iser_helper = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.iser_ip_address = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.iser_port = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.iser_target_prefix = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.nas_host = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.nas_login = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.nas_mount_options = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.nas_password = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.nas_private_key = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.nas_share_path = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.nas_ssh_port = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.num_shell_tries = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.nvmet_port_id = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.replication_device = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.report_discard_supported = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.reserved_percentage = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.scst_target_driver = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.storage_protocol = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.target_helper = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.target_ip_address = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.target_port = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.target_prefix = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.target_protocol = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.trace_flags = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.use_chap_auth = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.volume_clear = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.volume_clear_size = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] QuobyteHD.volumes_dir = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_rabbit.ssl = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_notifications.driver = [] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_notifications.retry = -1 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] key_manager.fixed_key = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] barbican.barbican_api_version = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] barbican.barbican_endpoint = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] barbican.barbican_endpoint_type = public {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] barbican.barbican_region_name = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] barbican.cafile = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] barbican.certfile = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] barbican.collect_timing = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] barbican.insecure = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] barbican.keyfile = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] barbican.number_of_retries = 60 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] barbican.retry_delay = 1 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] barbican.send_service_user_token = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] barbican.split_loggers = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] barbican.timeout = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] barbican.verify_ssl = True {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] barbican.verify_ssl_path = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] barbican_service_user.auth_section = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] barbican_service_user.auth_type = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] barbican_service_user.cafile = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] barbican_service_user.certfile = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] barbican_service_user.collect_timing = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] barbican_service_user.insecure = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] barbican_service_user.keyfile = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] barbican_service_user.split_loggers = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] barbican_service_user.timeout = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] vault.approle_role_id = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] vault.approle_secret_id = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] vault.auth_method = approle {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] vault.auth_path = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85363]: DEBUG oslo_concurrency.processutils [None req-07186165-42c6-4408-80d0-6f8369b374c8 None None] CMD "mount.quobyte" returned: 1 in 0.156s {{(pid=85363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] vault.kv_mountpoint = secret {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] vault.kv_path = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] vault.kv_version = 2 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] vault.namespace = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] vault.root_token_id = **** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] vault.ssl_ca_crt_file = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] vault.timeout = 60.0 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] vault.token_file = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] vault.token_role = None {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85363]: DEBUG oslo_concurrency.lockutils [None req-07186165-42c6-4408-80d0-6f8369b374c8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85363) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] vault.use_ssl = False {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:01 devstack cinder-volume[85363]: DEBUG oslo_concurrency.lockutils [None req-07186165-42c6-4408-80d0-6f8369b374c8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85363) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:11:01 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] ******************************************************************************** {{(pid=85118) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 31 15:11:01 devstack cinder-volume[85363]: DEBUG cinder.volume.drivers.quobyte [None req-07186165-42c6-4408-80d0-6f8369b374c8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=85363) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:11:01 devstack cinder-volume[85363]: INFO cinder.volume.drivers.quobyte [None req-07186165-42c6-4408-80d0-6f8369b374c8 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 ... Aug 31 15:11:01 devstack cinder-volume[85363]: DEBUG oslo_concurrency.processutils [None req-07186165-42c6-4408-80d0-6f8369b374c8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e -c /etc/quobyte/client-cinder.cfg {{(pid=85363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:11:01 devstack sudo[85369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e -c /etc/quobyte/client-cinder.cfg Aug 31 15:11:01 devstack sudo[85369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:11:01 devstack sudo[85369]: pam_unix(sudo:session): session closed for user root Aug 31 15:11:01 devstack cinder-volume[85363]: DEBUG oslo_concurrency.processutils [None req-07186165-42c6-4408-80d0-6f8369b374c8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.374s {{(pid=85363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:11:01 devstack cinder-volume[85363]: INFO cinder.volume.drivers.quobyte [None req-07186165-42c6-4408-80d0-6f8369b374c8 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 succeeded Aug 31 15:11:01 devstack cinder-volume[85363]: DEBUG cinder.volume.drivers.quobyte [None req-07186165-42c6-4408-80d0-6f8369b374c8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=85363) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:11:01 devstack cinder-volume[85363]: DEBUG oslo_concurrency.lockutils [None req-07186165-42c6-4408-80d0-6f8369b374c8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.385s {{(pid=85363) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:11:01 devstack cinder-volume[85363]: DEBUG oslo_concurrency.processutils [None req-07186165-42c6-4408-80d0-6f8369b374c8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=85363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:11:01 devstack sudo[85438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:11:01 devstack sudo[85438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:11:01 devstack sudo[85438]: pam_unix(sudo:session): session closed for user root Aug 31 15:11:01 devstack cinder-volume[85363]: DEBUG oslo_concurrency.processutils [None req-07186165-42c6-4408-80d0-6f8369b374c8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.239s {{(pid=85363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:11:01 devstack cinder-volume[85363]: INFO cinder.volume.driver [None req-07186165-42c6-4408-80d0-6f8369b374c8 None None] Driver hasn't implemented _init_vendor_properties() Aug 31 15:11:01 devstack cinder-volume[85363]: DEBUG cinder.volume.driver [None req-07186165-42c6-4408-80d0-6f8369b374c8 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.3757095336914, 'free_capacity_gb': 1774.3757095336914, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85363) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 31 15:11:02 devstack cinder-volume[85363]: DEBUG oslo_db.sqlalchemy.engines [None req-07186165-42c6-4408-80d0-6f8369b374c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85363) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 31 15:11:02 devstack cinder-volume[85363]: DEBUG dbcounter [-] [85363] Writer thread running {{(pid=85363) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 31 15:11:02 devstack cinder-volume[85363]: DEBUG cinder.db.api [None req-07186165-42c6-4408-80d0-6f8369b374c8 None None] Building query based on filter {{(pid=85363) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 31 15:11:02 devstack cinder-volume[85363]: DEBUG cinder.image.image_utils [None req-07186165-42c6-4408-80d0-6f8369b374c8 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85363) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 31 15:11:02 devstack cinder-volume[85363]: INFO cinder.keymgr.migration [None req-cab4e6c7-92f5-431a-aef0-f6539776d664 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 31 15:11:02 devstack cinder-volume[85363]: DEBUG oslo_concurrency.lockutils [None req-07186165-42c6-4408-80d0-6f8369b374c8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85363) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:11:02 devstack cinder-volume[85363]: DEBUG oslo_concurrency.lockutils [None req-07186165-42c6-4408-80d0-6f8369b374c8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85363) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:11:02 devstack cinder-volume[85363]: DEBUG cinder.volume.drivers.quobyte [None req-07186165-42c6-4408-80d0-6f8369b374c8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=85363) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:11:02 devstack cinder-volume[85363]: DEBUG cinder.volume.drivers.quobyte [None req-07186165-42c6-4408-80d0-6f8369b374c8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=85363) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:11:02 devstack cinder-volume[85363]: DEBUG oslo_concurrency.lockutils [None req-07186165-42c6-4408-80d0-6f8369b374c8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85363) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:11:02 devstack cinder-volume[85363]: DEBUG oslo_concurrency.processutils [None req-07186165-42c6-4408-80d0-6f8369b374c8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=85363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:11:02 devstack sudo[85441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:11:02 devstack sudo[85441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:11:02 devstack sudo[85441]: pam_unix(sudo:session): session closed for user root Aug 31 15:11:02 devstack cinder-volume[85363]: DEBUG oslo_concurrency.processutils [None req-07186165-42c6-4408-80d0-6f8369b374c8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.230s {{(pid=85363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:11:02 devstack cinder-volume[85363]: DEBUG cinder.manager [None req-07186165-42c6-4408-80d0-6f8369b374c8 None None] Notifying Schedulers of capabilities ... {{(pid=85363) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:11:02 devstack cinder-volume[85363]: INFO cinder.volume.manager [None req-07186165-42c6-4408-80d0-6f8369b374c8 None None] Driver initialization completed successfully. Aug 31 15:11:02 devstack cinder-volume[85363]: INFO cinder.manager [None req-07186165-42c6-4408-80d0-6f8369b374c8 None None] Initiating service 3 cleanup Aug 31 15:11:02 devstack cinder-volume[85363]: INFO cinder.manager [None req-07186165-42c6-4408-80d0-6f8369b374c8 None None] Service 3 cleanup completed. Aug 31 15:11:02 devstack cinder-volume[85363]: DEBUG cinder.service [None req-07186165-42c6-4408-80d0-6f8369b374c8 None None] Creating RPC server for service cinder-volume {{(pid=85363) start /opt/stack/cinder/cinder/service.py:231}} Aug 31 15:11:02 devstack cinder-volume[85363]: DEBUG cinder.service [None req-07186165-42c6-4408-80d0-6f8369b374c8 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85363) start /opt/stack/cinder/cinder/service.py:237}} Aug 31 15:11:02 devstack cinder-volume[85363]: INFO cinder.volume.manager [None req-07186165-42c6-4408-80d0-6f8369b374c8 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Aug 31 15:11:02 devstack cinder-volume[85363]: DEBUG oslo_concurrency.lockutils [None req-07186165-42c6-4408-80d0-6f8369b374c8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85363) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:11:02 devstack cinder-volume[85363]: DEBUG oslo_concurrency.lockutils [None req-07186165-42c6-4408-80d0-6f8369b374c8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85363) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:11:02 devstack cinder-volume[85363]: DEBUG cinder.volume.drivers.quobyte [None req-07186165-42c6-4408-80d0-6f8369b374c8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=85363) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:11:02 devstack cinder-volume[85363]: DEBUG cinder.volume.drivers.quobyte [None req-07186165-42c6-4408-80d0-6f8369b374c8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=85363) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:11:02 devstack cinder-volume[85363]: DEBUG oslo_concurrency.lockutils [None req-07186165-42c6-4408-80d0-6f8369b374c8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85363) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:11:02 devstack cinder-volume[85363]: DEBUG oslo_concurrency.processutils [None req-07186165-42c6-4408-80d0-6f8369b374c8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=85363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:11:02 devstack sudo[85444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:11:02 devstack sudo[85444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:11:02 devstack sudo[85444]: pam_unix(sudo:session): session closed for user root Aug 31 15:11:02 devstack cinder-volume[85363]: DEBUG oslo_concurrency.processutils [None req-07186165-42c6-4408-80d0-6f8369b374c8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.239s {{(pid=85363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:11:02 devstack cinder-volume[85363]: INFO cinder.volume.manager [None req-07186165-42c6-4408-80d0-6f8369b374c8 None None] Driver post RPC initialization completed successfully. Aug 31 15:11:07 devstack cinder-volume[85363]: DEBUG oslo_concurrency.lockutils [None req-3ed6ffda-b5b7-4cef-b24a-8ff2d29e4b6f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85363) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:11:07 devstack cinder-volume[85363]: DEBUG oslo_concurrency.lockutils [None req-3ed6ffda-b5b7-4cef-b24a-8ff2d29e4b6f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85363) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:11:07 devstack cinder-volume[85363]: DEBUG cinder.volume.drivers.quobyte [None req-3ed6ffda-b5b7-4cef-b24a-8ff2d29e4b6f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=85363) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:11:07 devstack cinder-volume[85363]: DEBUG cinder.volume.drivers.quobyte [None req-3ed6ffda-b5b7-4cef-b24a-8ff2d29e4b6f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=85363) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:11:07 devstack cinder-volume[85363]: DEBUG oslo_concurrency.lockutils [None req-3ed6ffda-b5b7-4cef-b24a-8ff2d29e4b6f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85363) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:11:07 devstack cinder-volume[85363]: DEBUG oslo_concurrency.processutils [None req-3ed6ffda-b5b7-4cef-b24a-8ff2d29e4b6f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=85363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:11:07 devstack sudo[85598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:11:07 devstack sudo[85598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:11:07 devstack sudo[85598]: pam_unix(sudo:session): session closed for user root Aug 31 15:11:07 devstack cinder-volume[85363]: DEBUG oslo_concurrency.processutils [None req-3ed6ffda-b5b7-4cef-b24a-8ff2d29e4b6f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.222s {{(pid=85363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:11:07 devstack cinder-volume[85363]: DEBUG cinder.manager [None req-3ed6ffda-b5b7-4cef-b24a-8ff2d29e4b6f None None] Notifying Schedulers of capabilities ... {{(pid=85363) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:11:10 devstack cinder-volume[85118]: INFO oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] Caught SIGTERM, stopping children Aug 31 15:11:10 devstack cinder-volume[85118]: DEBUG oslo_concurrency.lockutils [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] Acquiring lock "singleton_lock" {{(pid=85118) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 31 15:11:10 devstack cinder-volume[85118]: DEBUG oslo_concurrency.lockutils [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] Acquired lock "singleton_lock" {{(pid=85118) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 31 15:11:10 devstack cinder-volume[85118]: DEBUG oslo_concurrency.lockutils [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] Releasing lock "singleton_lock" {{(pid=85118) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 31 15:11:10 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] Stop services. {{(pid=85118) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 31 15:11:10 devstack cinder-volume[85118]: DEBUG oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] Killing children. {{(pid=85118) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 31 15:11:10 devstack cinder-volume[85118]: INFO oslo_service.backend._eventlet.service [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] Waiting on 1 children to exit Aug 31 15:11:10 devstack cinder-volume[85363]: DEBUG oslo_service.periodic_task [None req-25bc0d78-da09-4c79-a18b-de9c38530c9a None None] Running periodic task VolumeManager._thread_info {{(pid=85363) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:11:10 devstack cinder-volume[85363]: DEBUG cinder.volume.manager [None req-25bc0d78-da09-4c79-a18b-de9c38530c9a None None] thread count: 6 {{(pid=85363) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 31 15:11:10 devstack cinder-volume[85363]: DEBUG cinder.volume.manager [None req-25bc0d78-da09-4c79-a18b-de9c38530c9a None None] thread info: [<_MainThread(MainThread, started 124378092093568)>, , , , , ] {{(pid=85363) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 31 15:11:12 devstack cinder-volume[85363]: DEBUG dbcounter [-] [85363] Writing DB stats cinder:SELECT=2 {{(pid=85363) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:11:12 devstack cinder-volume[85363]: DEBUG dbcounter [-] [85363] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=85363) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:11:15 devstack cinder-volume[85363]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Aug 31 15:11:15 devstack cinder-volume[85363]: DEBUG oslo_concurrency.lockutils [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] Acquiring lock "singleton_lock" {{(pid=85363) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 31 15:11:15 devstack cinder-volume[85363]: DEBUG oslo_concurrency.lockutils [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] Acquired lock "singleton_lock" {{(pid=85363) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 31 15:11:15 devstack cinder-volume[85363]: DEBUG oslo_concurrency.lockutils [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] Releasing lock "singleton_lock" {{(pid=85363) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 31 15:11:15 devstack cinder-volume[85363]: WARNING amqp [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 31 15:11:15 devstack cinder-volume[85363]: WARNING amqp [None req-0aa7f4d0-27e0-437d-8df8-69c313ebf3d5 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 31 15:11:16 devstack cinder-volume[85704]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 31 15:11:16 devstack cinder-volume[85704]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 31 15:11:16 devstack cinder-volume[85704]: we strongly recommend against using it for new projects. Aug 31 15:11:16 devstack cinder-volume[85704]: If you are already using Eventlet, we recommend migrating to a different Aug 31 15:11:16 devstack cinder-volume[85704]: framework. For more detail see Aug 31 15:11:16 devstack cinder-volume[85704]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 31 15:11:16 devstack cinder-volume[85704]: import eventlet # noqa Aug 31 15:11:18 devstack cinder-volume[85704]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85704) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 31 15:11:18 devstack cinder-volume[85704]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85704) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 31 15:11:18 devstack cinder-volume[85704]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85704) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 31 15:11:19 devstack cinder-volume[85704]: INFO dbcounter [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] Registered counter for database cinder Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_db.sqlalchemy.engines [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85704) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG dbcounter [-] [85704] Writer thread running {{(pid=85704) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 31 15:11:19 devstack cinder-volume[85704]: INFO cinder.rpc [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 31 15:11:19 devstack cinder-volume[85704]: INFO cinder.rpc [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_db.sqlalchemy.engines [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85704) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 31 15:11:19 devstack cinder-volume[85704]: INFO cinder.volume.manager [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] Determined volume DB was empty at startup. Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG cinder.volume.manager [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85704) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 31 15:11:19 devstack cinder-volume[85704]: WARNING stevedore.named [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 31 15:11:19 devstack cinder-volume[85704]: WARNING castellan.key_manager [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 31 15:11:19 devstack cinder-volume[85704]: WARNING cinder.keymgr.conf_key_mgr [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 31 15:11:19 devstack cinder-volume[85704]: INFO cinder.volume.manager [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_db.sqlalchemy.engines [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85704) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 31 15:11:19 devstack cinder-volume[85704]: INFO oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] Starting 1 workers Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] Started child 86000 {{(pid=85704) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] Full set of CONF: {{(pid=85704) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] ******************************************************************************** {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] Configuration options gathered from: {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] ================================================================================ {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] allow_availability_zone_fallback = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] allow_compression_on_image_upload = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] allowed_direct_url_schemes = [] {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] api_rate_limit = True {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] auth_strategy = keystone {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_availability_zone = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_host = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_name = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_stats_polling_interval = 60 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backup_api_class = cinder.backup.api.API {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backup_name_template = backup-%s {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backup_use_same_host = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backup_use_temp_snapshot = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] chap_password = **** {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] chap_username = {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cinder_internal_tenant_project_id = d5515742ca7548c2b7491fdf4bf97ae9 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cinder_internal_tenant_user_id = 3aaa775e6f5b4bb78fc2223c402fc625 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[86000]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cluster = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] compression_format = gzip {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] compute_api_class = cinder.compute.nova.API {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] config_dir = [] {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] config_source = [] {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] control_exchange = openstack {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] debug = True {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] default_availability_zone = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] default_group_type = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] default_volume_type = QuobyteHD {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] disk_geometry = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] driver_client_cert = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] driver_client_cert_key = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] driver_data_namespace = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] driver_ssl_cert_path = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] driver_ssl_cert_verify = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] driver_use_ssl = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] enable_new_services = True {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] enable_unsupported_driver = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] enabled_backends = ['QuobyteHD'] {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] enforce_multipath_for_image_xfer = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] filter_function = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] glance_api_insecure = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] glance_api_servers = ['http://192.168.122.232/image'] {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] glance_api_ssl_compression = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] glance_ca_certificates_file = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] glance_catalog_info = image:glance:publicURL {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] glance_certfile = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] glance_keyfile = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] glance_num_retries = 3 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] glance_request_timeout = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] goodness_function = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] graceful_shutdown_timeout = 5 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] group_api_class = cinder.group.api.API {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] host = devstack {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] image_compress_on_upload = True {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] image_conversion_address_space_limit = 1 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] image_conversion_cpu_limit = 60 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] image_conversion_disable = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] image_upload_use_cinder_backend = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] image_upload_use_internal_tenant = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] image_volume_cache_enabled = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] image_volume_cache_max_count = 0 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] image_volume_cache_max_size_gb = 0 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] init_host_max_objects_retrieval = 0 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] instance_format = [instance: %(uuid)s] {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] iscsi_target_flags = {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] iscsi_write_cache = on {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] iser_helper = tgtadm {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] iser_ip_address = 192.168.122.232 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] iser_port = 3260 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] log_color = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] log_config_append = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] log_dir = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] log_file = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] log_options = True {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] log_rotate_interval = 1 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] log_rotate_interval_type = days {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] log_rotation_type = none {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] max_age = 0 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] max_logfile_count = 30 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] max_logfile_size_mb = 200 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] max_over_subscription_ratio = 20.0 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] message_reap_interval = 86400 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] message_ttl = 2592000 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] migration_create_volume_timeout_secs = 300 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] monkey_patch = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] monkey_patch_modules = [] {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] my_ip = 192.168.122.232 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] no_snapshot_gb_quota = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] num_iser_scan_tries = 3 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] num_shell_tries = 3 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] num_volume_device_scan_tries = 3 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] nvmeof_conn_info_version = 1 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] nvmet_ns_id = 10 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] nvmet_port_id = 1 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] osapi_max_limit = 1000 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] osapi_volume_ext_list = [] {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] osapi_volume_listen = 0.0.0.0 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] osapi_volume_listen_port = 8776 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] osapi_volume_use_ssl = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] osapi_volume_workers = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] per_volume_size_limit = -1 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] periodic_fuzzy_delay = 60 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] periodic_interval = 60 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] project_id_regex = [0-9a-f\-]+ {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] public_endpoint = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] publish_errors = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] quota_backup_gigabytes = 1000 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] quota_backups = 10 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] quota_gigabytes = 1000 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] quota_groups = 10 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] quota_snapshots = 10 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] quota_volumes = 10 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] rate_limit_burst = 0 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] rate_limit_except_level = CRITICAL {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] rate_limit_interval = 0 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] reinit_driver_count = 3 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] replication_device = **** {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] report_discard_supported = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] report_interval = 120 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] reservation_clean_interval = 86400 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] reservation_expire = 86400 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] reserved_image_namespaces = [] {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] reserved_percentage = 0 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] rpc_response_timeout = 120 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] run_external_periodic_tasks = True {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] scst_target_driver = iscsi {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] scst_target_iqn_name = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] service_down_time = 720 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] shell_completion = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] snapshot_name_template = snapshot-%s {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] split_loggers = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] state_path = /opt/stack/data/cinder {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] storage_availability_zone = nova {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] storage_protocol = iSCSI {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] syslog_log_facility = LOG_USER {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] target_helper = lioadm {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] target_ip_address = 192.168.122.232 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] target_port = 3260 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] target_protocol = iscsi {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] target_secondary_ip_addresses = [] {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] trace_flags = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-9ad7e4e7-3df1-4a89-8719-c828a1673ee4 None None] Starting volume driver QuobyteDriver (1.2.1) Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] transfer_api_class = cinder.transfer.api.API {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-9ad7e4e7-3df1-4a89-8719-c828a1673ee4 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86000) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] transport_url = **** {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] until_refresh = 0 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] use_chap_auth = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] use_default_quota_class = True {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] use_journal = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] use_json = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] use_multipath_for_image_xfer = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] use_stderr = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] use_syslog = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] verify_glance_signatures = enabled {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] volume_api_class = cinder.volume.api.API {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] volume_backend_name = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] volume_clear = zero {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] volume_clear_ionice = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] volume_clear_size = 0 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] volume_copy_bps_limit = 0 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] volume_dd_blocksize = 1M {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] volume_name_template = volume-%s {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] volume_service_inithost_offload = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] volume_usage_audit_period = month {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] zoning_mode = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_concurrency.disable_process_locking = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] keystone_authtoken.auth_section = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] keystone_authtoken.auth_type = password {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] keystone_authtoken.auth_version = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] keystone_authtoken.cache = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] keystone_authtoken.certfile = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] keystone_authtoken.delay_auth_decision = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] keystone_authtoken.http_connect_timeout = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] keystone_authtoken.include_service_catalog = True {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] keystone_authtoken.insecure = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] keystone_authtoken.interface = public {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] keystone_authtoken.keyfile = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] keystone_authtoken.memcache_password = **** {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] keystone_authtoken.memcache_username = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] keystone_authtoken.region_name = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] keystone_authtoken.service_token_roles_required = True {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] keystone_authtoken.service_type = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] keystone_authtoken.token_cache_time = 300 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.232/identity {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cache.backend = dogpile.cache.null {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cache.backend_argument = **** {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cache.backend_expiration_time = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cache.config_prefix = cache.oslo {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cache.debug_cache_backend = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cache.enable_retry_client = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cache.enable_socket_keepalive = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cache.enabled = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cache.expiration_time = 600 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cache.hashclient_retry_attempts = 2 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cache.memcache_dead_retry = 300 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cache.memcache_pool_maxsize = 10 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cache.memcache_sasl_enabled = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cache.password = **** {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cache.proxies = [] {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cache.redis_db = 0 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cache.redis_sentinel_service_name = mymaster {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cache.redis_server = localhost:6379 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cache.retry_attempts = 2 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cache.retry_delay = 0.0 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cache.socket_keepalive_count = 1 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cache.socket_keepalive_idle = 1 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cache.socket_keepalive_interval = 1 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cache.socket_timeout = 1.0 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cache.tls_allowed_ciphers = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cache.tls_cafile = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cache.tls_certfile = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cache.tls_enabled = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cache.tls_keyfile = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cache.username = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] coordination.backend_url = **** {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] database.asyncio_connection = **** {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] database.asyncio_slave_connection = **** {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] database.backend = sqlalchemy {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] database.connection = **** {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] database.connection_debug = 0 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] database.connection_parameters = {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] database.connection_recycle_time = 3600 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] database.connection_trace = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] database.db_inc_retry_interval = True {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] database.db_max_retries = 20 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] database.db_max_retry_interval = 10 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] database.db_retry_interval = 1 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] database.max_overflow = 50 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] database.max_pool_size = 5 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] database.max_retries = 10 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] database.mysql_wsrep_sync_wait = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] database.pool_timeout = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] database.retry_interval = 10 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] database.slave_connection = **** {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] database.sqlite_synchronous = True {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] database.synchronous_reader = True {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] database.use_db_reconnect = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_tracing.insecure = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] profiler.connection_string = messaging:// {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] profiler.enabled = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] profiler.es_doc_type = notification {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] profiler.es_scroll_size = 10000 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] profiler.es_scroll_time = 2m {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] profiler.filter_error_trace = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] profiler.hmac_keys = **** {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-9ad7e4e7-3df1-4a89-8719-c828a1673ee4 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86000) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] profiler.sentinel_service_name = mymaster {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] profiler.socket_timeout = 0.1 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] profiler.trace_requests = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] profiler.trace_sqlalchemy = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] profiler_jaeger.process_tags = {} {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.quobyte [None req-9ad7e4e7-3df1-4a89-8719-c828a1673ee4 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] profiler_jaeger.service_name_prefix = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.quobyte [None req-9ad7e4e7-3df1-4a89-8719-c828a1673ee4 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] profiler_otlp.service_name_prefix = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_policy.enforce_new_defaults = True {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_policy.policy_default_rule = default {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9ad7e4e7-3df1-4a89-8719-c828a1673ee4 None None] Running cmd (subprocess): mount.quobyte {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_policy.policy_file = policy.yaml {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_policy.remote_timeout = 60.0 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] privsep_osbrick.group = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] privsep_osbrick.helper_command = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] privsep_osbrick.user = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cinder_sys_admin.group = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cinder_sys_admin.helper_command = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] cinder_sys_admin.user = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] service_user.auth_section = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] service_user.auth_type = password {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] service_user.cafile = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] service_user.certfile = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] service_user.collect_timing = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] service_user.insecure = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] service_user.keyfile = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] service_user.send_service_user_token = True {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] service_user.split_loggers = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] service_user.timeout = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] glance.auth_section = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] glance.auth_type = password {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] glance.certfile = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] glance.collect_timing = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] glance.insecure = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] glance.keyfile = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] glance.region_name = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] glance.split_loggers = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] glance.timeout = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.backend_availability_zone = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.chap_password = **** {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.chap_username = {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.disk_geometry = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.driver_client_cert = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.driver_client_cert_key = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.driver_data_namespace = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.driver_use_ssl = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.enable_unsupported_driver = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.extra_capabilities = {} {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.filter_function = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.goodness_function = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.iscsi_target_flags = {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.iscsi_write_cache = on {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.iser_helper = tgtadm {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.iser_ip_address = 192.168.122.232 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.iser_port = 3260 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:19 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.nas_host = {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.nas_login = admin {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.nas_mount_options = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.nas_password = **** {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.nas_private_key = {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.nas_share_path = {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.nas_ssh_port = 22 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.num_shell_tries = 3 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.nvmet_port_id = 1 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.quobyte_client_cfg = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.quobyte_volume_url = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.replication_device = **** {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.report_discard_supported = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.reserved_percentage = 0 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.scst_target_driver = iscsi {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.scst_target_iqn_name = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.storage_protocol = iSCSI {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.target_helper = tgtadm {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.target_ip_address = 192.168.122.232 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.target_port = 3260 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.target_protocol = iscsi {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.trace_flags = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.unique_fqdn_network = True {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.use_chap_auth = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.volume_backend_name = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.volume_clear = zero {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.volume_clear_ionice = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.volume_clear_size = 0 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_reports.file_event_handler = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_reports.log_dir = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.backend_availability_zone = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.backend_host = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.chap_password = **** {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.chap_username = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.chiscsi_conf = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.disk_geometry = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.driver_client_cert = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.driver_client_cert_key = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.driver_data_namespace = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.driver_use_ssl = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.extra_capabilities = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.filter_function = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.goodness_function = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.iscsi_target_flags = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.iscsi_write_cache = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.iser_helper = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.iser_ip_address = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.iser_port = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.iser_target_prefix = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.nas_host = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.nas_login = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.nas_mount_options = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.nas_password = **** {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.nas_private_key = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.nas_share_path = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.nas_ssh_port = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.num_shell_tries = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.nvmet_ns_id = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.nvmet_port_id = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.replication_device = **** {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.report_discard_supported = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.reserved_percentage = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.scst_target_driver = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.storage_protocol = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.target_helper = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9ad7e4e7-3df1-4a89-8719-c828a1673ee4 None None] CMD "mount.quobyte" returned: 1 in 0.072s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.target_ip_address = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.target_port = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9ad7e4e7-3df1-4a89-8719-c828a1673ee4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.target_prefix = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9ad7e4e7-3df1-4a89-8719-c828a1673ee4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.target_protocol = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-9ad7e4e7-3df1-4a89-8719-c828a1673ee4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.trace_flags = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.unique_fqdn_network = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.use_chap_auth = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.volume_clear = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.volume_clear_ionice = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.volume_clear_size = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] QuobyteHD.volumes_dir = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-9ad7e4e7-3df1-4a89-8719-c828a1673ee4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:11:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9ad7e4e7-3df1-4a89-8719-c828a1673ee4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9ad7e4e7-3df1-4a89-8719-c828a1673ee4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_rabbit.ssl = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_rabbit.ssl_version = {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_notifications.driver = [] {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_notifications.retry = -1 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] oslo_messaging_notifications.transport_url = **** {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] key_manager.fixed_key = **** {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] barbican.barbican_api_version = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] barbican.barbican_endpoint = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] barbican.barbican_endpoint_type = public {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] barbican.barbican_region_name = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] barbican.cafile = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] barbican.certfile = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] barbican.collect_timing = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] barbican.insecure = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] barbican.keyfile = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] barbican.number_of_retries = 60 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] barbican.retry_delay = 1 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] barbican.send_service_user_token = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] barbican.split_loggers = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] barbican.timeout = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] barbican.verify_ssl = True {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] barbican.verify_ssl_path = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] barbican_service_user.auth_section = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] barbican_service_user.auth_type = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] barbican_service_user.cafile = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] barbican_service_user.certfile = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] barbican_service_user.collect_timing = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] barbican_service_user.insecure = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] barbican_service_user.keyfile = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] barbican_service_user.split_loggers = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] barbican_service_user.timeout = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] vault.approle_role_id = **** {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] vault.approle_secret_id = **** {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] vault.auth_method = approle {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] vault.auth_path = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] vault.kv_mountpoint = secret {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] vault.kv_path = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] vault.kv_version = 2 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] vault.namespace = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] vault.root_token_id = **** {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack sudo[86010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] vault.ssl_ca_crt_file = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] vault.timeout = 60.0 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] vault.token_file = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] vault.token_role = None {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] vault.use_ssl = False {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 31 15:11:20 devstack sudo[86010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:11:20 devstack cinder-volume[85704]: DEBUG oslo_service.backend._eventlet.service [None req-fe922732-4b41-4b30-bb63-cdaab8d8972f None None] ******************************************************************************** {{(pid=85704) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 31 15:11:20 devstack sudo[86010]: pam_unix(sudo:session): session closed for user root Aug 31 15:11:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9ad7e4e7-3df1-4a89-8719-c828a1673ee4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.250s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:11:20 devstack cinder-volume[86000]: INFO cinder.volume.driver [None req-9ad7e4e7-3df1-4a89-8719-c828a1673ee4 None None] Driver hasn't implemented _init_vendor_properties() Aug 31 15:11:20 devstack cinder-volume[86000]: DEBUG cinder.volume.driver [None req-9ad7e4e7-3df1-4a89-8719-c828a1673ee4 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.3757095336914, 'free_capacity_gb': 1774.3757095336914, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86000) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 31 15:11:20 devstack cinder-volume[86000]: DEBUG oslo_db.sqlalchemy.engines [None req-9ad7e4e7-3df1-4a89-8719-c828a1673ee4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86000) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 31 15:11:20 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writer thread running {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 31 15:11:20 devstack cinder-volume[86000]: DEBUG cinder.db.api [None req-9ad7e4e7-3df1-4a89-8719-c828a1673ee4 None None] Building query based on filter {{(pid=86000) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 31 15:11:20 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-9ad7e4e7-3df1-4a89-8719-c828a1673ee4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86000) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 31 15:11:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9ad7e4e7-3df1-4a89-8719-c828a1673ee4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:11:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9ad7e4e7-3df1-4a89-8719-c828a1673ee4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:11:20 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-9ad7e4e7-3df1-4a89-8719-c828a1673ee4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:11:20 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-9ad7e4e7-3df1-4a89-8719-c828a1673ee4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:11:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9ad7e4e7-3df1-4a89-8719-c828a1673ee4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:11:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9ad7e4e7-3df1-4a89-8719-c828a1673ee4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:11:20 devstack cinder-volume[86000]: INFO cinder.keymgr.migration [None req-8be85828-30f9-4cdf-9ad7-c751b58fd109 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 31 15:11:20 devstack sudo[86018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:11:20 devstack sudo[86018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:11:20 devstack sudo[86018]: pam_unix(sudo:session): session closed for user root Aug 31 15:11:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9ad7e4e7-3df1-4a89-8719-c828a1673ee4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.245s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:11:20 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-9ad7e4e7-3df1-4a89-8719-c828a1673ee4 None None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:11:20 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-9ad7e4e7-3df1-4a89-8719-c828a1673ee4 None None] Driver initialization completed successfully. Aug 31 15:11:20 devstack cinder-volume[86000]: INFO cinder.manager [None req-9ad7e4e7-3df1-4a89-8719-c828a1673ee4 None None] Initiating service 3 cleanup Aug 31 15:11:20 devstack cinder-volume[86000]: INFO cinder.manager [None req-9ad7e4e7-3df1-4a89-8719-c828a1673ee4 None None] Service 3 cleanup completed. Aug 31 15:11:20 devstack cinder-volume[86000]: DEBUG cinder.service [None req-9ad7e4e7-3df1-4a89-8719-c828a1673ee4 None None] Creating RPC server for service cinder-volume {{(pid=86000) start /opt/stack/cinder/cinder/service.py:231}} Aug 31 15:11:20 devstack cinder-volume[86000]: DEBUG cinder.service [None req-9ad7e4e7-3df1-4a89-8719-c828a1673ee4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86000) start /opt/stack/cinder/cinder/service.py:237}} Aug 31 15:11:20 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-9ad7e4e7-3df1-4a89-8719-c828a1673ee4 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Aug 31 15:11:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9ad7e4e7-3df1-4a89-8719-c828a1673ee4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:11:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9ad7e4e7-3df1-4a89-8719-c828a1673ee4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:11:20 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-9ad7e4e7-3df1-4a89-8719-c828a1673ee4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:11:20 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-9ad7e4e7-3df1-4a89-8719-c828a1673ee4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:11:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9ad7e4e7-3df1-4a89-8719-c828a1673ee4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:11:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9ad7e4e7-3df1-4a89-8719-c828a1673ee4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:11:20 devstack sudo[86024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:11:20 devstack sudo[86024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:11:21 devstack sudo[86024]: pam_unix(sudo:session): session closed for user root Aug 31 15:11:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9ad7e4e7-3df1-4a89-8719-c828a1673ee4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.225s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:11:21 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-9ad7e4e7-3df1-4a89-8719-c828a1673ee4 None None] Driver post RPC initialization completed successfully. Aug 31 15:11:29 devstack cinder-volume[85704]: DEBUG dbcounter [-] [85704] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=85704) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:11:30 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:11:31 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:SELECT=3 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:11:45 devstack cinder-volume[86000]: DEBUG oslo_service.periodic_task [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running periodic task VolumeManager._thread_info {{(pid=86000) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:11:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] thread count: 6 {{(pid=86000) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 31 15:11:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] thread info: [<_MainThread(MainThread, started 137631281086592)>, , , , , ] {{(pid=86000) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 31 15:12:19 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b756c71-a107-463f-85ae-132baa0d9be0 tempest-TaggedAttachmentsTest-1355735929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:12:19 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0b756c71-a107-463f-85ae-132baa0d9be0 tempest-TaggedAttachmentsTest-1355735929 None] Flow 'volume_create_manager' (0efcd4af-5d7f-4dca-aa91-6d994de07299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:12:19 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0b756c71-a107-463f-85ae-132baa0d9be0 tempest-TaggedAttachmentsTest-1355735929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09c37f88-57e7-44a0-b183-c3c186e98ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:12:19 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0b756c71-a107-463f-85ae-132baa0d9be0 tempest-TaggedAttachmentsTest-1355735929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09c37f88-57e7-44a0-b183-c3c186e98ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-481922738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53cfde77-4676-4bba-a6c8-b0d2a25ccaed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e48377316ab40389664cbd14f26faaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:12:19Z,use_quota=True,user_id='9ee381bd89754af3ae9ec17fb8297e16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:12:19 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0b756c71-a107-463f-85ae-132baa0d9be0 tempest-TaggedAttachmentsTest-1355735929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e63c005e-a307-4430-93de-5d515dac012d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:12:19 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0b756c71-a107-463f-85ae-132baa0d9be0 tempest-TaggedAttachmentsTest-1355735929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e63c005e-a307-4430-93de-5d515dac012d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:12:19 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0b756c71-a107-463f-85ae-132baa0d9be0 tempest-TaggedAttachmentsTest-1355735929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b134d2eb-d21d-4740-90bf-0883d5a4f5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:12:19 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0b756c71-a107-463f-85ae-132baa0d9be0 tempest-TaggedAttachmentsTest-1355735929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b134d2eb-d21d-4740-90bf-0883d5a4f5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53cfde77-4676-4bba-a6c8-b0d2a25ccaed', 'volume_name': 'volume-53cfde77-4676-4bba-a6c8-b0d2a25ccaed', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:12:19 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0b756c71-a107-463f-85ae-132baa0d9be0 tempest-TaggedAttachmentsTest-1355735929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f310f8d8-04b0-4c9e-93d6-0944fd5148af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:12:19 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0b756c71-a107-463f-85ae-132baa0d9be0 tempest-TaggedAttachmentsTest-1355735929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f310f8d8-04b0-4c9e-93d6-0944fd5148af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:12:19 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0b756c71-a107-463f-85ae-132baa0d9be0 tempest-TaggedAttachmentsTest-1355735929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed135077-df9b-4f9f-b02b-1c69ceb8a643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:12:19 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-0b756c71-a107-463f-85ae-132baa0d9be0 tempest-TaggedAttachmentsTest-1355735929 None] Volume 53cfde77-4676-4bba-a6c8-b0d2a25ccaed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53cfde77-4676-4bba-a6c8-b0d2a25ccaed', 'volume_size': 1} Aug 31 15:12:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-0b756c71-a107-463f-85ae-132baa0d9be0 tempest-TaggedAttachmentsTest-1355735929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:12:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-0b756c71-a107-463f-85ae-132baa0d9be0 tempest-TaggedAttachmentsTest-1355735929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:12:19 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-0b756c71-a107-463f-85ae-132baa0d9be0 tempest-TaggedAttachmentsTest-1355735929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-481922738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53cfde77-4676-4bba-a6c8-b0d2a25ccaed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e48377316ab40389664cbd14f26faaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:12:19Z,use_quota=True,user_id='9ee381bd89754af3ae9ec17fb8297e16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:12:19 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-0b756c71-a107-463f-85ae-132baa0d9be0 tempest-TaggedAttachmentsTest-1355735929 None] Creating volume 53cfde77-4676-4bba-a6c8-b0d2a25ccaed {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:12:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-0b756c71-a107-463f-85ae-132baa0d9be0 tempest-TaggedAttachmentsTest-1355735929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:12:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-0b756c71-a107-463f-85ae-132baa0d9be0 tempest-TaggedAttachmentsTest-1355735929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:12:19 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-0b756c71-a107-463f-85ae-132baa0d9be0 tempest-TaggedAttachmentsTest-1355735929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:12:19 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-0b756c71-a107-463f-85ae-132baa0d9be0 tempest-TaggedAttachmentsTest-1355735929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:12:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-0b756c71-a107-463f-85ae-132baa0d9be0 tempest-TaggedAttachmentsTest-1355735929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:12:19 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-0b756c71-a107-463f-85ae-132baa0d9be0 tempest-TaggedAttachmentsTest-1355735929 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:12:19 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-0b756c71-a107-463f-85ae-132baa0d9be0 tempest-TaggedAttachmentsTest-1355735929 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:12:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0b756c71-a107-463f-85ae-132baa0d9be0 tempest-TaggedAttachmentsTest-1355735929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-53cfde77-4676-4bba-a6c8-b0d2a25ccaed 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:12:19 devstack sudo[86536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-53cfde77-4676-4bba-a6c8-b0d2a25ccaed 1073741824 Aug 31 15:12:19 devstack sudo[86536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:12:20 devstack sudo[86536]: pam_unix(sudo:session): session closed for user root Aug 31 15:12:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0b756c71-a107-463f-85ae-132baa0d9be0 tempest-TaggedAttachmentsTest-1355735929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-53cfde77-4676-4bba-a6c8-b0d2a25ccaed 1073741824" returned: 0 in 0.958s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:12:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0b756c71-a107-463f-85ae-132baa0d9be0 tempest-TaggedAttachmentsTest-1355735929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-53cfde77-4676-4bba-a6c8-b0d2a25ccaed {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:12:20 devstack sudo[86873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-53cfde77-4676-4bba-a6c8-b0d2a25ccaed Aug 31 15:12:20 devstack sudo[86873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:12:21 devstack sudo[86873]: pam_unix(sudo:session): session closed for user root Aug 31 15:12:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0b756c71-a107-463f-85ae-132baa0d9be0 tempest-TaggedAttachmentsTest-1355735929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-53cfde77-4676-4bba-a6c8-b0d2a25ccaed" returned: 0 in 0.290s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:12:21 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-0b756c71-a107-463f-85ae-132baa0d9be0 tempest-TaggedAttachmentsTest-1355735929 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:12:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-0b756c71-a107-463f-85ae-132baa0d9be0 tempest-TaggedAttachmentsTest-1355735929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.364s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:12:21 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0b756c71-a107-463f-85ae-132baa0d9be0 tempest-TaggedAttachmentsTest-1355735929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed135077-df9b-4f9f-b02b-1c69ceb8a643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53cfde77-4676-4bba-a6c8-b0d2a25ccaed', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:12:21 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0b756c71-a107-463f-85ae-132baa0d9be0 tempest-TaggedAttachmentsTest-1355735929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b02aad6-7bc2-4956-b59d-776a6e689c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:12:21 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-0b756c71-a107-463f-85ae-132baa0d9be0 tempest-TaggedAttachmentsTest-1355735929 None] Volume volume-53cfde77-4676-4bba-a6c8-b0d2a25ccaed (53cfde77-4676-4bba-a6c8-b0d2a25ccaed): created successfully Aug 31 15:12:21 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0b756c71-a107-463f-85ae-132baa0d9be0 tempest-TaggedAttachmentsTest-1355735929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b02aad6-7bc2-4956-b59d-776a6e689c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:12:21 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0b756c71-a107-463f-85ae-132baa0d9be0 tempest-TaggedAttachmentsTest-1355735929 None] Flow 'volume_create_manager' (0efcd4af-5d7f-4dca-aa91-6d994de07299) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:12:21 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-0b756c71-a107-463f-85ae-132baa0d9be0 tempest-TaggedAttachmentsTest-1355735929 None] Created volume successfully. Aug 31 15:12:31 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:12:31 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:UPDATE=4,cinder:SELECT=3,cinder:DELETE=1 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:12:33 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-4edeaa2a-103d-4dc3-858e-384c2f7ac45b tempest-DeleteServersTestJSON-341402528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:12:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4edeaa2a-103d-4dc3-858e-384c2f7ac45b tempest-DeleteServersTestJSON-341402528 None] Flow 'volume_create_manager' (6c9cc2de-1b7a-4ba2-82f2-6f906318286c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:12:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4edeaa2a-103d-4dc3-858e-384c2f7ac45b tempest-DeleteServersTestJSON-341402528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8502b65a-b76b-42cd-a1ba-76b864222793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:12:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4edeaa2a-103d-4dc3-858e-384c2f7ac45b tempest-DeleteServersTestJSON-341402528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8502b65a-b76b-42cd-a1ba-76b864222793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1477118060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b6fed77-d17e-4a7a-8790-4df842589d8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19b533e8b92e4cb3a55eaec7c53cab6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:12:33Z,use_quota=True,user_id='dd0bee2c9a024a208b40c29c5cd28a9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:12:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4edeaa2a-103d-4dc3-858e-384c2f7ac45b tempest-DeleteServersTestJSON-341402528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (965f0b86-06a0-4ea1-8a15-0f9a61ee0f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:12:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4edeaa2a-103d-4dc3-858e-384c2f7ac45b tempest-DeleteServersTestJSON-341402528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (965f0b86-06a0-4ea1-8a15-0f9a61ee0f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:12:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4edeaa2a-103d-4dc3-858e-384c2f7ac45b tempest-DeleteServersTestJSON-341402528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7203bb0-35e0-430a-bc4e-f7d4c9a50d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:12:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4edeaa2a-103d-4dc3-858e-384c2f7ac45b tempest-DeleteServersTestJSON-341402528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7203bb0-35e0-430a-bc4e-f7d4c9a50d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b6fed77-d17e-4a7a-8790-4df842589d8f', 'volume_name': 'volume-5b6fed77-d17e-4a7a-8790-4df842589d8f', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:12:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4edeaa2a-103d-4dc3-858e-384c2f7ac45b tempest-DeleteServersTestJSON-341402528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d697f13a-8d67-4631-8737-5824f64cf63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:12:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4edeaa2a-103d-4dc3-858e-384c2f7ac45b tempest-DeleteServersTestJSON-341402528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d697f13a-8d67-4631-8737-5824f64cf63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:12:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4edeaa2a-103d-4dc3-858e-384c2f7ac45b tempest-DeleteServersTestJSON-341402528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dca3f34a-f298-4cbe-b8c5-6e2b9a570789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:12:33 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-4edeaa2a-103d-4dc3-858e-384c2f7ac45b tempest-DeleteServersTestJSON-341402528 None] Volume 5b6fed77-d17e-4a7a-8790-4df842589d8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b6fed77-d17e-4a7a-8790-4df842589d8f', 'volume_size': 1} Aug 31 15:12:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4edeaa2a-103d-4dc3-858e-384c2f7ac45b tempest-DeleteServersTestJSON-341402528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:12:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4edeaa2a-103d-4dc3-858e-384c2f7ac45b tempest-DeleteServersTestJSON-341402528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:12:33 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4edeaa2a-103d-4dc3-858e-384c2f7ac45b tempest-DeleteServersTestJSON-341402528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1477118060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b6fed77-d17e-4a7a-8790-4df842589d8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19b533e8b92e4cb3a55eaec7c53cab6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:12:33Z,use_quota=True,user_id='dd0bee2c9a024a208b40c29c5cd28a9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:12:33 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-4edeaa2a-103d-4dc3-858e-384c2f7ac45b tempest-DeleteServersTestJSON-341402528 None] Creating volume 5b6fed77-d17e-4a7a-8790-4df842589d8f {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:12:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4edeaa2a-103d-4dc3-858e-384c2f7ac45b tempest-DeleteServersTestJSON-341402528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:12:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4edeaa2a-103d-4dc3-858e-384c2f7ac45b tempest-DeleteServersTestJSON-341402528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:12:33 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4edeaa2a-103d-4dc3-858e-384c2f7ac45b tempest-DeleteServersTestJSON-341402528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:12:33 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4edeaa2a-103d-4dc3-858e-384c2f7ac45b tempest-DeleteServersTestJSON-341402528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:12:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4edeaa2a-103d-4dc3-858e-384c2f7ac45b tempest-DeleteServersTestJSON-341402528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:12:33 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4edeaa2a-103d-4dc3-858e-384c2f7ac45b tempest-DeleteServersTestJSON-341402528 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:12:33 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-4edeaa2a-103d-4dc3-858e-384c2f7ac45b tempest-DeleteServersTestJSON-341402528 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:12:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4edeaa2a-103d-4dc3-858e-384c2f7ac45b tempest-DeleteServersTestJSON-341402528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-5b6fed77-d17e-4a7a-8790-4df842589d8f 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:12:33 devstack sudo[87027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-5b6fed77-d17e-4a7a-8790-4df842589d8f 1073741824 Aug 31 15:12:33 devstack sudo[87027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:12:34 devstack sudo[87027]: pam_unix(sudo:session): session closed for user root Aug 31 15:12:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4edeaa2a-103d-4dc3-858e-384c2f7ac45b tempest-DeleteServersTestJSON-341402528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-5b6fed77-d17e-4a7a-8790-4df842589d8f 1073741824" returned: 0 in 1.144s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:12:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4edeaa2a-103d-4dc3-858e-384c2f7ac45b tempest-DeleteServersTestJSON-341402528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-5b6fed77-d17e-4a7a-8790-4df842589d8f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:12:34 devstack sudo[87041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-5b6fed77-d17e-4a7a-8790-4df842589d8f Aug 31 15:12:34 devstack sudo[87041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:12:35 devstack sudo[87041]: pam_unix(sudo:session): session closed for user root Aug 31 15:12:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4edeaa2a-103d-4dc3-858e-384c2f7ac45b tempest-DeleteServersTestJSON-341402528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-5b6fed77-d17e-4a7a-8790-4df842589d8f" returned: 0 in 0.619s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:12:35 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4edeaa2a-103d-4dc3-858e-384c2f7ac45b tempest-DeleteServersTestJSON-341402528 None] <== create_volume: return (1885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:12:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4edeaa2a-103d-4dc3-858e-384c2f7ac45b tempest-DeleteServersTestJSON-341402528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.898s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:12:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4edeaa2a-103d-4dc3-858e-384c2f7ac45b tempest-DeleteServersTestJSON-341402528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dca3f34a-f298-4cbe-b8c5-6e2b9a570789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b6fed77-d17e-4a7a-8790-4df842589d8f', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:12:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4edeaa2a-103d-4dc3-858e-384c2f7ac45b tempest-DeleteServersTestJSON-341402528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67f37249-b01b-4644-88fc-38af80002385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:12:35 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-4edeaa2a-103d-4dc3-858e-384c2f7ac45b tempest-DeleteServersTestJSON-341402528 None] Volume volume-5b6fed77-d17e-4a7a-8790-4df842589d8f (5b6fed77-d17e-4a7a-8790-4df842589d8f): created successfully Aug 31 15:12:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4edeaa2a-103d-4dc3-858e-384c2f7ac45b tempest-DeleteServersTestJSON-341402528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67f37249-b01b-4644-88fc-38af80002385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:12:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4edeaa2a-103d-4dc3-858e-384c2f7ac45b tempest-DeleteServersTestJSON-341402528 None] Flow 'volume_create_manager' (6c9cc2de-1b7a-4ba2-82f2-6f906318286c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:12:35 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-4edeaa2a-103d-4dc3-858e-384c2f7ac45b tempest-DeleteServersTestJSON-341402528 None] Created volume successfully. Aug 31 15:12:41 devstack cinder-volume[86000]: WARNING py.warnings [req-c1f0ead0-c207-4599-ba62-c505b57548a3 req-7dc89701-5df4-4feb-829b-64611d77e67d tempest-DeleteServersTestJSON-341402528 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Aug 31 15:12:41 devstack cinder-volume[86000]: .first() Aug 31 15:12:41 devstack cinder-volume[86000]: Aug 31 15:12:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-c1f0ead0-c207-4599-ba62-c505b57548a3 req-7dc89701-5df4-4feb-829b-64611d77e67d tempest-DeleteServersTestJSON-341402528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:12:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-c1f0ead0-c207-4599-ba62-c505b57548a3 req-7dc89701-5df4-4feb-829b-64611d77e67d tempest-DeleteServersTestJSON-341402528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:12:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-c1f0ead0-c207-4599-ba62-c505b57548a3 req-7dc89701-5df4-4feb-829b-64611d77e67d tempest-DeleteServersTestJSON-341402528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:12:41 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-c1f0ead0-c207-4599-ba62-c505b57548a3 req-7dc89701-5df4-4feb-829b-64611d77e67d tempest-DeleteServersTestJSON-341402528 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77', 'name': 'volume-5b6fed77-d17e-4a7a-8790-4df842589d8f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '543005bf-ed0a-4af6-af4c-8dd11285b8e9', 'enforce_multipath': True} {{(pid=86000) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 31 15:12:41 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-c1f0ead0-c207-4599-ba62-c505b57548a3 req-7dc89701-5df4-4feb-829b-64611d77e67d tempest-DeleteServersTestJSON-341402528 None] attachment_update completed successfully. Aug 31 15:12:45 devstack cinder-volume[86000]: DEBUG oslo_service.periodic_task [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86000) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:12:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:12:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:12:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:12:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:12:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:12:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:12:45 devstack sudo[87589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:12:45 devstack sudo[87589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:12:45 devstack sudo[87589]: pam_unix(sudo:session): session closed for user root Aug 31 15:12:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.722s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:12:45 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:12:45 devstack cinder-volume[86000]: DEBUG oslo_service.periodic_task [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running periodic task VolumeManager._thread_info {{(pid=86000) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:12:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] thread count: 6 {{(pid=86000) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 31 15:12:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] thread info: [<_MainThread(MainThread, started 137631281086592)>, , , , , ] {{(pid=86000) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 31 15:12:49 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-126a77f8-b2ad-4754-90a1-0fd2f380244c req-b5b94e5a-bef5-43e0-9b74-fe2fd91264ed tempest-DeleteServersTestJSON-341402528 None] Terminate volume connection completed successfully. Aug 31 15:12:49 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-126a77f8-b2ad-4754-90a1-0fd2f380244c req-b5b94e5a-bef5-43e0-9b74-fe2fd91264ed tempest-DeleteServersTestJSON-341402528 None] Deleting attachment 543005bf-ed0a-4af6-af4c-8dd11285b8e9. {{(pid=86000) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 31 15:12:51 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:12:52 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-35860dce-0cd6-43b2-96fb-bd26b045be98 tempest-DeleteServersTestJSON-341402528 None] Acquiring lock "cinder-5b6fed77-d17e-4a7a-8790-4df842589d8f-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:12:52 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-35860dce-0cd6-43b2-96fb-bd26b045be98 tempest-DeleteServersTestJSON-341402528 None] Lock "cinder-5b6fed77-d17e-4a7a-8790-4df842589d8f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:12:52 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-35860dce-0cd6-43b2-96fb-bd26b045be98 tempest-DeleteServersTestJSON-341402528 None] Acquiring lock "cinder-quobyte-5b6fed77-d17e-4a7a-8790-4df842589d8f" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:12:52 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-35860dce-0cd6-43b2-96fb-bd26b045be98 tempest-DeleteServersTestJSON-341402528 None] Lock "cinder-quobyte-5b6fed77-d17e-4a7a-8790-4df842589d8f" acquired by "delete_volume" :: waited 0.026s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:12:52 devstack cinder-volume[86000]: INFO oslo.privsep.daemon [None req-35860dce-0cd6-43b2-96fb-bd26b045be98 tempest-DeleteServersTestJSON-341402528 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp76d04iwc/privsep.sock'] Aug 31 15:12:52 devstack sudo[87682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp76d04iwc/privsep.sock Aug 31 15:12:52 devstack sudo[87682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:12:54 devstack cinder-volume[86000]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Aug 31 15:12:54 devstack cinder-volume[86000]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 31 15:12:54 devstack cinder-volume[86000]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Aug 31 15:12:54 devstack cinder-volume[86000]: WARNING oslo.privsep.daemon [-] privsep log: Aug 31 15:12:54 devstack cinder-volume[86000]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Aug 31 15:12:54 devstack cinder-volume[86000]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Aug 31 15:12:54 devstack cinder-volume[86000]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 31 15:12:54 devstack cinder-volume[86000]: WARNING oslo.privsep.daemon [-] privsep log: Aug 31 15:12:54 devstack cinder-volume[86000]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Aug 31 15:12:55 devstack sudo[87682]: pam_unix(sudo:session): session closed for user root Aug 31 15:12:55 devstack cinder-volume[86000]: INFO oslo.privsep.daemon [None req-35860dce-0cd6-43b2-96fb-bd26b045be98 tempest-DeleteServersTestJSON-341402528 None] Spawned new privsep daemon via rootwrap Aug 31 15:12:55 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [None req-35860dce-0cd6-43b2-96fb-bd26b045be98 tempest-DeleteServersTestJSON-341402528 None] Accepted privsep connection to /tmp/tmp76d04iwc/privsep.sock {{(pid=86000) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Aug 31 15:12:55 devstack cinder-volume[86000]: INFO oslo.privsep.daemon [-] privsep daemon starting Aug 31 15:12:55 devstack cinder-volume[86000]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Aug 31 15:12:55 devstack cinder-volume[86000]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Aug 31 15:12:55 devstack cinder-volume[86000]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87685 Aug 31 15:12:55 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e018772-a811-4da5-8d80-30db6af75b80]: (2,) {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:12:55 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb15409-47cd-4ec6-83dc-7f211f73191a]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:12:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-35860dce-0cd6-43b2-96fb-bd26b045be98 tempest-DeleteServersTestJSON-341402528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-5b6fed77-d17e-4a7a-8790-4df842589d8f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:12:55 devstack sudo[87703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-5b6fed77-d17e-4a7a-8790-4df842589d8f Aug 31 15:12:55 devstack sudo[87703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:12:55 devstack sudo[87703]: pam_unix(sudo:session): session closed for user root Aug 31 15:12:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-35860dce-0cd6-43b2-96fb-bd26b045be98 tempest-DeleteServersTestJSON-341402528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-5b6fed77-d17e-4a7a-8790-4df842589d8f" returned: 0 in 0.557s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:12:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-35860dce-0cd6-43b2-96fb-bd26b045be98 tempest-DeleteServersTestJSON-341402528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-5b6fed77-d17e-4a7a-8790-4df842589d8f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:12:55 devstack sudo[87720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-5b6fed77-d17e-4a7a-8790-4df842589d8f Aug 31 15:12:55 devstack sudo[87720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:12:56 devstack sudo[87720]: pam_unix(sudo:session): session closed for user root Aug 31 15:12:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-35860dce-0cd6-43b2-96fb-bd26b045be98 tempest-DeleteServersTestJSON-341402528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-5b6fed77-d17e-4a7a-8790-4df842589d8f" returned: 0 in 0.345s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:12:56 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-35860dce-0cd6-43b2-96fb-bd26b045be98 tempest-DeleteServersTestJSON-341402528 None] Lock "cinder-quobyte-5b6fed77-d17e-4a7a-8790-4df842589d8f" released by "delete_volume" :: held 3.438s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:12:56 devstack cinder-volume[86000]: WARNING cinder.quota [None req-35860dce-0cd6-43b2-96fb-bd26b045be98 tempest-DeleteServersTestJSON-341402528 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 31 15:12:56 devstack cinder-volume[86000]: WARNING cinder.quota [None req-35860dce-0cd6-43b2-96fb-bd26b045be98 tempest-DeleteServersTestJSON-341402528 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 31 15:12:56 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-35860dce-0cd6-43b2-96fb-bd26b045be98 tempest-DeleteServersTestJSON-341402528 None] Created reservations ['e3d606d2-07d1-4f01-99fb-c74bccae0602', 'a3f16c85-b2cf-4b70-ae51-95a86deaef5d', 'a5d38a9e-d41f-4f49-98b8-b7187071497c', '1e176da5-5ffd-48ef-80af-ad825754f5da'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:12:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-35860dce-0cd6-43b2-96fb-bd26b045be98 tempest-DeleteServersTestJSON-341402528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:12:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-35860dce-0cd6-43b2-96fb-bd26b045be98 tempest-DeleteServersTestJSON-341402528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:12:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-35860dce-0cd6-43b2-96fb-bd26b045be98 tempest-DeleteServersTestJSON-341402528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:12:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-35860dce-0cd6-43b2-96fb-bd26b045be98 tempest-DeleteServersTestJSON-341402528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:12:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-35860dce-0cd6-43b2-96fb-bd26b045be98 tempest-DeleteServersTestJSON-341402528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:12:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-35860dce-0cd6-43b2-96fb-bd26b045be98 tempest-DeleteServersTestJSON-341402528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:12:56 devstack sudo[87725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:12:56 devstack sudo[87725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:12:56 devstack sudo[87725]: pam_unix(sudo:session): session closed for user root Aug 31 15:12:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-35860dce-0cd6-43b2-96fb-bd26b045be98 tempest-DeleteServersTestJSON-341402528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.390s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:12:56 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-35860dce-0cd6-43b2-96fb-bd26b045be98 tempest-DeleteServersTestJSON-341402528 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:12:56 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-35860dce-0cd6-43b2-96fb-bd26b045be98 tempest-DeleteServersTestJSON-341402528 None] Deleted volume successfully. Aug 31 15:12:56 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-35860dce-0cd6-43b2-96fb-bd26b045be98 tempest-DeleteServersTestJSON-341402528 None] Lock "cinder-5b6fed77-d17e-4a7a-8790-4df842589d8f-delete_volume" released by "delete_volume" :: held 4.235s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:13:03 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb84846b-f3e2-4029-8a82-99aa21b4c959 tempest-ServersNegativeTestJSON-671890593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:13:03 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb84846b-f3e2-4029-8a82-99aa21b4c959 tempest-ServersNegativeTestJSON-671890593 None] Flow 'volume_create_manager' (7f65a096-4d3b-4328-9e7c-5b746bcf068b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:13:03 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb84846b-f3e2-4029-8a82-99aa21b4c959 tempest-ServersNegativeTestJSON-671890593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dce5c45b-4dcd-4738-904a-723984fa1553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:13:03 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb84846b-f3e2-4029-8a82-99aa21b4c959 tempest-ServersNegativeTestJSON-671890593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dce5c45b-4dcd-4738-904a-723984fa1553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-194657952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8674d4d-bc90-4bd5-bc6b-efd8ef3ec4ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23e47aef0e99467787995c75f6e094e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:13:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:13:03Z,use_quota=True,user_id='08a4e59a7f094cf79c1a00555896da90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:13:03 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb84846b-f3e2-4029-8a82-99aa21b4c959 tempest-ServersNegativeTestJSON-671890593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea7998f2-b31c-46bc-bbe9-a235d8818764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:13:03 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb84846b-f3e2-4029-8a82-99aa21b4c959 tempest-ServersNegativeTestJSON-671890593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea7998f2-b31c-46bc-bbe9-a235d8818764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:13:03 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb84846b-f3e2-4029-8a82-99aa21b4c959 tempest-ServersNegativeTestJSON-671890593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5bf3540-54b8-492c-abad-506fd000f668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:13:03 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb84846b-f3e2-4029-8a82-99aa21b4c959 tempest-ServersNegativeTestJSON-671890593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5bf3540-54b8-492c-abad-506fd000f668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8674d4d-bc90-4bd5-bc6b-efd8ef3ec4ae', 'volume_name': 'volume-f8674d4d-bc90-4bd5-bc6b-efd8ef3ec4ae', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:13:03 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb84846b-f3e2-4029-8a82-99aa21b4c959 tempest-ServersNegativeTestJSON-671890593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d210841-ebb2-499b-9188-833b91b9f748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:13:03 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb84846b-f3e2-4029-8a82-99aa21b4c959 tempest-ServersNegativeTestJSON-671890593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d210841-ebb2-499b-9188-833b91b9f748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:13:03 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb84846b-f3e2-4029-8a82-99aa21b4c959 tempest-ServersNegativeTestJSON-671890593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (736c1c94-82bb-4514-9552-62e5e1749082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:13:03 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-eb84846b-f3e2-4029-8a82-99aa21b4c959 tempest-ServersNegativeTestJSON-671890593 None] Volume f8674d4d-bc90-4bd5-bc6b-efd8ef3ec4ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8674d4d-bc90-4bd5-bc6b-efd8ef3ec4ae', 'volume_size': 1} Aug 31 15:13:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-eb84846b-f3e2-4029-8a82-99aa21b4c959 tempest-ServersNegativeTestJSON-671890593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:13:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-eb84846b-f3e2-4029-8a82-99aa21b4c959 tempest-ServersNegativeTestJSON-671890593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:13:03 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-eb84846b-f3e2-4029-8a82-99aa21b4c959 tempest-ServersNegativeTestJSON-671890593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-194657952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8674d4d-bc90-4bd5-bc6b-efd8ef3ec4ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23e47aef0e99467787995c75f6e094e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:13:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:13:03Z,use_quota=True,user_id='08a4e59a7f094cf79c1a00555896da90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:13:03 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-eb84846b-f3e2-4029-8a82-99aa21b4c959 tempest-ServersNegativeTestJSON-671890593 None] Creating volume f8674d4d-bc90-4bd5-bc6b-efd8ef3ec4ae {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:13:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-eb84846b-f3e2-4029-8a82-99aa21b4c959 tempest-ServersNegativeTestJSON-671890593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:13:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-eb84846b-f3e2-4029-8a82-99aa21b4c959 tempest-ServersNegativeTestJSON-671890593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:13:03 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-eb84846b-f3e2-4029-8a82-99aa21b4c959 tempest-ServersNegativeTestJSON-671890593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:13:03 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-eb84846b-f3e2-4029-8a82-99aa21b4c959 tempest-ServersNegativeTestJSON-671890593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:13:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-eb84846b-f3e2-4029-8a82-99aa21b4c959 tempest-ServersNegativeTestJSON-671890593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:13:03 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-eb84846b-f3e2-4029-8a82-99aa21b4c959 tempest-ServersNegativeTestJSON-671890593 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:13:03 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-eb84846b-f3e2-4029-8a82-99aa21b4c959 tempest-ServersNegativeTestJSON-671890593 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:13:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-eb84846b-f3e2-4029-8a82-99aa21b4c959 tempest-ServersNegativeTestJSON-671890593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f8674d4d-bc90-4bd5-bc6b-efd8ef3ec4ae 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:13:03 devstack sudo[87758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f8674d4d-bc90-4bd5-bc6b-efd8ef3ec4ae 1073741824 Aug 31 15:13:03 devstack sudo[87758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:13:03 devstack sudo[87758]: pam_unix(sudo:session): session closed for user root Aug 31 15:13:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-eb84846b-f3e2-4029-8a82-99aa21b4c959 tempest-ServersNegativeTestJSON-671890593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f8674d4d-bc90-4bd5-bc6b-efd8ef3ec4ae 1073741824" returned: 0 in 0.498s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:13:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-eb84846b-f3e2-4029-8a82-99aa21b4c959 tempest-ServersNegativeTestJSON-671890593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f8674d4d-bc90-4bd5-bc6b-efd8ef3ec4ae {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:13:03 devstack sudo[87764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f8674d4d-bc90-4bd5-bc6b-efd8ef3ec4ae Aug 31 15:13:03 devstack sudo[87764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:13:03 devstack sudo[87764]: pam_unix(sudo:session): session closed for user root Aug 31 15:13:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-eb84846b-f3e2-4029-8a82-99aa21b4c959 tempest-ServersNegativeTestJSON-671890593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f8674d4d-bc90-4bd5-bc6b-efd8ef3ec4ae" returned: 0 in 0.284s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:13:03 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-eb84846b-f3e2-4029-8a82-99aa21b4c959 tempest-ServersNegativeTestJSON-671890593 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:13:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-eb84846b-f3e2-4029-8a82-99aa21b4c959 tempest-ServersNegativeTestJSON-671890593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:13:03 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb84846b-f3e2-4029-8a82-99aa21b4c959 tempest-ServersNegativeTestJSON-671890593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (736c1c94-82bb-4514-9552-62e5e1749082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8674d4d-bc90-4bd5-bc6b-efd8ef3ec4ae', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:13:03 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb84846b-f3e2-4029-8a82-99aa21b4c959 tempest-ServersNegativeTestJSON-671890593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (488b6fe6-8bcd-4b66-976c-96c85ebc27b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:13:04 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-eb84846b-f3e2-4029-8a82-99aa21b4c959 tempest-ServersNegativeTestJSON-671890593 None] Volume volume-f8674d4d-bc90-4bd5-bc6b-efd8ef3ec4ae (f8674d4d-bc90-4bd5-bc6b-efd8ef3ec4ae): created successfully Aug 31 15:13:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb84846b-f3e2-4029-8a82-99aa21b4c959 tempest-ServersNegativeTestJSON-671890593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (488b6fe6-8bcd-4b66-976c-96c85ebc27b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:13:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb84846b-f3e2-4029-8a82-99aa21b4c959 tempest-ServersNegativeTestJSON-671890593 None] Flow 'volume_create_manager' (7f65a096-4d3b-4328-9e7c-5b746bcf068b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:13:04 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-eb84846b-f3e2-4029-8a82-99aa21b4c959 tempest-ServersNegativeTestJSON-671890593 None] Created volume successfully. Aug 31 15:13:06 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-c211ae5b-207c-434f-b4d1-a7cafc67f357 tempest-ServersNegativeTestJSON-671890593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:13:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c211ae5b-207c-434f-b4d1-a7cafc67f357 tempest-ServersNegativeTestJSON-671890593 None] Flow 'volume_create_manager' (3039f27f-2227-4c8c-8ea0-4878a8bb8bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:13:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c211ae5b-207c-434f-b4d1-a7cafc67f357 tempest-ServersNegativeTestJSON-671890593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aabc0d3c-ce6b-4183-b352-8b1950df5227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:13:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c211ae5b-207c-434f-b4d1-a7cafc67f357 tempest-ServersNegativeTestJSON-671890593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aabc0d3c-ce6b-4183-b352-8b1950df5227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1210409201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54768355-a886-44b1-83f8-51128614fcb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23e47aef0e99467787995c75f6e094e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:13:07Z,use_quota=True,user_id='08a4e59a7f094cf79c1a00555896da90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:13:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c211ae5b-207c-434f-b4d1-a7cafc67f357 tempest-ServersNegativeTestJSON-671890593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2809b3bb-60e2-41d7-91ed-82f13b12050d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:13:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c211ae5b-207c-434f-b4d1-a7cafc67f357 tempest-ServersNegativeTestJSON-671890593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2809b3bb-60e2-41d7-91ed-82f13b12050d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:13:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c211ae5b-207c-434f-b4d1-a7cafc67f357 tempest-ServersNegativeTestJSON-671890593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b34ee077-c925-4bc2-884e-b6298e5b7f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:13:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c211ae5b-207c-434f-b4d1-a7cafc67f357 tempest-ServersNegativeTestJSON-671890593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b34ee077-c925-4bc2-884e-b6298e5b7f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54768355-a886-44b1-83f8-51128614fcb0', 'volume_name': 'volume-54768355-a886-44b1-83f8-51128614fcb0', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:13:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c211ae5b-207c-434f-b4d1-a7cafc67f357 tempest-ServersNegativeTestJSON-671890593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eba4c8bc-28e3-4dbd-845e-beb963df7a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:13:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c211ae5b-207c-434f-b4d1-a7cafc67f357 tempest-ServersNegativeTestJSON-671890593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eba4c8bc-28e3-4dbd-845e-beb963df7a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:13:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c211ae5b-207c-434f-b4d1-a7cafc67f357 tempest-ServersNegativeTestJSON-671890593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf35c38-e3e2-4747-9926-dcb83f290e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:13:06 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-c211ae5b-207c-434f-b4d1-a7cafc67f357 tempest-ServersNegativeTestJSON-671890593 None] Volume 54768355-a886-44b1-83f8-51128614fcb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54768355-a886-44b1-83f8-51128614fcb0', 'volume_size': 1} Aug 31 15:13:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c211ae5b-207c-434f-b4d1-a7cafc67f357 tempest-ServersNegativeTestJSON-671890593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:13:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c211ae5b-207c-434f-b4d1-a7cafc67f357 tempest-ServersNegativeTestJSON-671890593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:13:06 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c211ae5b-207c-434f-b4d1-a7cafc67f357 tempest-ServersNegativeTestJSON-671890593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1210409201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54768355-a886-44b1-83f8-51128614fcb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23e47aef0e99467787995c75f6e094e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:13:07Z,use_quota=True,user_id='08a4e59a7f094cf79c1a00555896da90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:13:06 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-c211ae5b-207c-434f-b4d1-a7cafc67f357 tempest-ServersNegativeTestJSON-671890593 None] Creating volume 54768355-a886-44b1-83f8-51128614fcb0 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:13:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c211ae5b-207c-434f-b4d1-a7cafc67f357 tempest-ServersNegativeTestJSON-671890593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:13:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c211ae5b-207c-434f-b4d1-a7cafc67f357 tempest-ServersNegativeTestJSON-671890593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:13:06 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c211ae5b-207c-434f-b4d1-a7cafc67f357 tempest-ServersNegativeTestJSON-671890593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:13:06 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c211ae5b-207c-434f-b4d1-a7cafc67f357 tempest-ServersNegativeTestJSON-671890593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:13:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c211ae5b-207c-434f-b4d1-a7cafc67f357 tempest-ServersNegativeTestJSON-671890593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:13:06 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c211ae5b-207c-434f-b4d1-a7cafc67f357 tempest-ServersNegativeTestJSON-671890593 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:13:06 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-c211ae5b-207c-434f-b4d1-a7cafc67f357 tempest-ServersNegativeTestJSON-671890593 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:13:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c211ae5b-207c-434f-b4d1-a7cafc67f357 tempest-ServersNegativeTestJSON-671890593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-54768355-a886-44b1-83f8-51128614fcb0 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:13:07 devstack sudo[87767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-54768355-a886-44b1-83f8-51128614fcb0 1073741824 Aug 31 15:13:07 devstack sudo[87767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:13:07 devstack sudo[87767]: pam_unix(sudo:session): session closed for user root Aug 31 15:13:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c211ae5b-207c-434f-b4d1-a7cafc67f357 tempest-ServersNegativeTestJSON-671890593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-54768355-a886-44b1-83f8-51128614fcb0 1073741824" returned: 0 in 0.580s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:13:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c211ae5b-207c-434f-b4d1-a7cafc67f357 tempest-ServersNegativeTestJSON-671890593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-54768355-a886-44b1-83f8-51128614fcb0 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:13:07 devstack sudo[87773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-54768355-a886-44b1-83f8-51128614fcb0 Aug 31 15:13:07 devstack sudo[87773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:13:07 devstack sudo[87773]: pam_unix(sudo:session): session closed for user root Aug 31 15:13:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c211ae5b-207c-434f-b4d1-a7cafc67f357 tempest-ServersNegativeTestJSON-671890593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-54768355-a886-44b1-83f8-51128614fcb0" returned: 0 in 0.312s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:13:07 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c211ae5b-207c-434f-b4d1-a7cafc67f357 tempest-ServersNegativeTestJSON-671890593 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:13:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c211ae5b-207c-434f-b4d1-a7cafc67f357 tempest-ServersNegativeTestJSON-671890593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:13:07 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c211ae5b-207c-434f-b4d1-a7cafc67f357 tempest-ServersNegativeTestJSON-671890593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf35c38-e3e2-4747-9926-dcb83f290e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54768355-a886-44b1-83f8-51128614fcb0', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:13:07 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c211ae5b-207c-434f-b4d1-a7cafc67f357 tempest-ServersNegativeTestJSON-671890593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4fa7a1a-57d4-4313-b0b7-f0a5e0adb12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:13:07 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-c211ae5b-207c-434f-b4d1-a7cafc67f357 tempest-ServersNegativeTestJSON-671890593 None] Volume volume-54768355-a886-44b1-83f8-51128614fcb0 (54768355-a886-44b1-83f8-51128614fcb0): created successfully Aug 31 15:13:07 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c211ae5b-207c-434f-b4d1-a7cafc67f357 tempest-ServersNegativeTestJSON-671890593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4fa7a1a-57d4-4313-b0b7-f0a5e0adb12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:13:07 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c211ae5b-207c-434f-b4d1-a7cafc67f357 tempest-ServersNegativeTestJSON-671890593 None] Flow 'volume_create_manager' (3039f27f-2227-4c8c-8ea0-4878a8bb8bd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:13:07 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-c211ae5b-207c-434f-b4d1-a7cafc67f357 tempest-ServersNegativeTestJSON-671890593 None] Created volume successfully. Aug 31 15:13:11 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-0b2b2e92-b900-4f6f-b755-64f830194381 tempest-ServersNegativeTestJSON-671890593 None] Acquiring lock "cinder-54768355-a886-44b1-83f8-51128614fcb0-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:13:11 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-0b2b2e92-b900-4f6f-b755-64f830194381 tempest-ServersNegativeTestJSON-671890593 None] Lock "cinder-54768355-a886-44b1-83f8-51128614fcb0-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:13:11 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-0b2b2e92-b900-4f6f-b755-64f830194381 tempest-ServersNegativeTestJSON-671890593 None] Acquiring lock "cinder-quobyte-54768355-a886-44b1-83f8-51128614fcb0" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:13:11 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-0b2b2e92-b900-4f6f-b755-64f830194381 tempest-ServersNegativeTestJSON-671890593 None] Lock "cinder-quobyte-54768355-a886-44b1-83f8-51128614fcb0" acquired by "delete_volume" :: waited 0.018s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:13:11 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a9e853-21da-42c4-a025-06a8f2e20fe5]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:13:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0b2b2e92-b900-4f6f-b755-64f830194381 tempest-ServersNegativeTestJSON-671890593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-54768355-a886-44b1-83f8-51128614fcb0 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:13:11 devstack sudo[87814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-54768355-a886-44b1-83f8-51128614fcb0 Aug 31 15:13:11 devstack sudo[87814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:13:12 devstack sudo[87814]: pam_unix(sudo:session): session closed for user root Aug 31 15:13:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0b2b2e92-b900-4f6f-b755-64f830194381 tempest-ServersNegativeTestJSON-671890593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-54768355-a886-44b1-83f8-51128614fcb0" returned: 0 in 0.420s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:13:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0b2b2e92-b900-4f6f-b755-64f830194381 tempest-ServersNegativeTestJSON-671890593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-54768355-a886-44b1-83f8-51128614fcb0 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:13:12 devstack sudo[87819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-54768355-a886-44b1-83f8-51128614fcb0 Aug 31 15:13:12 devstack sudo[87819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:13:12 devstack sudo[87819]: pam_unix(sudo:session): session closed for user root Aug 31 15:13:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0b2b2e92-b900-4f6f-b755-64f830194381 tempest-ServersNegativeTestJSON-671890593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-54768355-a886-44b1-83f8-51128614fcb0" returned: 0 in 0.337s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:13:12 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-0b2b2e92-b900-4f6f-b755-64f830194381 tempest-ServersNegativeTestJSON-671890593 None] Lock "cinder-quobyte-54768355-a886-44b1-83f8-51128614fcb0" released by "delete_volume" :: held 0.814s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:13:12 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-0b2b2e92-b900-4f6f-b755-64f830194381 tempest-ServersNegativeTestJSON-671890593 None] Created reservations ['52cc4c7d-570d-4cb3-a2fc-b4f94dd9e268', '87ff45b3-b1a0-44a7-83e2-148862524ac1', '4fa8056c-3f1e-47b1-a062-3917c58196ee', '007eef2a-836c-473e-b924-fba2304a17f0'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:13:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-0b2b2e92-b900-4f6f-b755-64f830194381 tempest-ServersNegativeTestJSON-671890593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:13:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-0b2b2e92-b900-4f6f-b755-64f830194381 tempest-ServersNegativeTestJSON-671890593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:13:12 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-0b2b2e92-b900-4f6f-b755-64f830194381 tempest-ServersNegativeTestJSON-671890593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:13:12 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-0b2b2e92-b900-4f6f-b755-64f830194381 tempest-ServersNegativeTestJSON-671890593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:13:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-0b2b2e92-b900-4f6f-b755-64f830194381 tempest-ServersNegativeTestJSON-671890593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:13:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0b2b2e92-b900-4f6f-b755-64f830194381 tempest-ServersNegativeTestJSON-671890593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:13:12 devstack sudo[87822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:13:12 devstack sudo[87822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:13:12 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-31863920-3ccc-4cd2-96ac-ac2e41129447 tempest-ServersNegativeTestJSON-671890593 None] Acquiring lock "cinder-f8674d4d-bc90-4bd5-bc6b-efd8ef3ec4ae-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:13:12 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-31863920-3ccc-4cd2-96ac-ac2e41129447 tempest-ServersNegativeTestJSON-671890593 None] Lock "cinder-f8674d4d-bc90-4bd5-bc6b-efd8ef3ec4ae-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:13:12 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-31863920-3ccc-4cd2-96ac-ac2e41129447 tempest-ServersNegativeTestJSON-671890593 None] Acquiring lock "cinder-quobyte-f8674d4d-bc90-4bd5-bc6b-efd8ef3ec4ae" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:13:13 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-31863920-3ccc-4cd2-96ac-ac2e41129447 tempest-ServersNegativeTestJSON-671890593 None] Lock "cinder-quobyte-f8674d4d-bc90-4bd5-bc6b-efd8ef3ec4ae" acquired by "delete_volume" :: waited 0.036s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:13:13 devstack sudo[87822]: pam_unix(sudo:session): session closed for user root Aug 31 15:13:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0b2b2e92-b900-4f6f-b755-64f830194381 tempest-ServersNegativeTestJSON-671890593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.348s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:13:13 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-0b2b2e92-b900-4f6f-b755-64f830194381 tempest-ServersNegativeTestJSON-671890593 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:13:13 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[652913d5-2a43-42a5-b0e5-2fff2fc235c9]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:13:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-31863920-3ccc-4cd2-96ac-ac2e41129447 tempest-ServersNegativeTestJSON-671890593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f8674d4d-bc90-4bd5-bc6b-efd8ef3ec4ae {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:13:13 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-0b2b2e92-b900-4f6f-b755-64f830194381 tempest-ServersNegativeTestJSON-671890593 None] Deleted volume successfully. Aug 31 15:13:13 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-0b2b2e92-b900-4f6f-b755-64f830194381 tempest-ServersNegativeTestJSON-671890593 None] Lock "cinder-54768355-a886-44b1-83f8-51128614fcb0-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:13:13 devstack sudo[87825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f8674d4d-bc90-4bd5-bc6b-efd8ef3ec4ae Aug 31 15:13:13 devstack sudo[87825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:13:13 devstack sudo[87825]: pam_unix(sudo:session): session closed for user root Aug 31 15:13:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-31863920-3ccc-4cd2-96ac-ac2e41129447 tempest-ServersNegativeTestJSON-671890593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f8674d4d-bc90-4bd5-bc6b-efd8ef3ec4ae" returned: 0 in 0.465s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:13:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-31863920-3ccc-4cd2-96ac-ac2e41129447 tempest-ServersNegativeTestJSON-671890593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f8674d4d-bc90-4bd5-bc6b-efd8ef3ec4ae {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:13:13 devstack sudo[87830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f8674d4d-bc90-4bd5-bc6b-efd8ef3ec4ae Aug 31 15:13:13 devstack sudo[87830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:13:13 devstack sudo[87830]: pam_unix(sudo:session): session closed for user root Aug 31 15:13:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-31863920-3ccc-4cd2-96ac-ac2e41129447 tempest-ServersNegativeTestJSON-671890593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f8674d4d-bc90-4bd5-bc6b-efd8ef3ec4ae" returned: 0 in 0.274s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:13:13 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-31863920-3ccc-4cd2-96ac-ac2e41129447 tempest-ServersNegativeTestJSON-671890593 None] Lock "cinder-quobyte-f8674d4d-bc90-4bd5-bc6b-efd8ef3ec4ae" released by "delete_volume" :: held 0.800s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:13:13 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-31863920-3ccc-4cd2-96ac-ac2e41129447 tempest-ServersNegativeTestJSON-671890593 None] Created reservations ['87eeedeb-fd64-4867-8624-d4c595ea5df2', '5bc4fc46-b067-4d34-a14a-ed11c6fa7ea4', '01566592-dc42-4871-ad16-8d27e5c38015', 'eaa6868d-0ee2-4815-98e9-d8768341f11c'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:13:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-31863920-3ccc-4cd2-96ac-ac2e41129447 tempest-ServersNegativeTestJSON-671890593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:13:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-31863920-3ccc-4cd2-96ac-ac2e41129447 tempest-ServersNegativeTestJSON-671890593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:13:13 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-31863920-3ccc-4cd2-96ac-ac2e41129447 tempest-ServersNegativeTestJSON-671890593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:13:13 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-31863920-3ccc-4cd2-96ac-ac2e41129447 tempest-ServersNegativeTestJSON-671890593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:13:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-31863920-3ccc-4cd2-96ac-ac2e41129447 tempest-ServersNegativeTestJSON-671890593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:13:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-31863920-3ccc-4cd2-96ac-ac2e41129447 tempest-ServersNegativeTestJSON-671890593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:13:14 devstack sudo[87833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:13:14 devstack sudo[87833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:13:14 devstack sudo[87833]: pam_unix(sudo:session): session closed for user root Aug 31 15:13:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-31863920-3ccc-4cd2-96ac-ac2e41129447 tempest-ServersNegativeTestJSON-671890593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.338s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:13:14 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-31863920-3ccc-4cd2-96ac-ac2e41129447 tempest-ServersNegativeTestJSON-671890593 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:13:14 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-31863920-3ccc-4cd2-96ac-ac2e41129447 tempest-ServersNegativeTestJSON-671890593 None] Deleted volume successfully. Aug 31 15:13:14 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-31863920-3ccc-4cd2-96ac-ac2e41129447 tempest-ServersNegativeTestJSON-671890593 None] Lock "cinder-f8674d4d-bc90-4bd5-bc6b-efd8ef3ec4ae-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:13:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-95bd485f-d1a5-4bf5-86db-c2ee47ae61c7 req-d2628d42-16d2-4878-9d0d-eaedf6bf3732 tempest-TaggedAttachmentsTest-1355735929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:13:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-95bd485f-d1a5-4bf5-86db-c2ee47ae61c7 req-d2628d42-16d2-4878-9d0d-eaedf6bf3732 tempest-TaggedAttachmentsTest-1355735929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:13:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-95bd485f-d1a5-4bf5-86db-c2ee47ae61c7 req-d2628d42-16d2-4878-9d0d-eaedf6bf3732 tempest-TaggedAttachmentsTest-1355735929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:13:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-95bd485f-d1a5-4bf5-86db-c2ee47ae61c7 req-d2628d42-16d2-4878-9d0d-eaedf6bf3732 tempest-TaggedAttachmentsTest-1355735929 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77', 'name': 'volume-53cfde77-4676-4bba-a6c8-b0d2a25ccaed', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b9a62fa4-fd21-4b17-9f8b-d6a8a8218108', 'enforce_multipath': True} {{(pid=86000) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 31 15:13:30 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-95bd485f-d1a5-4bf5-86db-c2ee47ae61c7 req-d2628d42-16d2-4878-9d0d-eaedf6bf3732 tempest-TaggedAttachmentsTest-1355735929 None] attachment_update completed successfully. Aug 31 15:13:35 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:UPDATE=40,cinder:SELECT=36,cinder:INSERT=7,cinder:DELETE=3 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:13:35 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-f0718f32-6785-46e5-a1cc-06cf20acdc1c req-34e7a1d1-ec70-4766-8fef-3cbedd598ccc tempest-TaggedAttachmentsTest-1355735929 None] Terminate volume connection completed successfully. Aug 31 15:13:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-f0718f32-6785-46e5-a1cc-06cf20acdc1c req-34e7a1d1-ec70-4766-8fef-3cbedd598ccc tempest-TaggedAttachmentsTest-1355735929 None] Deleting attachment b9a62fa4-fd21-4b17-9f8b-d6a8a8218108. {{(pid=86000) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 31 15:13:45 devstack cinder-volume[86000]: DEBUG oslo_service.periodic_task [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86000) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:13:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:13:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:13:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:13:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:13:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:13:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:13:45 devstack sudo[88483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:13:45 devstack sudo[88483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:13:45 devstack sudo[88483]: pam_unix(sudo:session): session closed for user root Aug 31 15:13:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.521s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:13:45 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:13:45 devstack cinder-volume[86000]: DEBUG oslo_service.periodic_task [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running periodic task VolumeManager._thread_info {{(pid=86000) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:13:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] thread count: 8 {{(pid=86000) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 31 15:13:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] thread info: [<_MainThread(MainThread, started 137631281086592)>, , , , , , , ] {{(pid=86000) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 31 15:13:45 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:SELECT=26,cinder:INSERT=8,cinder:UPDATE=30,cinder:DELETE=2 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:13:55 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-84d1c886-55f5-4a69-83ff-c494258e85a3 tempest-TaggedAttachmentsTest-1355735929 None] Acquiring lock "cinder-53cfde77-4676-4bba-a6c8-b0d2a25ccaed-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:13:55 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-84d1c886-55f5-4a69-83ff-c494258e85a3 tempest-TaggedAttachmentsTest-1355735929 None] Lock "cinder-53cfde77-4676-4bba-a6c8-b0d2a25ccaed-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:13:55 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-84d1c886-55f5-4a69-83ff-c494258e85a3 tempest-TaggedAttachmentsTest-1355735929 None] Acquiring lock "cinder-quobyte-53cfde77-4676-4bba-a6c8-b0d2a25ccaed" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:13:55 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-84d1c886-55f5-4a69-83ff-c494258e85a3 tempest-TaggedAttachmentsTest-1355735929 None] Lock "cinder-quobyte-53cfde77-4676-4bba-a6c8-b0d2a25ccaed" acquired by "delete_volume" :: waited 0.028s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:13:55 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[155b06c1-224c-4eee-92ac-cb0ba54c94f0]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:13:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-84d1c886-55f5-4a69-83ff-c494258e85a3 tempest-TaggedAttachmentsTest-1355735929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-53cfde77-4676-4bba-a6c8-b0d2a25ccaed {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:13:55 devstack sudo[88519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-53cfde77-4676-4bba-a6c8-b0d2a25ccaed Aug 31 15:13:55 devstack sudo[88519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:13:55 devstack sudo[88519]: pam_unix(sudo:session): session closed for user root Aug 31 15:13:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-84d1c886-55f5-4a69-83ff-c494258e85a3 tempest-TaggedAttachmentsTest-1355735929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-53cfde77-4676-4bba-a6c8-b0d2a25ccaed" returned: 0 in 0.600s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:13:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-84d1c886-55f5-4a69-83ff-c494258e85a3 tempest-TaggedAttachmentsTest-1355735929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-53cfde77-4676-4bba-a6c8-b0d2a25ccaed {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:13:55 devstack sudo[88528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-53cfde77-4676-4bba-a6c8-b0d2a25ccaed Aug 31 15:13:55 devstack sudo[88528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:13:56 devstack sudo[88528]: pam_unix(sudo:session): session closed for user root Aug 31 15:13:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-84d1c886-55f5-4a69-83ff-c494258e85a3 tempest-TaggedAttachmentsTest-1355735929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-53cfde77-4676-4bba-a6c8-b0d2a25ccaed" returned: 0 in 0.294s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:13:56 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-84d1c886-55f5-4a69-83ff-c494258e85a3 tempest-TaggedAttachmentsTest-1355735929 None] Lock "cinder-quobyte-53cfde77-4676-4bba-a6c8-b0d2a25ccaed" released by "delete_volume" :: held 0.985s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:13:56 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-84d1c886-55f5-4a69-83ff-c494258e85a3 tempest-TaggedAttachmentsTest-1355735929 None] Created reservations ['8e3f3554-c8d6-4500-a1b5-80dbea0c7df2', '62b4043a-8d6e-47a1-b7c2-119a1afc64e1', '920b9e1c-1a52-4a02-93e4-8a3486a36368', '2dafaa4a-bfbc-4133-ab4c-53d89b8b8cba'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:13:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-84d1c886-55f5-4a69-83ff-c494258e85a3 tempest-TaggedAttachmentsTest-1355735929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:13:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-84d1c886-55f5-4a69-83ff-c494258e85a3 tempest-TaggedAttachmentsTest-1355735929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:13:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-84d1c886-55f5-4a69-83ff-c494258e85a3 tempest-TaggedAttachmentsTest-1355735929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:13:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-84d1c886-55f5-4a69-83ff-c494258e85a3 tempest-TaggedAttachmentsTest-1355735929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:13:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-84d1c886-55f5-4a69-83ff-c494258e85a3 tempest-TaggedAttachmentsTest-1355735929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:13:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-84d1c886-55f5-4a69-83ff-c494258e85a3 tempest-TaggedAttachmentsTest-1355735929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:13:56 devstack sudo[88544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:13:56 devstack sudo[88544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:13:56 devstack sudo[88544]: pam_unix(sudo:session): session closed for user root Aug 31 15:13:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-84d1c886-55f5-4a69-83ff-c494258e85a3 tempest-TaggedAttachmentsTest-1355735929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.318s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:13:56 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-84d1c886-55f5-4a69-83ff-c494258e85a3 tempest-TaggedAttachmentsTest-1355735929 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:13:56 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-84d1c886-55f5-4a69-83ff-c494258e85a3 tempest-TaggedAttachmentsTest-1355735929 None] Deleted volume successfully. Aug 31 15:13:56 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-84d1c886-55f5-4a69-83ff-c494258e85a3 tempest-TaggedAttachmentsTest-1355735929 None] Lock "cinder-53cfde77-4676-4bba-a6c8-b0d2a25ccaed-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:14:06 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=6 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:14:06 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:UPDATE=10,cinder:SELECT=4,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:14:11 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-cea8aa77-8549-4c58-89f3-4415328babac tempest-AttachVolumeTestJSON-1224274971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:14:11 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cea8aa77-8549-4c58-89f3-4415328babac tempest-AttachVolumeTestJSON-1224274971 None] Flow 'volume_create_manager' (da0d33c3-c7a9-4c1b-a39f-422ab3920770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:14:11 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cea8aa77-8549-4c58-89f3-4415328babac tempest-AttachVolumeTestJSON-1224274971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95a5b4b0-db7d-4de7-a33b-3cb9a28cfc87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:14:11 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cea8aa77-8549-4c58-89f3-4415328babac tempest-AttachVolumeTestJSON-1224274971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95a5b4b0-db7d-4de7-a33b-3cb9a28cfc87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2049718762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eba67575-402b-48ad-9008-19e0f43f5b51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94d1b489a6fc4b8d90323c4d2759774f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:14:12Z,use_quota=True,user_id='e37742c6023b41c89297120e921e6d25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:14:11 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cea8aa77-8549-4c58-89f3-4415328babac tempest-AttachVolumeTestJSON-1224274971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a18f2e7-ee30-42cd-82de-ec52459851dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:14:11 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cea8aa77-8549-4c58-89f3-4415328babac tempest-AttachVolumeTestJSON-1224274971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a18f2e7-ee30-42cd-82de-ec52459851dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:14:11 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cea8aa77-8549-4c58-89f3-4415328babac tempest-AttachVolumeTestJSON-1224274971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b2723d4-294c-4529-98d3-9d7d9ce02f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:14:11 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cea8aa77-8549-4c58-89f3-4415328babac tempest-AttachVolumeTestJSON-1224274971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b2723d4-294c-4529-98d3-9d7d9ce02f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eba67575-402b-48ad-9008-19e0f43f5b51', 'volume_name': 'volume-eba67575-402b-48ad-9008-19e0f43f5b51', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:14:11 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cea8aa77-8549-4c58-89f3-4415328babac tempest-AttachVolumeTestJSON-1224274971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bfaefdf-5a7b-4a31-8b7d-591e2b939ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:14:11 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cea8aa77-8549-4c58-89f3-4415328babac tempest-AttachVolumeTestJSON-1224274971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bfaefdf-5a7b-4a31-8b7d-591e2b939ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:14:11 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cea8aa77-8549-4c58-89f3-4415328babac tempest-AttachVolumeTestJSON-1224274971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dd84bc1-7345-4e53-8f08-2b895f1ab527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:14:11 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-cea8aa77-8549-4c58-89f3-4415328babac tempest-AttachVolumeTestJSON-1224274971 None] Volume eba67575-402b-48ad-9008-19e0f43f5b51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eba67575-402b-48ad-9008-19e0f43f5b51', 'volume_size': 1} Aug 31 15:14:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-cea8aa77-8549-4c58-89f3-4415328babac tempest-AttachVolumeTestJSON-1224274971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:14:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-cea8aa77-8549-4c58-89f3-4415328babac tempest-AttachVolumeTestJSON-1224274971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:14:11 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-cea8aa77-8549-4c58-89f3-4415328babac tempest-AttachVolumeTestJSON-1224274971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2049718762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eba67575-402b-48ad-9008-19e0f43f5b51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94d1b489a6fc4b8d90323c4d2759774f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:14:12Z,use_quota=True,user_id='e37742c6023b41c89297120e921e6d25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:14:11 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-cea8aa77-8549-4c58-89f3-4415328babac tempest-AttachVolumeTestJSON-1224274971 None] Creating volume eba67575-402b-48ad-9008-19e0f43f5b51 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:14:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-cea8aa77-8549-4c58-89f3-4415328babac tempest-AttachVolumeTestJSON-1224274971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:14:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-cea8aa77-8549-4c58-89f3-4415328babac tempest-AttachVolumeTestJSON-1224274971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:14:11 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-cea8aa77-8549-4c58-89f3-4415328babac tempest-AttachVolumeTestJSON-1224274971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:14:11 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-cea8aa77-8549-4c58-89f3-4415328babac tempest-AttachVolumeTestJSON-1224274971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:14:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-cea8aa77-8549-4c58-89f3-4415328babac tempest-AttachVolumeTestJSON-1224274971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:14:11 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-cea8aa77-8549-4c58-89f3-4415328babac tempest-AttachVolumeTestJSON-1224274971 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:14:11 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-cea8aa77-8549-4c58-89f3-4415328babac tempest-AttachVolumeTestJSON-1224274971 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:14:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cea8aa77-8549-4c58-89f3-4415328babac tempest-AttachVolumeTestJSON-1224274971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eba67575-402b-48ad-9008-19e0f43f5b51 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:14:11 devstack sudo[88794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eba67575-402b-48ad-9008-19e0f43f5b51 1073741824 Aug 31 15:14:11 devstack sudo[88794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:14:12 devstack sudo[88794]: pam_unix(sudo:session): session closed for user root Aug 31 15:14:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cea8aa77-8549-4c58-89f3-4415328babac tempest-AttachVolumeTestJSON-1224274971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eba67575-402b-48ad-9008-19e0f43f5b51 1073741824" returned: 0 in 0.837s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:14:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cea8aa77-8549-4c58-89f3-4415328babac tempest-AttachVolumeTestJSON-1224274971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eba67575-402b-48ad-9008-19e0f43f5b51 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:14:12 devstack sudo[88800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eba67575-402b-48ad-9008-19e0f43f5b51 Aug 31 15:14:12 devstack sudo[88800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:14:13 devstack sudo[88800]: pam_unix(sudo:session): session closed for user root Aug 31 15:14:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cea8aa77-8549-4c58-89f3-4415328babac tempest-AttachVolumeTestJSON-1224274971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eba67575-402b-48ad-9008-19e0f43f5b51" returned: 0 in 0.508s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:14:13 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-cea8aa77-8549-4c58-89f3-4415328babac tempest-AttachVolumeTestJSON-1224274971 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:14:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-cea8aa77-8549-4c58-89f3-4415328babac tempest-AttachVolumeTestJSON-1224274971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.425s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:14:13 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cea8aa77-8549-4c58-89f3-4415328babac tempest-AttachVolumeTestJSON-1224274971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dd84bc1-7345-4e53-8f08-2b895f1ab527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eba67575-402b-48ad-9008-19e0f43f5b51', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:14:13 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cea8aa77-8549-4c58-89f3-4415328babac tempest-AttachVolumeTestJSON-1224274971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4577c6ca-844c-4cc9-b6aa-d6d3646138a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:14:13 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-cea8aa77-8549-4c58-89f3-4415328babac tempest-AttachVolumeTestJSON-1224274971 None] Volume volume-eba67575-402b-48ad-9008-19e0f43f5b51 (eba67575-402b-48ad-9008-19e0f43f5b51): created successfully Aug 31 15:14:13 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cea8aa77-8549-4c58-89f3-4415328babac tempest-AttachVolumeTestJSON-1224274971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4577c6ca-844c-4cc9-b6aa-d6d3646138a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:14:13 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cea8aa77-8549-4c58-89f3-4415328babac tempest-AttachVolumeTestJSON-1224274971 None] Flow 'volume_create_manager' (da0d33c3-c7a9-4c1b-a39f-422ab3920770) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:14:13 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-cea8aa77-8549-4c58-89f3-4415328babac tempest-AttachVolumeTestJSON-1224274971 None] Created volume successfully. Aug 31 15:14:13 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-70f12a05-5bfa-4cb9-8232-7d4ccd761eb7 tempest-VolumesAdminNegativeTest-841781036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:14:13 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-70f12a05-5bfa-4cb9-8232-7d4ccd761eb7 tempest-VolumesAdminNegativeTest-841781036 None] Flow 'volume_create_manager' (50bc0476-9559-4740-a18b-c713f7fe379f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:14:13 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-70f12a05-5bfa-4cb9-8232-7d4ccd761eb7 tempest-VolumesAdminNegativeTest-841781036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (068db211-4b3c-4e17-88a5-4ba65a582173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:14:13 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-70f12a05-5bfa-4cb9-8232-7d4ccd761eb7 tempest-VolumesAdminNegativeTest-841781036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (068db211-4b3c-4e17-88a5-4ba65a582173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1840360456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef6cb69a-40fe-4378-a5c0-b0001435dd50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='708040d01c58400bb2143d27a08e7258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:14:14Z,use_quota=True,user_id='a19af438847b44d4bd34ade2b2dec9a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:14:13 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-70f12a05-5bfa-4cb9-8232-7d4ccd761eb7 tempest-VolumesAdminNegativeTest-841781036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (930a23d4-cc55-4ad2-aadc-1cfad740614e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:14:13 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-70f12a05-5bfa-4cb9-8232-7d4ccd761eb7 tempest-VolumesAdminNegativeTest-841781036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (930a23d4-cc55-4ad2-aadc-1cfad740614e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:14:13 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-70f12a05-5bfa-4cb9-8232-7d4ccd761eb7 tempest-VolumesAdminNegativeTest-841781036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca58e327-9a5c-4a03-ab6c-39508a2cbd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:14:13 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-70f12a05-5bfa-4cb9-8232-7d4ccd761eb7 tempest-VolumesAdminNegativeTest-841781036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca58e327-9a5c-4a03-ab6c-39508a2cbd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef6cb69a-40fe-4378-a5c0-b0001435dd50', 'volume_name': 'volume-ef6cb69a-40fe-4378-a5c0-b0001435dd50', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:14:13 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-70f12a05-5bfa-4cb9-8232-7d4ccd761eb7 tempest-VolumesAdminNegativeTest-841781036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dd5b5cb-966b-4b6a-a263-46417e5a3aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:14:13 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-70f12a05-5bfa-4cb9-8232-7d4ccd761eb7 tempest-VolumesAdminNegativeTest-841781036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dd5b5cb-966b-4b6a-a263-46417e5a3aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:14:13 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-70f12a05-5bfa-4cb9-8232-7d4ccd761eb7 tempest-VolumesAdminNegativeTest-841781036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da792548-47b1-4bea-816d-29fd200a85ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:14:13 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-70f12a05-5bfa-4cb9-8232-7d4ccd761eb7 tempest-VolumesAdminNegativeTest-841781036 None] Volume ef6cb69a-40fe-4378-a5c0-b0001435dd50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef6cb69a-40fe-4378-a5c0-b0001435dd50', 'volume_size': 1} Aug 31 15:14:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-70f12a05-5bfa-4cb9-8232-7d4ccd761eb7 tempest-VolumesAdminNegativeTest-841781036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:14:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-70f12a05-5bfa-4cb9-8232-7d4ccd761eb7 tempest-VolumesAdminNegativeTest-841781036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:14:13 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-70f12a05-5bfa-4cb9-8232-7d4ccd761eb7 tempest-VolumesAdminNegativeTest-841781036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1840360456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef6cb69a-40fe-4378-a5c0-b0001435dd50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='708040d01c58400bb2143d27a08e7258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:14:14Z,use_quota=True,user_id='a19af438847b44d4bd34ade2b2dec9a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:14:13 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-70f12a05-5bfa-4cb9-8232-7d4ccd761eb7 tempest-VolumesAdminNegativeTest-841781036 None] Creating volume ef6cb69a-40fe-4378-a5c0-b0001435dd50 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:14:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-70f12a05-5bfa-4cb9-8232-7d4ccd761eb7 tempest-VolumesAdminNegativeTest-841781036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:14:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-70f12a05-5bfa-4cb9-8232-7d4ccd761eb7 tempest-VolumesAdminNegativeTest-841781036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:14:13 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-70f12a05-5bfa-4cb9-8232-7d4ccd761eb7 tempest-VolumesAdminNegativeTest-841781036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:14:13 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-70f12a05-5bfa-4cb9-8232-7d4ccd761eb7 tempest-VolumesAdminNegativeTest-841781036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:14:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-70f12a05-5bfa-4cb9-8232-7d4ccd761eb7 tempest-VolumesAdminNegativeTest-841781036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:14:13 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-70f12a05-5bfa-4cb9-8232-7d4ccd761eb7 tempest-VolumesAdminNegativeTest-841781036 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:14:13 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-70f12a05-5bfa-4cb9-8232-7d4ccd761eb7 tempest-VolumesAdminNegativeTest-841781036 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:14:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-70f12a05-5bfa-4cb9-8232-7d4ccd761eb7 tempest-VolumesAdminNegativeTest-841781036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ef6cb69a-40fe-4378-a5c0-b0001435dd50 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:14:13 devstack sudo[88804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ef6cb69a-40fe-4378-a5c0-b0001435dd50 1073741824 Aug 31 15:14:13 devstack sudo[88804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:14:14 devstack sudo[88804]: pam_unix(sudo:session): session closed for user root Aug 31 15:14:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-70f12a05-5bfa-4cb9-8232-7d4ccd761eb7 tempest-VolumesAdminNegativeTest-841781036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ef6cb69a-40fe-4378-a5c0-b0001435dd50 1073741824" returned: 0 in 0.748s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:14:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-70f12a05-5bfa-4cb9-8232-7d4ccd761eb7 tempest-VolumesAdminNegativeTest-841781036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ef6cb69a-40fe-4378-a5c0-b0001435dd50 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:14:14 devstack sudo[88817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ef6cb69a-40fe-4378-a5c0-b0001435dd50 Aug 31 15:14:14 devstack sudo[88817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:14:15 devstack sudo[88817]: pam_unix(sudo:session): session closed for user root Aug 31 15:14:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-70f12a05-5bfa-4cb9-8232-7d4ccd761eb7 tempest-VolumesAdminNegativeTest-841781036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ef6cb69a-40fe-4378-a5c0-b0001435dd50" returned: 0 in 0.670s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:14:15 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-70f12a05-5bfa-4cb9-8232-7d4ccd761eb7 tempest-VolumesAdminNegativeTest-841781036 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:14:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-70f12a05-5bfa-4cb9-8232-7d4ccd761eb7 tempest-VolumesAdminNegativeTest-841781036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:14:15 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-70f12a05-5bfa-4cb9-8232-7d4ccd761eb7 tempest-VolumesAdminNegativeTest-841781036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da792548-47b1-4bea-816d-29fd200a85ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef6cb69a-40fe-4378-a5c0-b0001435dd50', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:14:15 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-70f12a05-5bfa-4cb9-8232-7d4ccd761eb7 tempest-VolumesAdminNegativeTest-841781036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44d20b11-d035-4ae6-bb17-982f918262b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:14:15 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-70f12a05-5bfa-4cb9-8232-7d4ccd761eb7 tempest-VolumesAdminNegativeTest-841781036 None] Volume volume-ef6cb69a-40fe-4378-a5c0-b0001435dd50 (ef6cb69a-40fe-4378-a5c0-b0001435dd50): created successfully Aug 31 15:14:15 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-70f12a05-5bfa-4cb9-8232-7d4ccd761eb7 tempest-VolumesAdminNegativeTest-841781036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44d20b11-d035-4ae6-bb17-982f918262b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:14:15 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-70f12a05-5bfa-4cb9-8232-7d4ccd761eb7 tempest-VolumesAdminNegativeTest-841781036 None] Flow 'volume_create_manager' (50bc0476-9559-4740-a18b-c713f7fe379f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:14:15 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-70f12a05-5bfa-4cb9-8232-7d4ccd761eb7 tempest-VolumesAdminNegativeTest-841781036 None] Created volume successfully. Aug 31 15:14:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-7297e726-44ef-4361-ab5b-347698216e1b req-d04bea49-a773-4748-8af8-a538ff36f036 tempest-AttachVolumeTestJSON-1224274971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:14:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-7297e726-44ef-4361-ab5b-347698216e1b req-d04bea49-a773-4748-8af8-a538ff36f036 tempest-AttachVolumeTestJSON-1224274971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:14:16 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-3a2e02a6-0ae3-49a8-bb2c-a457b9b772ca tempest-VolumesAdminNegativeTest-841781036 None] Acquiring lock "cinder-ef6cb69a-40fe-4378-a5c0-b0001435dd50-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:14:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-7297e726-44ef-4361-ab5b-347698216e1b req-d04bea49-a773-4748-8af8-a538ff36f036 tempest-AttachVolumeTestJSON-1224274971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.048s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:14:16 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-3a2e02a6-0ae3-49a8-bb2c-a457b9b772ca tempest-VolumesAdminNegativeTest-841781036 None] Lock "cinder-ef6cb69a-40fe-4378-a5c0-b0001435dd50-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:14:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-7297e726-44ef-4361-ab5b-347698216e1b req-d04bea49-a773-4748-8af8-a538ff36f036 tempest-AttachVolumeTestJSON-1224274971 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77', 'name': 'volume-eba67575-402b-48ad-9008-19e0f43f5b51', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c8004350-5ad2-439e-bab5-0fb7610f9e83', 'enforce_multipath': True} {{(pid=86000) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 31 15:14:17 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-3a2e02a6-0ae3-49a8-bb2c-a457b9b772ca tempest-VolumesAdminNegativeTest-841781036 None] Acquiring lock "cinder-quobyte-ef6cb69a-40fe-4378-a5c0-b0001435dd50" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:14:17 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-3a2e02a6-0ae3-49a8-bb2c-a457b9b772ca tempest-VolumesAdminNegativeTest-841781036 None] Lock "cinder-quobyte-ef6cb69a-40fe-4378-a5c0-b0001435dd50" acquired by "delete_volume" :: waited 0.031s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:14:17 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1deafe-cc6c-487a-8cfa-9f06214d7cc3]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:14:17 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-7297e726-44ef-4361-ab5b-347698216e1b req-d04bea49-a773-4748-8af8-a538ff36f036 tempest-AttachVolumeTestJSON-1224274971 None] attachment_update completed successfully. Aug 31 15:14:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-3a2e02a6-0ae3-49a8-bb2c-a457b9b772ca tempest-VolumesAdminNegativeTest-841781036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ef6cb69a-40fe-4378-a5c0-b0001435dd50 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:14:17 devstack sudo[88886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ef6cb69a-40fe-4378-a5c0-b0001435dd50 Aug 31 15:14:17 devstack sudo[88886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:14:17 devstack sudo[88886]: pam_unix(sudo:session): session closed for user root Aug 31 15:14:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-3a2e02a6-0ae3-49a8-bb2c-a457b9b772ca tempest-VolumesAdminNegativeTest-841781036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ef6cb69a-40fe-4378-a5c0-b0001435dd50" returned: 0 in 0.618s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:14:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-3a2e02a6-0ae3-49a8-bb2c-a457b9b772ca tempest-VolumesAdminNegativeTest-841781036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ef6cb69a-40fe-4378-a5c0-b0001435dd50 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:14:17 devstack sudo[89273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ef6cb69a-40fe-4378-a5c0-b0001435dd50 Aug 31 15:14:17 devstack sudo[89273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:14:18 devstack sudo[89273]: pam_unix(sudo:session): session closed for user root Aug 31 15:14:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-3a2e02a6-0ae3-49a8-bb2c-a457b9b772ca tempest-VolumesAdminNegativeTest-841781036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ef6cb69a-40fe-4378-a5c0-b0001435dd50" returned: 0 in 0.424s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:14:18 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-3a2e02a6-0ae3-49a8-bb2c-a457b9b772ca tempest-VolumesAdminNegativeTest-841781036 None] Lock "cinder-quobyte-ef6cb69a-40fe-4378-a5c0-b0001435dd50" released by "delete_volume" :: held 1.099s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:14:18 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-3a2e02a6-0ae3-49a8-bb2c-a457b9b772ca tempest-VolumesAdminNegativeTest-841781036 None] Created reservations ['6ab537cf-6069-4a0e-b3e8-8773c471e919', '32e884da-4a48-453a-983b-19312d275292', '60fff510-c65d-475a-8fcd-025b4b12eaf6', 'e41049e0-0a07-4713-a93d-34e58ac25e38'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:14:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-3a2e02a6-0ae3-49a8-bb2c-a457b9b772ca tempest-VolumesAdminNegativeTest-841781036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:14:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-3a2e02a6-0ae3-49a8-bb2c-a457b9b772ca tempest-VolumesAdminNegativeTest-841781036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:14:18 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e02a6-0ae3-49a8-bb2c-a457b9b772ca tempest-VolumesAdminNegativeTest-841781036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:14:18 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e02a6-0ae3-49a8-bb2c-a457b9b772ca tempest-VolumesAdminNegativeTest-841781036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:14:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-3a2e02a6-0ae3-49a8-bb2c-a457b9b772ca tempest-VolumesAdminNegativeTest-841781036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:14:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-3a2e02a6-0ae3-49a8-bb2c-a457b9b772ca tempest-VolumesAdminNegativeTest-841781036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:14:18 devstack sudo[89276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:14:18 devstack sudo[89276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:14:18 devstack sudo[89276]: pam_unix(sudo:session): session closed for user root Aug 31 15:14:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-3a2e02a6-0ae3-49a8-bb2c-a457b9b772ca tempest-VolumesAdminNegativeTest-841781036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.304s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:14:18 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-3a2e02a6-0ae3-49a8-bb2c-a457b9b772ca tempest-VolumesAdminNegativeTest-841781036 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:14:18 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-3a2e02a6-0ae3-49a8-bb2c-a457b9b772ca tempest-VolumesAdminNegativeTest-841781036 None] Deleted volume successfully. Aug 31 15:14:18 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-3a2e02a6-0ae3-49a8-bb2c-a457b9b772ca tempest-VolumesAdminNegativeTest-841781036 None] Lock "cinder-ef6cb69a-40fe-4378-a5c0-b0001435dd50-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:14:28 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:SELECT=14,cinder:UPDATE=18,cinder:DELETE=1,cinder:INSERT=2 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:14:28 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:SELECT=17,cinder:UPDATE=13,cinder:INSERT=4,cinder:DELETE=2 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:14:36 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-862d50e6-5022-42dd-8c7a-2b5ae527f838 tempest-AttachVolumeNegativeTest-1548450425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:14:36 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-862d50e6-5022-42dd-8c7a-2b5ae527f838 tempest-AttachVolumeNegativeTest-1548450425 None] Flow 'volume_create_manager' (d1ade20f-119e-4826-b1b5-ea528a1efaa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:14:36 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-862d50e6-5022-42dd-8c7a-2b5ae527f838 tempest-AttachVolumeNegativeTest-1548450425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a0e2f1-e17f-45b6-8b76-aa974e8c5e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:14:36 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-862d50e6-5022-42dd-8c7a-2b5ae527f838 tempest-AttachVolumeNegativeTest-1548450425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a0e2f1-e17f-45b6-8b76-aa974e8c5e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-920826482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=654b7439-8b11-407e-9ad4-e45081c01d76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32c0ba9f9fcb4b72adfe9348cc89b3f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:14:36Z,use_quota=True,user_id='e9851aff44c84b328eef6abb7e631932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:14:36 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-862d50e6-5022-42dd-8c7a-2b5ae527f838 tempest-AttachVolumeNegativeTest-1548450425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d560bb5-b420-40ac-b58a-513cfe749ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:14:36 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-862d50e6-5022-42dd-8c7a-2b5ae527f838 tempest-AttachVolumeNegativeTest-1548450425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d560bb5-b420-40ac-b58a-513cfe749ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:14:36 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-862d50e6-5022-42dd-8c7a-2b5ae527f838 tempest-AttachVolumeNegativeTest-1548450425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98e8b6b4-02a5-494b-ba48-3c5b59449676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:14:36 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-862d50e6-5022-42dd-8c7a-2b5ae527f838 tempest-AttachVolumeNegativeTest-1548450425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98e8b6b4-02a5-494b-ba48-3c5b59449676) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '654b7439-8b11-407e-9ad4-e45081c01d76', 'volume_name': 'volume-654b7439-8b11-407e-9ad4-e45081c01d76', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:14:36 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-862d50e6-5022-42dd-8c7a-2b5ae527f838 tempest-AttachVolumeNegativeTest-1548450425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af2e79fd-90d0-4bb4-968c-7a51b016e430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:14:36 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-862d50e6-5022-42dd-8c7a-2b5ae527f838 tempest-AttachVolumeNegativeTest-1548450425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af2e79fd-90d0-4bb4-968c-7a51b016e430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:14:36 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-862d50e6-5022-42dd-8c7a-2b5ae527f838 tempest-AttachVolumeNegativeTest-1548450425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81657df5-a00f-4bd1-ac5d-d66af344dd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:14:36 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-862d50e6-5022-42dd-8c7a-2b5ae527f838 tempest-AttachVolumeNegativeTest-1548450425 None] Volume 654b7439-8b11-407e-9ad4-e45081c01d76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-654b7439-8b11-407e-9ad4-e45081c01d76', 'volume_size': 1} Aug 31 15:14:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-862d50e6-5022-42dd-8c7a-2b5ae527f838 tempest-AttachVolumeNegativeTest-1548450425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:14:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-862d50e6-5022-42dd-8c7a-2b5ae527f838 tempest-AttachVolumeNegativeTest-1548450425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:14:36 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-862d50e6-5022-42dd-8c7a-2b5ae527f838 tempest-AttachVolumeNegativeTest-1548450425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-920826482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=654b7439-8b11-407e-9ad4-e45081c01d76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32c0ba9f9fcb4b72adfe9348cc89b3f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:14:36Z,use_quota=True,user_id='e9851aff44c84b328eef6abb7e631932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:14:36 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-862d50e6-5022-42dd-8c7a-2b5ae527f838 tempest-AttachVolumeNegativeTest-1548450425 None] Creating volume 654b7439-8b11-407e-9ad4-e45081c01d76 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:14:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-862d50e6-5022-42dd-8c7a-2b5ae527f838 tempest-AttachVolumeNegativeTest-1548450425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:14:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-862d50e6-5022-42dd-8c7a-2b5ae527f838 tempest-AttachVolumeNegativeTest-1548450425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:14:36 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-862d50e6-5022-42dd-8c7a-2b5ae527f838 tempest-AttachVolumeNegativeTest-1548450425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:14:36 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-862d50e6-5022-42dd-8c7a-2b5ae527f838 tempest-AttachVolumeNegativeTest-1548450425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:14:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-862d50e6-5022-42dd-8c7a-2b5ae527f838 tempest-AttachVolumeNegativeTest-1548450425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:14:36 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-862d50e6-5022-42dd-8c7a-2b5ae527f838 tempest-AttachVolumeNegativeTest-1548450425 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:14:36 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-862d50e6-5022-42dd-8c7a-2b5ae527f838 tempest-AttachVolumeNegativeTest-1548450425 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:14:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-862d50e6-5022-42dd-8c7a-2b5ae527f838 tempest-AttachVolumeNegativeTest-1548450425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-654b7439-8b11-407e-9ad4-e45081c01d76 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:14:36 devstack sudo[89857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-654b7439-8b11-407e-9ad4-e45081c01d76 1073741824 Aug 31 15:14:36 devstack sudo[89857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:14:37 devstack sudo[89857]: pam_unix(sudo:session): session closed for user root Aug 31 15:14:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-862d50e6-5022-42dd-8c7a-2b5ae527f838 tempest-AttachVolumeNegativeTest-1548450425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-654b7439-8b11-407e-9ad4-e45081c01d76 1073741824" returned: 0 in 0.835s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:14:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-862d50e6-5022-42dd-8c7a-2b5ae527f838 tempest-AttachVolumeNegativeTest-1548450425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-654b7439-8b11-407e-9ad4-e45081c01d76 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:14:37 devstack sudo[89877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-654b7439-8b11-407e-9ad4-e45081c01d76 Aug 31 15:14:37 devstack sudo[89877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:14:37 devstack sudo[89877]: pam_unix(sudo:session): session closed for user root Aug 31 15:14:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-862d50e6-5022-42dd-8c7a-2b5ae527f838 tempest-AttachVolumeNegativeTest-1548450425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-654b7439-8b11-407e-9ad4-e45081c01d76" returned: 0 in 0.342s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:14:37 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-862d50e6-5022-42dd-8c7a-2b5ae527f838 tempest-AttachVolumeNegativeTest-1548450425 None] <== create_volume: return (1347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:14:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-862d50e6-5022-42dd-8c7a-2b5ae527f838 tempest-AttachVolumeNegativeTest-1548450425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.353s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:14:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-862d50e6-5022-42dd-8c7a-2b5ae527f838 tempest-AttachVolumeNegativeTest-1548450425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81657df5-a00f-4bd1-ac5d-d66af344dd4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-654b7439-8b11-407e-9ad4-e45081c01d76', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:14:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-862d50e6-5022-42dd-8c7a-2b5ae527f838 tempest-AttachVolumeNegativeTest-1548450425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (739ad353-5107-4074-b798-6238b0607305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:14:37 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-862d50e6-5022-42dd-8c7a-2b5ae527f838 tempest-AttachVolumeNegativeTest-1548450425 None] Volume volume-654b7439-8b11-407e-9ad4-e45081c01d76 (654b7439-8b11-407e-9ad4-e45081c01d76): created successfully Aug 31 15:14:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-862d50e6-5022-42dd-8c7a-2b5ae527f838 tempest-AttachVolumeNegativeTest-1548450425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (739ad353-5107-4074-b798-6238b0607305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:14:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-862d50e6-5022-42dd-8c7a-2b5ae527f838 tempest-AttachVolumeNegativeTest-1548450425 None] Flow 'volume_create_manager' (d1ade20f-119e-4826-b1b5-ea528a1efaa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:14:37 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-862d50e6-5022-42dd-8c7a-2b5ae527f838 tempest-AttachVolumeNegativeTest-1548450425 None] Created volume successfully. Aug 31 15:14:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-f0001a68-5250-4419-bc52-247f4d19f52d req-77eb40d1-1311-49a0-ac21-7f83715f93d1 tempest-AttachVolumeNegativeTest-1548450425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:14:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-f0001a68-5250-4419-bc52-247f4d19f52d req-77eb40d1-1311-49a0-ac21-7f83715f93d1 tempest-AttachVolumeNegativeTest-1548450425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:14:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-f0001a68-5250-4419-bc52-247f4d19f52d req-77eb40d1-1311-49a0-ac21-7f83715f93d1 tempest-AttachVolumeNegativeTest-1548450425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:14:40 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-f0001a68-5250-4419-bc52-247f4d19f52d req-77eb40d1-1311-49a0-ac21-7f83715f93d1 tempest-AttachVolumeNegativeTest-1548450425 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77', 'name': 'volume-654b7439-8b11-407e-9ad4-e45081c01d76', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '186b11c1-bacf-4dce-97d0-7b5c89c5c8d1', 'enforce_multipath': True} {{(pid=86000) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 31 15:14:40 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-f0001a68-5250-4419-bc52-247f4d19f52d req-77eb40d1-1311-49a0-ac21-7f83715f93d1 tempest-AttachVolumeNegativeTest-1548450425 None] attachment_update completed successfully. Aug 31 15:14:45 devstack cinder-volume[86000]: DEBUG oslo_service.periodic_task [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86000) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:14:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:14:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:14:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:14:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:14:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:14:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:14:45 devstack sudo[90053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:14:45 devstack sudo[90053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:14:45 devstack sudo[90053]: pam_unix(sudo:session): session closed for user root Aug 31 15:14:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.444s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:14:45 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:14:50 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:SELECT=8,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:14:50 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:SELECT=9,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:14:51 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-a0958d17-292f-4486-bc0e-910f068a8155 req-7c7d5413-2874-48b7-a999-36a617d625d6 tempest-AttachVolumeTestJSON-1224274971 None] Terminate volume connection completed successfully. Aug 31 15:14:51 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-a0958d17-292f-4486-bc0e-910f068a8155 req-7c7d5413-2874-48b7-a999-36a617d625d6 tempest-AttachVolumeTestJSON-1224274971 None] Deleting attachment c8004350-5ad2-439e-bab5-0fb7610f9e83. {{(pid=86000) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 31 15:14:57 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dd255ce-6f85-43f1-8b69-d361117c82cf tempest-ServerRescueNegativeTestJSON-496579112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:14:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1dd255ce-6f85-43f1-8b69-d361117c82cf tempest-ServerRescueNegativeTestJSON-496579112 None] Flow 'volume_create_manager' (d5ae478d-638e-452b-9cdf-1fd21a711a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:14:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1dd255ce-6f85-43f1-8b69-d361117c82cf tempest-ServerRescueNegativeTestJSON-496579112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (861b41e7-3884-49b3-9b43-0b5e6e20c813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:14:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1dd255ce-6f85-43f1-8b69-d361117c82cf tempest-ServerRescueNegativeTestJSON-496579112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (861b41e7-3884-49b3-9b43-0b5e6e20c813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1168814394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa501681-063b-4c87-9e78-08fb39dee4c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f5393d1748b4834b2045686f44ca41d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:14:57Z,use_quota=True,user_id='2d7f6a4896b243adb60eb6ee8506b57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:14:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1dd255ce-6f85-43f1-8b69-d361117c82cf tempest-ServerRescueNegativeTestJSON-496579112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32661132-28cc-46e5-b1d6-f8430cec1304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:14:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1dd255ce-6f85-43f1-8b69-d361117c82cf tempest-ServerRescueNegativeTestJSON-496579112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32661132-28cc-46e5-b1d6-f8430cec1304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:14:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1dd255ce-6f85-43f1-8b69-d361117c82cf tempest-ServerRescueNegativeTestJSON-496579112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5ae3511-7fad-4b93-990b-4e4e7a8697ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:14:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1dd255ce-6f85-43f1-8b69-d361117c82cf tempest-ServerRescueNegativeTestJSON-496579112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5ae3511-7fad-4b93-990b-4e4e7a8697ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa501681-063b-4c87-9e78-08fb39dee4c9', 'volume_name': 'volume-fa501681-063b-4c87-9e78-08fb39dee4c9', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:14:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1dd255ce-6f85-43f1-8b69-d361117c82cf tempest-ServerRescueNegativeTestJSON-496579112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83340bdb-c587-4e00-8dfc-d0f3ca94b556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:14:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1dd255ce-6f85-43f1-8b69-d361117c82cf tempest-ServerRescueNegativeTestJSON-496579112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83340bdb-c587-4e00-8dfc-d0f3ca94b556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:14:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1dd255ce-6f85-43f1-8b69-d361117c82cf tempest-ServerRescueNegativeTestJSON-496579112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57ef2a1c-34fb-4d7a-b64f-7a5ff1c9fb31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:14:57 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-1dd255ce-6f85-43f1-8b69-d361117c82cf tempest-ServerRescueNegativeTestJSON-496579112 None] Volume fa501681-063b-4c87-9e78-08fb39dee4c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa501681-063b-4c87-9e78-08fb39dee4c9', 'volume_size': 1} Aug 31 15:14:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1dd255ce-6f85-43f1-8b69-d361117c82cf tempest-ServerRescueNegativeTestJSON-496579112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:14:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1dd255ce-6f85-43f1-8b69-d361117c82cf tempest-ServerRescueNegativeTestJSON-496579112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:14:57 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1dd255ce-6f85-43f1-8b69-d361117c82cf tempest-ServerRescueNegativeTestJSON-496579112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1168814394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa501681-063b-4c87-9e78-08fb39dee4c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f5393d1748b4834b2045686f44ca41d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:14:57Z,use_quota=True,user_id='2d7f6a4896b243adb60eb6ee8506b57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:14:57 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-1dd255ce-6f85-43f1-8b69-d361117c82cf tempest-ServerRescueNegativeTestJSON-496579112 None] Creating volume fa501681-063b-4c87-9e78-08fb39dee4c9 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:14:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1dd255ce-6f85-43f1-8b69-d361117c82cf tempest-ServerRescueNegativeTestJSON-496579112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:14:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1dd255ce-6f85-43f1-8b69-d361117c82cf tempest-ServerRescueNegativeTestJSON-496579112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:14:57 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1dd255ce-6f85-43f1-8b69-d361117c82cf tempest-ServerRescueNegativeTestJSON-496579112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:14:57 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1dd255ce-6f85-43f1-8b69-d361117c82cf tempest-ServerRescueNegativeTestJSON-496579112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:14:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1dd255ce-6f85-43f1-8b69-d361117c82cf tempest-ServerRescueNegativeTestJSON-496579112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:14:57 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1dd255ce-6f85-43f1-8b69-d361117c82cf tempest-ServerRescueNegativeTestJSON-496579112 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:14:57 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-1dd255ce-6f85-43f1-8b69-d361117c82cf tempest-ServerRescueNegativeTestJSON-496579112 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:14:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1dd255ce-6f85-43f1-8b69-d361117c82cf tempest-ServerRescueNegativeTestJSON-496579112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-fa501681-063b-4c87-9e78-08fb39dee4c9 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:14:57 devstack sudo[90159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-fa501681-063b-4c87-9e78-08fb39dee4c9 1073741824 Aug 31 15:14:57 devstack sudo[90159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:14:58 devstack sudo[90159]: pam_unix(sudo:session): session closed for user root Aug 31 15:14:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1dd255ce-6f85-43f1-8b69-d361117c82cf tempest-ServerRescueNegativeTestJSON-496579112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-fa501681-063b-4c87-9e78-08fb39dee4c9 1073741824" returned: 0 in 1.045s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:14:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1dd255ce-6f85-43f1-8b69-d361117c82cf tempest-ServerRescueNegativeTestJSON-496579112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-fa501681-063b-4c87-9e78-08fb39dee4c9 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:14:58 devstack sudo[90166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-fa501681-063b-4c87-9e78-08fb39dee4c9 Aug 31 15:14:58 devstack sudo[90166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:14:59 devstack sudo[90166]: pam_unix(sudo:session): session closed for user root Aug 31 15:14:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1dd255ce-6f85-43f1-8b69-d361117c82cf tempest-ServerRescueNegativeTestJSON-496579112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-fa501681-063b-4c87-9e78-08fb39dee4c9" returned: 0 in 0.726s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:14:59 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1dd255ce-6f85-43f1-8b69-d361117c82cf tempest-ServerRescueNegativeTestJSON-496579112 None] <== create_volume: return (1849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:14:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1dd255ce-6f85-43f1-8b69-d361117c82cf tempest-ServerRescueNegativeTestJSON-496579112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.852s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:14:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1dd255ce-6f85-43f1-8b69-d361117c82cf tempest-ServerRescueNegativeTestJSON-496579112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57ef2a1c-34fb-4d7a-b64f-7a5ff1c9fb31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa501681-063b-4c87-9e78-08fb39dee4c9', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:14:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1dd255ce-6f85-43f1-8b69-d361117c82cf tempest-ServerRescueNegativeTestJSON-496579112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7df2218-5799-442e-9c5d-a339cae4ee21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:14:59 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-1dd255ce-6f85-43f1-8b69-d361117c82cf tempest-ServerRescueNegativeTestJSON-496579112 None] Volume volume-fa501681-063b-4c87-9e78-08fb39dee4c9 (fa501681-063b-4c87-9e78-08fb39dee4c9): created successfully Aug 31 15:14:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1dd255ce-6f85-43f1-8b69-d361117c82cf tempest-ServerRescueNegativeTestJSON-496579112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7df2218-5799-442e-9c5d-a339cae4ee21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:14:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1dd255ce-6f85-43f1-8b69-d361117c82cf tempest-ServerRescueNegativeTestJSON-496579112 None] Flow 'volume_create_manager' (d5ae478d-638e-452b-9cdf-1fd21a711a38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:14:59 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-1dd255ce-6f85-43f1-8b69-d361117c82cf tempest-ServerRescueNegativeTestJSON-496579112 None] Created volume successfully. Aug 31 15:15:09 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:15:09 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:15:18 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-2d0cd718-e4dc-4981-8826-0a9e2a4084fc tempest-ServerRescueNegativeTestJSON-496579112 None] Acquiring lock "cinder-fa501681-063b-4c87-9e78-08fb39dee4c9-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:15:18 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-2d0cd718-e4dc-4981-8826-0a9e2a4084fc tempest-ServerRescueNegativeTestJSON-496579112 None] Lock "cinder-fa501681-063b-4c87-9e78-08fb39dee4c9-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:15:18 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-2d0cd718-e4dc-4981-8826-0a9e2a4084fc tempest-ServerRescueNegativeTestJSON-496579112 None] Acquiring lock "cinder-quobyte-fa501681-063b-4c87-9e78-08fb39dee4c9" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:15:18 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-2d0cd718-e4dc-4981-8826-0a9e2a4084fc tempest-ServerRescueNegativeTestJSON-496579112 None] Lock "cinder-quobyte-fa501681-063b-4c87-9e78-08fb39dee4c9" acquired by "delete_volume" :: waited 0.073s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:15:18 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2301b77b-495e-4919-8db2-d964b54c2b1a]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:15:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2d0cd718-e4dc-4981-8826-0a9e2a4084fc tempest-ServerRescueNegativeTestJSON-496579112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-fa501681-063b-4c87-9e78-08fb39dee4c9 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:15:19 devstack sudo[90487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-fa501681-063b-4c87-9e78-08fb39dee4c9 Aug 31 15:15:19 devstack sudo[90487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:15:20 devstack sudo[90487]: pam_unix(sudo:session): session closed for user root Aug 31 15:15:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2d0cd718-e4dc-4981-8826-0a9e2a4084fc tempest-ServerRescueNegativeTestJSON-496579112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-fa501681-063b-4c87-9e78-08fb39dee4c9" returned: 0 in 1.648s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:15:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2d0cd718-e4dc-4981-8826-0a9e2a4084fc tempest-ServerRescueNegativeTestJSON-496579112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-fa501681-063b-4c87-9e78-08fb39dee4c9 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:15:20 devstack sudo[90507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-fa501681-063b-4c87-9e78-08fb39dee4c9 Aug 31 15:15:20 devstack sudo[90507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:15:21 devstack sudo[90507]: pam_unix(sudo:session): session closed for user root Aug 31 15:15:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2d0cd718-e4dc-4981-8826-0a9e2a4084fc tempest-ServerRescueNegativeTestJSON-496579112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-fa501681-063b-4c87-9e78-08fb39dee4c9" returned: 0 in 0.936s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:15:21 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-2d0cd718-e4dc-4981-8826-0a9e2a4084fc tempest-ServerRescueNegativeTestJSON-496579112 None] Lock "cinder-quobyte-fa501681-063b-4c87-9e78-08fb39dee4c9" released by "delete_volume" :: held 2.750s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:15:21 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-2d0cd718-e4dc-4981-8826-0a9e2a4084fc tempest-ServerRescueNegativeTestJSON-496579112 None] Created reservations ['6ab59f29-9839-4e67-b630-720f2845c3f8', '3f8a8d20-ae3c-4ff0-b647-1495f34a631e', '4286369a-6544-409b-8c6e-87d540ba0af2', 'd3d79c9f-76da-4a1b-bf40-d4a43ee1cbb7'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:15:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-2d0cd718-e4dc-4981-8826-0a9e2a4084fc tempest-ServerRescueNegativeTestJSON-496579112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:15:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-2d0cd718-e4dc-4981-8826-0a9e2a4084fc tempest-ServerRescueNegativeTestJSON-496579112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:15:21 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-2d0cd718-e4dc-4981-8826-0a9e2a4084fc tempest-ServerRescueNegativeTestJSON-496579112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:15:21 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-2d0cd718-e4dc-4981-8826-0a9e2a4084fc tempest-ServerRescueNegativeTestJSON-496579112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:15:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-2d0cd718-e4dc-4981-8826-0a9e2a4084fc tempest-ServerRescueNegativeTestJSON-496579112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:15:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2d0cd718-e4dc-4981-8826-0a9e2a4084fc tempest-ServerRescueNegativeTestJSON-496579112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:15:21 devstack sudo[90512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:15:21 devstack sudo[90512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:15:22 devstack sudo[90512]: pam_unix(sudo:session): session closed for user root Aug 31 15:15:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2d0cd718-e4dc-4981-8826-0a9e2a4084fc tempest-ServerRescueNegativeTestJSON-496579112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.558s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:15:22 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-2d0cd718-e4dc-4981-8826-0a9e2a4084fc tempest-ServerRescueNegativeTestJSON-496579112 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:15:22 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-2d0cd718-e4dc-4981-8826-0a9e2a4084fc tempest-ServerRescueNegativeTestJSON-496579112 None] Deleted volume successfully. Aug 31 15:15:22 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-2d0cd718-e4dc-4981-8826-0a9e2a4084fc tempest-ServerRescueNegativeTestJSON-496579112 None] Lock "cinder-fa501681-063b-4c87-9e78-08fb39dee4c9-delete_volume" released by "delete_volume" :: held 3.962s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:15:31 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:UPDATE=10,cinder:SELECT=6 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:15:32 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:SELECT=5,cinder:UPDATE=7,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:15:45 devstack cinder-volume[86000]: DEBUG oslo_service.periodic_task [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86000) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:15:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:15:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:15:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:15:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:15:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:15:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:15:45 devstack sudo[90755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:15:45 devstack sudo[90755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:15:45 devstack sudo[90755]: pam_unix(sudo:session): session closed for user root Aug 31 15:15:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.553s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:15:45 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:15:45 devstack cinder-volume[86000]: DEBUG oslo_service.periodic_task [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running periodic task VolumeManager._thread_info {{(pid=86000) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:15:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] thread count: 8 {{(pid=86000) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 31 15:15:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] thread info: [<_MainThread(MainThread, started 137631281086592)>, , , , , , , ] {{(pid=86000) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 31 15:15:55 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-6ea39a85-68bd-4e52-8675-1904c3f86705 req-b4537966-fac8-40fb-99fb-dccc258fa8ce tempest-AttachVolumeNegativeTest-1548450425 None] Terminate volume connection completed successfully. Aug 31 15:15:55 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-6ea39a85-68bd-4e52-8675-1904c3f86705 req-b4537966-fac8-40fb-99fb-dccc258fa8ce tempest-AttachVolumeNegativeTest-1548450425 None] Deleting attachment 186b11c1-bacf-4dce-97d0-7b5c89c5c8d1. {{(pid=86000) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 31 15:16:00 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-40ab132d-4e0b-48b3-bcea-5ff1aca4b83e tempest-ServerActionsTestOtherA-1383095791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:16:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-40ab132d-4e0b-48b3-bcea-5ff1aca4b83e tempest-ServerActionsTestOtherA-1383095791 None] Flow 'volume_create_manager' (c4b8f08e-e974-4110-a0b6-3e4858046724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:16:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-40ab132d-4e0b-48b3-bcea-5ff1aca4b83e tempest-ServerActionsTestOtherA-1383095791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c79425d2-e4fa-426e-a88d-ed7101254a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:16:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-40ab132d-4e0b-48b3-bcea-5ff1aca4b83e tempest-ServerActionsTestOtherA-1383095791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c79425d2-e4fa-426e-a88d-ed7101254a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-580045954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d108717-f218-4bc2-b7ad-28b3f585c248,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d51adb80a5c745e2b42f7a484d7120a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:16:01Z,use_quota=True,user_id='0e451b482e4e4febae00cdbf8361fcaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:16:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-40ab132d-4e0b-48b3-bcea-5ff1aca4b83e tempest-ServerActionsTestOtherA-1383095791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (193008d0-db09-432e-85fb-629a4603b93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:16:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-40ab132d-4e0b-48b3-bcea-5ff1aca4b83e tempest-ServerActionsTestOtherA-1383095791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (193008d0-db09-432e-85fb-629a4603b93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:16:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-40ab132d-4e0b-48b3-bcea-5ff1aca4b83e tempest-ServerActionsTestOtherA-1383095791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff0de1b5-7535-44c4-a14e-1ad64b4e986c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:16:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-40ab132d-4e0b-48b3-bcea-5ff1aca4b83e tempest-ServerActionsTestOtherA-1383095791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff0de1b5-7535-44c4-a14e-1ad64b4e986c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d108717-f218-4bc2-b7ad-28b3f585c248', 'volume_name': 'volume-7d108717-f218-4bc2-b7ad-28b3f585c248', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:16:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-40ab132d-4e0b-48b3-bcea-5ff1aca4b83e tempest-ServerActionsTestOtherA-1383095791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cfb24b1-d96e-4df7-8c0d-2187a52e0273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:16:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-40ab132d-4e0b-48b3-bcea-5ff1aca4b83e tempest-ServerActionsTestOtherA-1383095791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cfb24b1-d96e-4df7-8c0d-2187a52e0273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:16:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-40ab132d-4e0b-48b3-bcea-5ff1aca4b83e tempest-ServerActionsTestOtherA-1383095791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60cb0fb2-ffbd-4f9d-b89a-e93685382f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:16:00 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-40ab132d-4e0b-48b3-bcea-5ff1aca4b83e tempest-ServerActionsTestOtherA-1383095791 None] Volume 7d108717-f218-4bc2-b7ad-28b3f585c248: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d108717-f218-4bc2-b7ad-28b3f585c248', 'volume_size': 1} Aug 31 15:16:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-40ab132d-4e0b-48b3-bcea-5ff1aca4b83e tempest-ServerActionsTestOtherA-1383095791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:16:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-40ab132d-4e0b-48b3-bcea-5ff1aca4b83e tempest-ServerActionsTestOtherA-1383095791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:16:00 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-40ab132d-4e0b-48b3-bcea-5ff1aca4b83e tempest-ServerActionsTestOtherA-1383095791 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-580045954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d108717-f218-4bc2-b7ad-28b3f585c248,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d51adb80a5c745e2b42f7a484d7120a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:16:01Z,use_quota=True,user_id='0e451b482e4e4febae00cdbf8361fcaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:16:00 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-40ab132d-4e0b-48b3-bcea-5ff1aca4b83e tempest-ServerActionsTestOtherA-1383095791 None] Creating volume 7d108717-f218-4bc2-b7ad-28b3f585c248 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:16:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-40ab132d-4e0b-48b3-bcea-5ff1aca4b83e tempest-ServerActionsTestOtherA-1383095791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:16:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-40ab132d-4e0b-48b3-bcea-5ff1aca4b83e tempest-ServerActionsTestOtherA-1383095791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:16:00 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-40ab132d-4e0b-48b3-bcea-5ff1aca4b83e tempest-ServerActionsTestOtherA-1383095791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:16:00 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-40ab132d-4e0b-48b3-bcea-5ff1aca4b83e tempest-ServerActionsTestOtherA-1383095791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:16:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-40ab132d-4e0b-48b3-bcea-5ff1aca4b83e tempest-ServerActionsTestOtherA-1383095791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.056s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:16:00 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-40ab132d-4e0b-48b3-bcea-5ff1aca4b83e tempest-ServerActionsTestOtherA-1383095791 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:16:00 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-40ab132d-4e0b-48b3-bcea-5ff1aca4b83e tempest-ServerActionsTestOtherA-1383095791 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:16:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-40ab132d-4e0b-48b3-bcea-5ff1aca4b83e tempest-ServerActionsTestOtherA-1383095791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7d108717-f218-4bc2-b7ad-28b3f585c248 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:16:01 devstack sudo[90892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7d108717-f218-4bc2-b7ad-28b3f585c248 1073741824 Aug 31 15:16:01 devstack sudo[90892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:16:02 devstack sudo[90892]: pam_unix(sudo:session): session closed for user root Aug 31 15:16:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-40ab132d-4e0b-48b3-bcea-5ff1aca4b83e tempest-ServerActionsTestOtherA-1383095791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7d108717-f218-4bc2-b7ad-28b3f585c248 1073741824" returned: 0 in 1.053s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:16:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-40ab132d-4e0b-48b3-bcea-5ff1aca4b83e tempest-ServerActionsTestOtherA-1383095791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7d108717-f218-4bc2-b7ad-28b3f585c248 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:16:02 devstack sudo[90957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7d108717-f218-4bc2-b7ad-28b3f585c248 Aug 31 15:16:02 devstack sudo[90957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:16:02 devstack sudo[90957]: pam_unix(sudo:session): session closed for user root Aug 31 15:16:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-40ab132d-4e0b-48b3-bcea-5ff1aca4b83e tempest-ServerActionsTestOtherA-1383095791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7d108717-f218-4bc2-b7ad-28b3f585c248" returned: 0 in 0.389s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:16:02 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-40ab132d-4e0b-48b3-bcea-5ff1aca4b83e tempest-ServerActionsTestOtherA-1383095791 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:16:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-40ab132d-4e0b-48b3-bcea-5ff1aca4b83e tempest-ServerActionsTestOtherA-1383095791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:16:02 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-40ab132d-4e0b-48b3-bcea-5ff1aca4b83e tempest-ServerActionsTestOtherA-1383095791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60cb0fb2-ffbd-4f9d-b89a-e93685382f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d108717-f218-4bc2-b7ad-28b3f585c248', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:16:02 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-40ab132d-4e0b-48b3-bcea-5ff1aca4b83e tempest-ServerActionsTestOtherA-1383095791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4957abb0-846d-484f-8e46-2222e2723c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:16:02 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-40ab132d-4e0b-48b3-bcea-5ff1aca4b83e tempest-ServerActionsTestOtherA-1383095791 None] Volume volume-7d108717-f218-4bc2-b7ad-28b3f585c248 (7d108717-f218-4bc2-b7ad-28b3f585c248): created successfully Aug 31 15:16:02 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-40ab132d-4e0b-48b3-bcea-5ff1aca4b83e tempest-ServerActionsTestOtherA-1383095791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4957abb0-846d-484f-8e46-2222e2723c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:16:02 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-40ab132d-4e0b-48b3-bcea-5ff1aca4b83e tempest-ServerActionsTestOtherA-1383095791 None] Flow 'volume_create_manager' (c4b8f08e-e974-4110-a0b6-3e4858046724) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:16:02 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-40ab132d-4e0b-48b3-bcea-5ff1aca4b83e tempest-ServerActionsTestOtherA-1383095791 None] Created volume successfully. Aug 31 15:16:12 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:16:12 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:16:28 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca975d22-781a-4589-8464-0c564f13da43 tempest-AttachVolumeTestJSON-1224274971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:16:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ca975d22-781a-4589-8464-0c564f13da43 tempest-AttachVolumeTestJSON-1224274971 None] Flow 'volume_create_manager' (d8df3d44-c303-46e0-8723-b86259634e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:16:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ca975d22-781a-4589-8464-0c564f13da43 tempest-AttachVolumeTestJSON-1224274971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b296a52-6e6e-42ed-9a70-4231df568ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:16:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ca975d22-781a-4589-8464-0c564f13da43 tempest-AttachVolumeTestJSON-1224274971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b296a52-6e6e-42ed-9a70-4231df568ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-506722473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94200774-b88b-4081-bf1a-76eae1bee759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94d1b489a6fc4b8d90323c4d2759774f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:16:29Z,use_quota=True,user_id='e37742c6023b41c89297120e921e6d25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:16:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ca975d22-781a-4589-8464-0c564f13da43 tempest-AttachVolumeTestJSON-1224274971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81184753-a74d-4e7e-afb8-572a2e7b5838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:16:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ca975d22-781a-4589-8464-0c564f13da43 tempest-AttachVolumeTestJSON-1224274971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81184753-a74d-4e7e-afb8-572a2e7b5838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:16:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ca975d22-781a-4589-8464-0c564f13da43 tempest-AttachVolumeTestJSON-1224274971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd730220-30f3-432d-b8ba-4fef3f63e05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:16:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ca975d22-781a-4589-8464-0c564f13da43 tempest-AttachVolumeTestJSON-1224274971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd730220-30f3-432d-b8ba-4fef3f63e05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94200774-b88b-4081-bf1a-76eae1bee759', 'volume_name': 'volume-94200774-b88b-4081-bf1a-76eae1bee759', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:16:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ca975d22-781a-4589-8464-0c564f13da43 tempest-AttachVolumeTestJSON-1224274971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5af1875e-6631-4454-9908-f72024687fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:16:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ca975d22-781a-4589-8464-0c564f13da43 tempest-AttachVolumeTestJSON-1224274971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5af1875e-6631-4454-9908-f72024687fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:16:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ca975d22-781a-4589-8464-0c564f13da43 tempest-AttachVolumeTestJSON-1224274971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e558d186-43e3-416d-bad2-1bd84364340f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:16:29 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-ca975d22-781a-4589-8464-0c564f13da43 tempest-AttachVolumeTestJSON-1224274971 None] Volume 94200774-b88b-4081-bf1a-76eae1bee759: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94200774-b88b-4081-bf1a-76eae1bee759', 'volume_size': 1} Aug 31 15:16:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ca975d22-781a-4589-8464-0c564f13da43 tempest-AttachVolumeTestJSON-1224274971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:16:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ca975d22-781a-4589-8464-0c564f13da43 tempest-AttachVolumeTestJSON-1224274971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:16:29 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-ca975d22-781a-4589-8464-0c564f13da43 tempest-AttachVolumeTestJSON-1224274971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-506722473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94200774-b88b-4081-bf1a-76eae1bee759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94d1b489a6fc4b8d90323c4d2759774f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:16:29Z,use_quota=True,user_id='e37742c6023b41c89297120e921e6d25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:16:29 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-ca975d22-781a-4589-8464-0c564f13da43 tempest-AttachVolumeTestJSON-1224274971 None] Creating volume 94200774-b88b-4081-bf1a-76eae1bee759 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:16:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ca975d22-781a-4589-8464-0c564f13da43 tempest-AttachVolumeTestJSON-1224274971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:16:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ca975d22-781a-4589-8464-0c564f13da43 tempest-AttachVolumeTestJSON-1224274971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:16:29 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-ca975d22-781a-4589-8464-0c564f13da43 tempest-AttachVolumeTestJSON-1224274971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:16:29 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-ca975d22-781a-4589-8464-0c564f13da43 tempest-AttachVolumeTestJSON-1224274971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:16:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ca975d22-781a-4589-8464-0c564f13da43 tempest-AttachVolumeTestJSON-1224274971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:16:29 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-ca975d22-781a-4589-8464-0c564f13da43 tempest-AttachVolumeTestJSON-1224274971 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:16:29 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-ca975d22-781a-4589-8464-0c564f13da43 tempest-AttachVolumeTestJSON-1224274971 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:16:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ca975d22-781a-4589-8464-0c564f13da43 tempest-AttachVolumeTestJSON-1224274971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-94200774-b88b-4081-bf1a-76eae1bee759 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:16:29 devstack sudo[91314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-94200774-b88b-4081-bf1a-76eae1bee759 1073741824 Aug 31 15:16:29 devstack sudo[91314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:16:29 devstack sudo[91314]: pam_unix(sudo:session): session closed for user root Aug 31 15:16:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ca975d22-781a-4589-8464-0c564f13da43 tempest-AttachVolumeTestJSON-1224274971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-94200774-b88b-4081-bf1a-76eae1bee759 1073741824" returned: 0 in 0.400s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:16:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ca975d22-781a-4589-8464-0c564f13da43 tempest-AttachVolumeTestJSON-1224274971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-94200774-b88b-4081-bf1a-76eae1bee759 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:16:29 devstack sudo[91320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-94200774-b88b-4081-bf1a-76eae1bee759 Aug 31 15:16:29 devstack sudo[91320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:16:29 devstack sudo[91320]: pam_unix(sudo:session): session closed for user root Aug 31 15:16:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ca975d22-781a-4589-8464-0c564f13da43 tempest-AttachVolumeTestJSON-1224274971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-94200774-b88b-4081-bf1a-76eae1bee759" returned: 0 in 0.229s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:16:29 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-ca975d22-781a-4589-8464-0c564f13da43 tempest-AttachVolumeTestJSON-1224274971 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:16:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ca975d22-781a-4589-8464-0c564f13da43 tempest-AttachVolumeTestJSON-1224274971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:16:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ca975d22-781a-4589-8464-0c564f13da43 tempest-AttachVolumeTestJSON-1224274971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e558d186-43e3-416d-bad2-1bd84364340f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94200774-b88b-4081-bf1a-76eae1bee759', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:16:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ca975d22-781a-4589-8464-0c564f13da43 tempest-AttachVolumeTestJSON-1224274971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d307079d-d090-4b3d-a779-31122f727253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:16:29 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-ca975d22-781a-4589-8464-0c564f13da43 tempest-AttachVolumeTestJSON-1224274971 None] Volume volume-94200774-b88b-4081-bf1a-76eae1bee759 (94200774-b88b-4081-bf1a-76eae1bee759): created successfully Aug 31 15:16:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ca975d22-781a-4589-8464-0c564f13da43 tempest-AttachVolumeTestJSON-1224274971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d307079d-d090-4b3d-a779-31122f727253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:16:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ca975d22-781a-4589-8464-0c564f13da43 tempest-AttachVolumeTestJSON-1224274971 None] Flow 'volume_create_manager' (d8df3d44-c303-46e0-8723-b86259634e38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:16:29 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-ca975d22-781a-4589-8464-0c564f13da43 tempest-AttachVolumeTestJSON-1224274971 None] Created volume successfully. Aug 31 15:16:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-a9a7c482-c4ac-48a1-9da1-b020df3dda03 req-ab25a6d6-4387-4696-a77d-ce1389d3d582 tempest-AttachVolumeTestJSON-1224274971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:16:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-a9a7c482-c4ac-48a1-9da1-b020df3dda03 req-ab25a6d6-4387-4696-a77d-ce1389d3d582 tempest-AttachVolumeTestJSON-1224274971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:16:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-a9a7c482-c4ac-48a1-9da1-b020df3dda03 req-ab25a6d6-4387-4696-a77d-ce1389d3d582 tempest-AttachVolumeTestJSON-1224274971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:16:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-a9a7c482-c4ac-48a1-9da1-b020df3dda03 req-ab25a6d6-4387-4696-a77d-ce1389d3d582 tempest-AttachVolumeTestJSON-1224274971 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77', 'name': 'volume-94200774-b88b-4081-bf1a-76eae1bee759', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fbe5b2cb-01e8-4c1b-a69e-8779a086b8c4', 'enforce_multipath': True} {{(pid=86000) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 31 15:16:30 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-a9a7c482-c4ac-48a1-9da1-b020df3dda03 req-ab25a6d6-4387-4696-a77d-ce1389d3d582 tempest-AttachVolumeTestJSON-1224274971 None] attachment_update completed successfully. Aug 31 15:16:33 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bfb886d-3898-42f6-a241-673053624076 tempest-AttachVolumeTestJSON-1224274971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:16:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7bfb886d-3898-42f6-a241-673053624076 tempest-AttachVolumeTestJSON-1224274971 None] Flow 'volume_create_manager' (bf9b5c85-45f2-45e8-8ca8-021b935f99f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:16:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7bfb886d-3898-42f6-a241-673053624076 tempest-AttachVolumeTestJSON-1224274971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b241396f-570c-42b3-a85c-f21327e3d6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:16:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7bfb886d-3898-42f6-a241-673053624076 tempest-AttachVolumeTestJSON-1224274971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b241396f-570c-42b3-a85c-f21327e3d6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1400639399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9cbc71c-d2f8-4a51-8789-d2ccaa207051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94d1b489a6fc4b8d90323c4d2759774f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:16:34Z,use_quota=True,user_id='e37742c6023b41c89297120e921e6d25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:16:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7bfb886d-3898-42f6-a241-673053624076 tempest-AttachVolumeTestJSON-1224274971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fed446a2-9444-4395-83cd-c0db24d619f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:16:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7bfb886d-3898-42f6-a241-673053624076 tempest-AttachVolumeTestJSON-1224274971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fed446a2-9444-4395-83cd-c0db24d619f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:16:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7bfb886d-3898-42f6-a241-673053624076 tempest-AttachVolumeTestJSON-1224274971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cff6f806-3028-4941-8b74-12081f218235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:16:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7bfb886d-3898-42f6-a241-673053624076 tempest-AttachVolumeTestJSON-1224274971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cff6f806-3028-4941-8b74-12081f218235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9cbc71c-d2f8-4a51-8789-d2ccaa207051', 'volume_name': 'volume-d9cbc71c-d2f8-4a51-8789-d2ccaa207051', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:16:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7bfb886d-3898-42f6-a241-673053624076 tempest-AttachVolumeTestJSON-1224274971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f0a4793-90f1-4e15-a384-17a5cb8eaa3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:16:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7bfb886d-3898-42f6-a241-673053624076 tempest-AttachVolumeTestJSON-1224274971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f0a4793-90f1-4e15-a384-17a5cb8eaa3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:16:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7bfb886d-3898-42f6-a241-673053624076 tempest-AttachVolumeTestJSON-1224274971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (229943e6-3054-4836-a144-5648aaf1ef47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:16:33 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-7bfb886d-3898-42f6-a241-673053624076 tempest-AttachVolumeTestJSON-1224274971 None] Volume d9cbc71c-d2f8-4a51-8789-d2ccaa207051: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9cbc71c-d2f8-4a51-8789-d2ccaa207051', 'volume_size': 1} Aug 31 15:16:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7bfb886d-3898-42f6-a241-673053624076 tempest-AttachVolumeTestJSON-1224274971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:16:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7bfb886d-3898-42f6-a241-673053624076 tempest-AttachVolumeTestJSON-1224274971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:16:33 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-7bfb886d-3898-42f6-a241-673053624076 tempest-AttachVolumeTestJSON-1224274971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1400639399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9cbc71c-d2f8-4a51-8789-d2ccaa207051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94d1b489a6fc4b8d90323c4d2759774f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:16:34Z,use_quota=True,user_id='e37742c6023b41c89297120e921e6d25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:16:33 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-7bfb886d-3898-42f6-a241-673053624076 tempest-AttachVolumeTestJSON-1224274971 None] Creating volume d9cbc71c-d2f8-4a51-8789-d2ccaa207051 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:16:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7bfb886d-3898-42f6-a241-673053624076 tempest-AttachVolumeTestJSON-1224274971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:16:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7bfb886d-3898-42f6-a241-673053624076 tempest-AttachVolumeTestJSON-1224274971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:16:33 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-7bfb886d-3898-42f6-a241-673053624076 tempest-AttachVolumeTestJSON-1224274971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:16:33 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-7bfb886d-3898-42f6-a241-673053624076 tempest-AttachVolumeTestJSON-1224274971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:16:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7bfb886d-3898-42f6-a241-673053624076 tempest-AttachVolumeTestJSON-1224274971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:16:33 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-7bfb886d-3898-42f6-a241-673053624076 tempest-AttachVolumeTestJSON-1224274971 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:16:33 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-7bfb886d-3898-42f6-a241-673053624076 tempest-AttachVolumeTestJSON-1224274971 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:16:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7bfb886d-3898-42f6-a241-673053624076 tempest-AttachVolumeTestJSON-1224274971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d9cbc71c-d2f8-4a51-8789-d2ccaa207051 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:16:33 devstack sudo[91720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d9cbc71c-d2f8-4a51-8789-d2ccaa207051 1073741824 Aug 31 15:16:33 devstack sudo[91720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:16:34 devstack sudo[91720]: pam_unix(sudo:session): session closed for user root Aug 31 15:16:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7bfb886d-3898-42f6-a241-673053624076 tempest-AttachVolumeTestJSON-1224274971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d9cbc71c-d2f8-4a51-8789-d2ccaa207051 1073741824" returned: 0 in 0.689s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:16:34 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-d56020e8-2c05-4c1d-ab1a-8092d47753da tempest-AttachVolumeShelveTestJSON-1820842392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:16:34 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-d56020e8-2c05-4c1d-ab1a-8092d47753da tempest-AttachVolumeShelveTestJSON-1820842392 None] Flow 'volume_create_manager' (01b9fb78-a241-4161-8ece-500eb40b29ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:16:34 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-d56020e8-2c05-4c1d-ab1a-8092d47753da tempest-AttachVolumeShelveTestJSON-1820842392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f35e66e-6768-4e6c-ba0e-4c0b02a882f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:16:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7bfb886d-3898-42f6-a241-673053624076 tempest-AttachVolumeTestJSON-1224274971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d9cbc71c-d2f8-4a51-8789-d2ccaa207051 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:16:34 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-d56020e8-2c05-4c1d-ab1a-8092d47753da tempest-AttachVolumeShelveTestJSON-1820842392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f35e66e-6768-4e6c-ba0e-4c0b02a882f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-398908624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26ebf820-f8b8-40d7-a4d5-2297f4515358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ea7e5ce1204469896f6bf425b1600e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:16:34Z,use_quota=True,user_id='f8d9832316e2424f90a55191fd5ecfe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:16:34 devstack sudo[91726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d9cbc71c-d2f8-4a51-8789-d2ccaa207051 Aug 31 15:16:34 devstack sudo[91726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:16:34 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-d56020e8-2c05-4c1d-ab1a-8092d47753da tempest-AttachVolumeShelveTestJSON-1820842392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e2439d9-9014-435f-bda3-37f59abb452a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:16:34 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-d56020e8-2c05-4c1d-ab1a-8092d47753da tempest-AttachVolumeShelveTestJSON-1820842392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e2439d9-9014-435f-bda3-37f59abb452a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:16:34 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-d56020e8-2c05-4c1d-ab1a-8092d47753da tempest-AttachVolumeShelveTestJSON-1820842392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d665dc-d375-4465-854b-358c759171d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:16:34 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-d56020e8-2c05-4c1d-ab1a-8092d47753da tempest-AttachVolumeShelveTestJSON-1820842392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d665dc-d375-4465-854b-358c759171d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26ebf820-f8b8-40d7-a4d5-2297f4515358', 'volume_name': 'volume-26ebf820-f8b8-40d7-a4d5-2297f4515358', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:16:34 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-d56020e8-2c05-4c1d-ab1a-8092d47753da tempest-AttachVolumeShelveTestJSON-1820842392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (badcf530-c291-4257-8882-1d66da352c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:16:34 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-d56020e8-2c05-4c1d-ab1a-8092d47753da tempest-AttachVolumeShelveTestJSON-1820842392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (badcf530-c291-4257-8882-1d66da352c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:16:34 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-d56020e8-2c05-4c1d-ab1a-8092d47753da tempest-AttachVolumeShelveTestJSON-1820842392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7038bf8e-0562-433c-9f33-99caff362df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:16:34 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-d56020e8-2c05-4c1d-ab1a-8092d47753da tempest-AttachVolumeShelveTestJSON-1820842392 None] Volume 26ebf820-f8b8-40d7-a4d5-2297f4515358: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26ebf820-f8b8-40d7-a4d5-2297f4515358', 'volume_size': 1} Aug 31 15:16:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-d56020e8-2c05-4c1d-ab1a-8092d47753da tempest-AttachVolumeShelveTestJSON-1820842392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:16:34 devstack sudo[91726]: pam_unix(sudo:session): session closed for user root Aug 31 15:16:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7bfb886d-3898-42f6-a241-673053624076 tempest-AttachVolumeTestJSON-1224274971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d9cbc71c-d2f8-4a51-8789-d2ccaa207051" returned: 0 in 0.272s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:16:34 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-7bfb886d-3898-42f6-a241-673053624076 tempest-AttachVolumeTestJSON-1224274971 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:16:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7bfb886d-3898-42f6-a241-673053624076 tempest-AttachVolumeTestJSON-1224274971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:16:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-d56020e8-2c05-4c1d-ab1a-8092d47753da tempest-AttachVolumeShelveTestJSON-1820842392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.202s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:16:34 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-d56020e8-2c05-4c1d-ab1a-8092d47753da tempest-AttachVolumeShelveTestJSON-1820842392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-398908624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26ebf820-f8b8-40d7-a4d5-2297f4515358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ea7e5ce1204469896f6bf425b1600e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:16:34Z,use_quota=True,user_id='f8d9832316e2424f90a55191fd5ecfe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:16:34 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-d56020e8-2c05-4c1d-ab1a-8092d47753da tempest-AttachVolumeShelveTestJSON-1820842392 None] Creating volume 26ebf820-f8b8-40d7-a4d5-2297f4515358 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:16:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-d56020e8-2c05-4c1d-ab1a-8092d47753da tempest-AttachVolumeShelveTestJSON-1820842392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:16:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-d56020e8-2c05-4c1d-ab1a-8092d47753da tempest-AttachVolumeShelveTestJSON-1820842392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:16:34 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-d56020e8-2c05-4c1d-ab1a-8092d47753da tempest-AttachVolumeShelveTestJSON-1820842392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:16:34 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-d56020e8-2c05-4c1d-ab1a-8092d47753da tempest-AttachVolumeShelveTestJSON-1820842392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:16:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-d56020e8-2c05-4c1d-ab1a-8092d47753da tempest-AttachVolumeShelveTestJSON-1820842392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:16:34 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-d56020e8-2c05-4c1d-ab1a-8092d47753da tempest-AttachVolumeShelveTestJSON-1820842392 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:16:34 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-d56020e8-2c05-4c1d-ab1a-8092d47753da tempest-AttachVolumeShelveTestJSON-1820842392 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:16:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d56020e8-2c05-4c1d-ab1a-8092d47753da tempest-AttachVolumeShelveTestJSON-1820842392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-26ebf820-f8b8-40d7-a4d5-2297f4515358 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:16:34 devstack sudo[91729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-26ebf820-f8b8-40d7-a4d5-2297f4515358 1073741824 Aug 31 15:16:34 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7bfb886d-3898-42f6-a241-673053624076 tempest-AttachVolumeTestJSON-1224274971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (229943e6-3054-4836-a144-5648aaf1ef47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9cbc71c-d2f8-4a51-8789-d2ccaa207051', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:16:34 devstack sudo[91729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:16:34 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7bfb886d-3898-42f6-a241-673053624076 tempest-AttachVolumeTestJSON-1224274971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c5c7e05-cdc3-4e9f-8086-df930da5ad91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:16:34 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-7bfb886d-3898-42f6-a241-673053624076 tempest-AttachVolumeTestJSON-1224274971 None] Volume volume-d9cbc71c-d2f8-4a51-8789-d2ccaa207051 (d9cbc71c-d2f8-4a51-8789-d2ccaa207051): created successfully Aug 31 15:16:34 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7bfb886d-3898-42f6-a241-673053624076 tempest-AttachVolumeTestJSON-1224274971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c5c7e05-cdc3-4e9f-8086-df930da5ad91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:16:34 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7bfb886d-3898-42f6-a241-673053624076 tempest-AttachVolumeTestJSON-1224274971 None] Flow 'volume_create_manager' (bf9b5c85-45f2-45e8-8ca8-021b935f99f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:16:34 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-7bfb886d-3898-42f6-a241-673053624076 tempest-AttachVolumeTestJSON-1224274971 None] Created volume successfully. Aug 31 15:16:35 devstack sudo[91729]: pam_unix(sudo:session): session closed for user root Aug 31 15:16:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d56020e8-2c05-4c1d-ab1a-8092d47753da tempest-AttachVolumeShelveTestJSON-1820842392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-26ebf820-f8b8-40d7-a4d5-2297f4515358 1073741824" returned: 0 in 0.521s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:16:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d56020e8-2c05-4c1d-ab1a-8092d47753da tempest-AttachVolumeShelveTestJSON-1820842392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-26ebf820-f8b8-40d7-a4d5-2297f4515358 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:16:35 devstack sudo[91741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-26ebf820-f8b8-40d7-a4d5-2297f4515358 Aug 31 15:16:35 devstack sudo[91741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:16:35 devstack sudo[91741]: pam_unix(sudo:session): session closed for user root Aug 31 15:16:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d56020e8-2c05-4c1d-ab1a-8092d47753da tempest-AttachVolumeShelveTestJSON-1820842392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-26ebf820-f8b8-40d7-a4d5-2297f4515358" returned: 0 in 0.278s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:16:35 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-d56020e8-2c05-4c1d-ab1a-8092d47753da tempest-AttachVolumeShelveTestJSON-1820842392 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:16:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-d56020e8-2c05-4c1d-ab1a-8092d47753da tempest-AttachVolumeShelveTestJSON-1820842392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:16:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-d56020e8-2c05-4c1d-ab1a-8092d47753da tempest-AttachVolumeShelveTestJSON-1820842392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7038bf8e-0562-433c-9f33-99caff362df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26ebf820-f8b8-40d7-a4d5-2297f4515358', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:16:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-d56020e8-2c05-4c1d-ab1a-8092d47753da tempest-AttachVolumeShelveTestJSON-1820842392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d25d937-fab9-418e-adcd-7ad21d947a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:16:35 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-d56020e8-2c05-4c1d-ab1a-8092d47753da tempest-AttachVolumeShelveTestJSON-1820842392 None] Volume volume-26ebf820-f8b8-40d7-a4d5-2297f4515358 (26ebf820-f8b8-40d7-a4d5-2297f4515358): created successfully Aug 31 15:16:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-d56020e8-2c05-4c1d-ab1a-8092d47753da tempest-AttachVolumeShelveTestJSON-1820842392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d25d937-fab9-418e-adcd-7ad21d947a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:16:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-d56020e8-2c05-4c1d-ab1a-8092d47753da tempest-AttachVolumeShelveTestJSON-1820842392 None] Flow 'volume_create_manager' (01b9fb78-a241-4161-8ece-500eb40b29ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:16:35 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-d56020e8-2c05-4c1d-ab1a-8092d47753da tempest-AttachVolumeShelveTestJSON-1820842392 None] Created volume successfully. Aug 31 15:16:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-7b515357-1241-43fb-b9d9-2dce794ce453 req-abf56aba-d950-4f78-836e-3dd8dd5f3929 tempest-AttachVolumeTestJSON-1224274971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:16:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-7b515357-1241-43fb-b9d9-2dce794ce453 req-abf56aba-d950-4f78-836e-3dd8dd5f3929 tempest-AttachVolumeTestJSON-1224274971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:16:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-7b515357-1241-43fb-b9d9-2dce794ce453 req-abf56aba-d950-4f78-836e-3dd8dd5f3929 tempest-AttachVolumeTestJSON-1224274971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:16:36 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-7b515357-1241-43fb-b9d9-2dce794ce453 req-abf56aba-d950-4f78-836e-3dd8dd5f3929 tempest-AttachVolumeTestJSON-1224274971 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77', 'name': 'volume-d9cbc71c-d2f8-4a51-8789-d2ccaa207051', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b400e393-84ad-4c7c-a605-f0bff29cc321', 'enforce_multipath': True} {{(pid=86000) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 31 15:16:36 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-7b515357-1241-43fb-b9d9-2dce794ce453 req-abf56aba-d950-4f78-836e-3dd8dd5f3929 tempest-AttachVolumeTestJSON-1224274971 None] attachment_update completed successfully. Aug 31 15:16:39 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-d66ba990-92ea-43a7-be6b-5affaef35da7 req-aa42592a-a333-4206-b45f-fd050c3995ef tempest-AttachVolumeTestJSON-1224274971 None] Terminate volume connection completed successfully. Aug 31 15:16:39 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-d66ba990-92ea-43a7-be6b-5affaef35da7 req-aa42592a-a333-4206-b45f-fd050c3995ef tempest-AttachVolumeTestJSON-1224274971 None] Deleting attachment fbe5b2cb-01e8-4c1b-a69e-8779a086b8c4. {{(pid=86000) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 31 15:16:40 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-b1cbfba9-1d33-4161-bdcf-9249397934f0 req-b4156ac2-051f-43b9-b8f9-fd3d3db00a61 tempest-AttachVolumeTestJSON-1224274971 None] Terminate volume connection completed successfully. Aug 31 15:16:40 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-b1cbfba9-1d33-4161-bdcf-9249397934f0 req-b4156ac2-051f-43b9-b8f9-fd3d3db00a61 tempest-AttachVolumeTestJSON-1224274971 None] Deleting attachment b400e393-84ad-4c7c-a605-f0bff29cc321. {{(pid=86000) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 31 15:16:45 devstack cinder-volume[86000]: DEBUG oslo_service.periodic_task [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86000) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:16:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:16:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:16:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:16:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:16:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:16:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:16:45 devstack sudo[91913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:16:45 devstack sudo[91913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:16:45 devstack sudo[91913]: pam_unix(sudo:session): session closed for user root Aug 31 15:16:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.317s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:16:45 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:16:45 devstack cinder-volume[86000]: DEBUG oslo_service.periodic_task [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running periodic task VolumeManager._thread_info {{(pid=86000) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:16:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] thread count: 8 {{(pid=86000) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 31 15:16:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] thread info: [<_MainThread(MainThread, started 137631281086592)>, , , , , , , ] {{(pid=86000) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 31 15:16:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-49abaf16-4ff1-48d6-ab0c-11f67992e137 req-b1976ebc-cb37-4132-89ee-21a3b0f92572 tempest-AttachVolumeShelveTestJSON-1820842392 None] No connector for attachment 54c92c9e-e7bc-4e39-b705-26bf6a60f340; skipping storage backend terminate_connection call. {{(pid=86000) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Aug 31 15:16:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-49abaf16-4ff1-48d6-ab0c-11f67992e137 req-b1976ebc-cb37-4132-89ee-21a3b0f92572 tempest-AttachVolumeShelveTestJSON-1820842392 None] Deleting attachment 54c92c9e-e7bc-4e39-b705-26bf6a60f340. {{(pid=86000) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 31 15:16:46 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-93c429f2-6b9c-4953-9563-99933abc28a0 tempest-AttachVolumeNegativeTest-1548450425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:16:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-93c429f2-6b9c-4953-9563-99933abc28a0 tempest-AttachVolumeNegativeTest-1548450425 None] Flow 'volume_create_manager' (41d36e9e-8d4a-49d8-b577-f9443c060b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:16:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-93c429f2-6b9c-4953-9563-99933abc28a0 tempest-AttachVolumeNegativeTest-1548450425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e094513-5d9a-4a74-bbee-75300b72a9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:16:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-93c429f2-6b9c-4953-9563-99933abc28a0 tempest-AttachVolumeNegativeTest-1548450425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e094513-5d9a-4a74-bbee-75300b72a9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-937540224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a87ac511-3281-4961-b04c-1c319cd4715f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32c0ba9f9fcb4b72adfe9348cc89b3f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:16:46Z,use_quota=True,user_id='e9851aff44c84b328eef6abb7e631932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:16:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-93c429f2-6b9c-4953-9563-99933abc28a0 tempest-AttachVolumeNegativeTest-1548450425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c5f998b-fe94-47a1-bd89-6ab6f4378996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:16:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-93c429f2-6b9c-4953-9563-99933abc28a0 tempest-AttachVolumeNegativeTest-1548450425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c5f998b-fe94-47a1-bd89-6ab6f4378996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:16:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-93c429f2-6b9c-4953-9563-99933abc28a0 tempest-AttachVolumeNegativeTest-1548450425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5b09c12-9032-4b46-96a1-956a79e32eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:16:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-93c429f2-6b9c-4953-9563-99933abc28a0 tempest-AttachVolumeNegativeTest-1548450425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5b09c12-9032-4b46-96a1-956a79e32eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a87ac511-3281-4961-b04c-1c319cd4715f', 'volume_name': 'volume-a87ac511-3281-4961-b04c-1c319cd4715f', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:16:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-93c429f2-6b9c-4953-9563-99933abc28a0 tempest-AttachVolumeNegativeTest-1548450425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d708b2e-ba28-4656-972b-2399aa3dbcad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:16:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-93c429f2-6b9c-4953-9563-99933abc28a0 tempest-AttachVolumeNegativeTest-1548450425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d708b2e-ba28-4656-972b-2399aa3dbcad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:16:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-93c429f2-6b9c-4953-9563-99933abc28a0 tempest-AttachVolumeNegativeTest-1548450425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e7388a6-5f6b-49b0-bf10-1237a493da63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:16:46 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-93c429f2-6b9c-4953-9563-99933abc28a0 tempest-AttachVolumeNegativeTest-1548450425 None] Volume a87ac511-3281-4961-b04c-1c319cd4715f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a87ac511-3281-4961-b04c-1c319cd4715f', 'volume_size': 1} Aug 31 15:16:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-93c429f2-6b9c-4953-9563-99933abc28a0 tempest-AttachVolumeNegativeTest-1548450425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:16:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-93c429f2-6b9c-4953-9563-99933abc28a0 tempest-AttachVolumeNegativeTest-1548450425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:16:46 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-93c429f2-6b9c-4953-9563-99933abc28a0 tempest-AttachVolumeNegativeTest-1548450425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-937540224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a87ac511-3281-4961-b04c-1c319cd4715f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32c0ba9f9fcb4b72adfe9348cc89b3f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:16:46Z,use_quota=True,user_id='e9851aff44c84b328eef6abb7e631932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:16:46 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-93c429f2-6b9c-4953-9563-99933abc28a0 tempest-AttachVolumeNegativeTest-1548450425 None] Creating volume a87ac511-3281-4961-b04c-1c319cd4715f {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:16:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-93c429f2-6b9c-4953-9563-99933abc28a0 tempest-AttachVolumeNegativeTest-1548450425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:16:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-93c429f2-6b9c-4953-9563-99933abc28a0 tempest-AttachVolumeNegativeTest-1548450425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:16:46 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-93c429f2-6b9c-4953-9563-99933abc28a0 tempest-AttachVolumeNegativeTest-1548450425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:16:46 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-93c429f2-6b9c-4953-9563-99933abc28a0 tempest-AttachVolumeNegativeTest-1548450425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:16:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-93c429f2-6b9c-4953-9563-99933abc28a0 tempest-AttachVolumeNegativeTest-1548450425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:16:46 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-93c429f2-6b9c-4953-9563-99933abc28a0 tempest-AttachVolumeNegativeTest-1548450425 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:16:46 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-93c429f2-6b9c-4953-9563-99933abc28a0 tempest-AttachVolumeNegativeTest-1548450425 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:16:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-93c429f2-6b9c-4953-9563-99933abc28a0 tempest-AttachVolumeNegativeTest-1548450425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a87ac511-3281-4961-b04c-1c319cd4715f 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:16:46 devstack sudo[91918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a87ac511-3281-4961-b04c-1c319cd4715f 1073741824 Aug 31 15:16:46 devstack sudo[91918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:16:47 devstack sudo[91918]: pam_unix(sudo:session): session closed for user root Aug 31 15:16:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-93c429f2-6b9c-4953-9563-99933abc28a0 tempest-AttachVolumeNegativeTest-1548450425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a87ac511-3281-4961-b04c-1c319cd4715f 1073741824" returned: 0 in 0.561s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:16:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-93c429f2-6b9c-4953-9563-99933abc28a0 tempest-AttachVolumeNegativeTest-1548450425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a87ac511-3281-4961-b04c-1c319cd4715f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:16:47 devstack sudo[91928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a87ac511-3281-4961-b04c-1c319cd4715f Aug 31 15:16:47 devstack sudo[91928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:16:47 devstack sudo[91928]: pam_unix(sudo:session): session closed for user root Aug 31 15:16:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-93c429f2-6b9c-4953-9563-99933abc28a0 tempest-AttachVolumeNegativeTest-1548450425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a87ac511-3281-4961-b04c-1c319cd4715f" returned: 0 in 0.333s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:16:47 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-93c429f2-6b9c-4953-9563-99933abc28a0 tempest-AttachVolumeNegativeTest-1548450425 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:16:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-93c429f2-6b9c-4953-9563-99933abc28a0 tempest-AttachVolumeNegativeTest-1548450425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:16:47 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-93c429f2-6b9c-4953-9563-99933abc28a0 tempest-AttachVolumeNegativeTest-1548450425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e7388a6-5f6b-49b0-bf10-1237a493da63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a87ac511-3281-4961-b04c-1c319cd4715f', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:16:47 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-93c429f2-6b9c-4953-9563-99933abc28a0 tempest-AttachVolumeNegativeTest-1548450425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c95233-e8f8-4297-baf0-478327166328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:16:47 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-93c429f2-6b9c-4953-9563-99933abc28a0 tempest-AttachVolumeNegativeTest-1548450425 None] Volume volume-a87ac511-3281-4961-b04c-1c319cd4715f (a87ac511-3281-4961-b04c-1c319cd4715f): created successfully Aug 31 15:16:47 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-93c429f2-6b9c-4953-9563-99933abc28a0 tempest-AttachVolumeNegativeTest-1548450425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c95233-e8f8-4297-baf0-478327166328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:16:47 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-93c429f2-6b9c-4953-9563-99933abc28a0 tempest-AttachVolumeNegativeTest-1548450425 None] Flow 'volume_create_manager' (41d36e9e-8d4a-49d8-b577-f9443c060b2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:16:47 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-93c429f2-6b9c-4953-9563-99933abc28a0 tempest-AttachVolumeNegativeTest-1548450425 None] Created volume successfully. Aug 31 15:16:47 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-9e179ceb-5941-44ae-8e17-82b838dbad8f tempest-AttachVolumeTestJSON-1224274971 None] Acquiring lock "cinder-d9cbc71c-d2f8-4a51-8789-d2ccaa207051-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:16:47 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-9e179ceb-5941-44ae-8e17-82b838dbad8f tempest-AttachVolumeTestJSON-1224274971 None] Lock "cinder-d9cbc71c-d2f8-4a51-8789-d2ccaa207051-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:16:47 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-9e179ceb-5941-44ae-8e17-82b838dbad8f tempest-AttachVolumeTestJSON-1224274971 None] Acquiring lock "cinder-quobyte-d9cbc71c-d2f8-4a51-8789-d2ccaa207051" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:16:47 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-9e179ceb-5941-44ae-8e17-82b838dbad8f tempest-AttachVolumeTestJSON-1224274971 None] Lock "cinder-quobyte-d9cbc71c-d2f8-4a51-8789-d2ccaa207051" acquired by "delete_volume" :: waited 0.016s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:16:47 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ce2bb9-4a0a-4dc7-ae7c-91f371753a33]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:16:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9e179ceb-5941-44ae-8e17-82b838dbad8f tempest-AttachVolumeTestJSON-1224274971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d9cbc71c-d2f8-4a51-8789-d2ccaa207051 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:16:48 devstack sudo[91933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d9cbc71c-d2f8-4a51-8789-d2ccaa207051 Aug 31 15:16:48 devstack sudo[91933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:16:48 devstack sudo[91933]: pam_unix(sudo:session): session closed for user root Aug 31 15:16:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9e179ceb-5941-44ae-8e17-82b838dbad8f tempest-AttachVolumeTestJSON-1224274971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d9cbc71c-d2f8-4a51-8789-d2ccaa207051" returned: 0 in 0.404s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:16:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9e179ceb-5941-44ae-8e17-82b838dbad8f tempest-AttachVolumeTestJSON-1224274971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d9cbc71c-d2f8-4a51-8789-d2ccaa207051 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:16:48 devstack sudo[91938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d9cbc71c-d2f8-4a51-8789-d2ccaa207051 Aug 31 15:16:48 devstack sudo[91938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:16:48 devstack sudo[91938]: pam_unix(sudo:session): session closed for user root Aug 31 15:16:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9e179ceb-5941-44ae-8e17-82b838dbad8f tempest-AttachVolumeTestJSON-1224274971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d9cbc71c-d2f8-4a51-8789-d2ccaa207051" returned: 0 in 0.332s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:16:48 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-9e179ceb-5941-44ae-8e17-82b838dbad8f tempest-AttachVolumeTestJSON-1224274971 None] Lock "cinder-quobyte-d9cbc71c-d2f8-4a51-8789-d2ccaa207051" released by "delete_volume" :: held 0.795s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:16:48 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-9e179ceb-5941-44ae-8e17-82b838dbad8f tempest-AttachVolumeTestJSON-1224274971 None] Created reservations ['ffc421e9-fd0f-4f31-aa03-96ce5a7ed5bb', '269042b6-a45b-4017-a5a1-c394fd957837', '7dd921b8-d5c1-4782-8ec7-dddf51d8412a', '83b18f49-5f1f-43fe-b1ed-69e3d7d12b45'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:16:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9e179ceb-5941-44ae-8e17-82b838dbad8f tempest-AttachVolumeTestJSON-1224274971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:16:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9e179ceb-5941-44ae-8e17-82b838dbad8f tempest-AttachVolumeTestJSON-1224274971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:16:48 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-9e179ceb-5941-44ae-8e17-82b838dbad8f tempest-AttachVolumeTestJSON-1224274971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:16:48 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-9e179ceb-5941-44ae-8e17-82b838dbad8f tempest-AttachVolumeTestJSON-1224274971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:16:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9e179ceb-5941-44ae-8e17-82b838dbad8f tempest-AttachVolumeTestJSON-1224274971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:16:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9e179ceb-5941-44ae-8e17-82b838dbad8f tempest-AttachVolumeTestJSON-1224274971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:16:48 devstack sudo[91947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:16:48 devstack sudo[91947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:16:49 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5d98ebfa-0c40-4eef-9bdb-7138e3f92848 tempest-AttachVolumeTestJSON-1224274971 None] Acquiring lock "cinder-94200774-b88b-4081-bf1a-76eae1bee759-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:16:49 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5d98ebfa-0c40-4eef-9bdb-7138e3f92848 tempest-AttachVolumeTestJSON-1224274971 None] Lock "cinder-94200774-b88b-4081-bf1a-76eae1bee759-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:16:49 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5d98ebfa-0c40-4eef-9bdb-7138e3f92848 tempest-AttachVolumeTestJSON-1224274971 None] Acquiring lock "cinder-quobyte-94200774-b88b-4081-bf1a-76eae1bee759" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:16:49 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5d98ebfa-0c40-4eef-9bdb-7138e3f92848 tempest-AttachVolumeTestJSON-1224274971 None] Lock "cinder-quobyte-94200774-b88b-4081-bf1a-76eae1bee759" acquired by "delete_volume" :: waited 0.018s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:16:49 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c417feda-f6d6-4894-a07b-67690dff6ec5]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:16:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5d98ebfa-0c40-4eef-9bdb-7138e3f92848 tempest-AttachVolumeTestJSON-1224274971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-94200774-b88b-4081-bf1a-76eae1bee759 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:16:49 devstack sudo[91947]: pam_unix(sudo:session): session closed for user root Aug 31 15:16:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9e179ceb-5941-44ae-8e17-82b838dbad8f tempest-AttachVolumeTestJSON-1224274971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.398s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:16:49 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-9e179ceb-5941-44ae-8e17-82b838dbad8f tempest-AttachVolumeTestJSON-1224274971 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:16:49 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-9e179ceb-5941-44ae-8e17-82b838dbad8f tempest-AttachVolumeTestJSON-1224274971 None] Deleted volume successfully. Aug 31 15:16:49 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-9e179ceb-5941-44ae-8e17-82b838dbad8f tempest-AttachVolumeTestJSON-1224274971 None] Lock "cinder-d9cbc71c-d2f8-4a51-8789-d2ccaa207051-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:16:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-8863808b-e0a3-48e1-b5fe-d854520fd952 req-26a45c12-e1ca-4fa2-b4a1-18340ecaa100 tempest-ServerActionsTestOtherA-1383095791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:16:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-8863808b-e0a3-48e1-b5fe-d854520fd952 req-26a45c12-e1ca-4fa2-b4a1-18340ecaa100 tempest-ServerActionsTestOtherA-1383095791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:16:49 devstack sudo[91963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-94200774-b88b-4081-bf1a-76eae1bee759 Aug 31 15:16:49 devstack sudo[91963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:16:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-8863808b-e0a3-48e1-b5fe-d854520fd952 req-26a45c12-e1ca-4fa2-b4a1-18340ecaa100 tempest-ServerActionsTestOtherA-1383095791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:16:49 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-8863808b-e0a3-48e1-b5fe-d854520fd952 req-26a45c12-e1ca-4fa2-b4a1-18340ecaa100 tempest-ServerActionsTestOtherA-1383095791 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77', 'name': 'volume-7d108717-f218-4bc2-b7ad-28b3f585c248', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c3a73545-8744-48d4-ba0a-3b79821cf24c', 'enforce_multipath': True} {{(pid=86000) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 31 15:16:49 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-8863808b-e0a3-48e1-b5fe-d854520fd952 req-26a45c12-e1ca-4fa2-b4a1-18340ecaa100 tempest-ServerActionsTestOtherA-1383095791 None] attachment_update completed successfully. Aug 31 15:16:49 devstack sudo[91963]: pam_unix(sudo:session): session closed for user root Aug 31 15:16:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5d98ebfa-0c40-4eef-9bdb-7138e3f92848 tempest-AttachVolumeTestJSON-1224274971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-94200774-b88b-4081-bf1a-76eae1bee759" returned: 0 in 0.643s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:16:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5d98ebfa-0c40-4eef-9bdb-7138e3f92848 tempest-AttachVolumeTestJSON-1224274971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-94200774-b88b-4081-bf1a-76eae1bee759 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:16:49 devstack sudo[92044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-94200774-b88b-4081-bf1a-76eae1bee759 Aug 31 15:16:49 devstack sudo[92044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:16:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-a7e04c27-b930-439a-8204-4f0923e9a8ba req-d65a4c16-bd8a-4b8d-8fac-375d2e38bf62 tempest-AttachVolumeNegativeTest-1548450425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:16:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-a7e04c27-b930-439a-8204-4f0923e9a8ba req-d65a4c16-bd8a-4b8d-8fac-375d2e38bf62 tempest-AttachVolumeNegativeTest-1548450425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:16:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-a7e04c27-b930-439a-8204-4f0923e9a8ba req-d65a4c16-bd8a-4b8d-8fac-375d2e38bf62 tempest-AttachVolumeNegativeTest-1548450425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:16:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-a7e04c27-b930-439a-8204-4f0923e9a8ba req-d65a4c16-bd8a-4b8d-8fac-375d2e38bf62 tempest-AttachVolumeNegativeTest-1548450425 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77', 'name': 'volume-a87ac511-3281-4961-b04c-1c319cd4715f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '054b795d-a5d7-44f0-bd34-2712b2cd83cc', 'enforce_multipath': True} {{(pid=86000) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 31 15:16:50 devstack sudo[92044]: pam_unix(sudo:session): session closed for user root Aug 31 15:16:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5d98ebfa-0c40-4eef-9bdb-7138e3f92848 tempest-AttachVolumeTestJSON-1224274971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-94200774-b88b-4081-bf1a-76eae1bee759" returned: 0 in 0.345s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:16:50 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5d98ebfa-0c40-4eef-9bdb-7138e3f92848 tempest-AttachVolumeTestJSON-1224274971 None] Lock "cinder-quobyte-94200774-b88b-4081-bf1a-76eae1bee759" released by "delete_volume" :: held 1.062s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:16:50 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-a7e04c27-b930-439a-8204-4f0923e9a8ba req-d65a4c16-bd8a-4b8d-8fac-375d2e38bf62 tempest-AttachVolumeNegativeTest-1548450425 None] attachment_update completed successfully. Aug 31 15:16:50 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-5d98ebfa-0c40-4eef-9bdb-7138e3f92848 tempest-AttachVolumeTestJSON-1224274971 None] Created reservations ['2868081d-9c4a-47b8-a26c-d6596ca8849a', '95801543-12f2-4d07-9361-74bbaf1d9e1a', '113ecfcc-54a4-49a4-8794-d55693ff7590', 'a68ee8a7-48f3-4981-8e2b-82cae5a6b577'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:16:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5d98ebfa-0c40-4eef-9bdb-7138e3f92848 tempest-AttachVolumeTestJSON-1224274971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:16:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5d98ebfa-0c40-4eef-9bdb-7138e3f92848 tempest-AttachVolumeTestJSON-1224274971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:16:50 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5d98ebfa-0c40-4eef-9bdb-7138e3f92848 tempest-AttachVolumeTestJSON-1224274971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:16:50 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5d98ebfa-0c40-4eef-9bdb-7138e3f92848 tempest-AttachVolumeTestJSON-1224274971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:16:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5d98ebfa-0c40-4eef-9bdb-7138e3f92848 tempest-AttachVolumeTestJSON-1224274971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:16:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5d98ebfa-0c40-4eef-9bdb-7138e3f92848 tempest-AttachVolumeTestJSON-1224274971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:16:50 devstack sudo[92364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:16:50 devstack sudo[92364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:16:50 devstack sudo[92364]: pam_unix(sudo:session): session closed for user root Aug 31 15:16:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5d98ebfa-0c40-4eef-9bdb-7138e3f92848 tempest-AttachVolumeTestJSON-1224274971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.350s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:16:50 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-5d98ebfa-0c40-4eef-9bdb-7138e3f92848 tempest-AttachVolumeTestJSON-1224274971 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:16:50 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-5d98ebfa-0c40-4eef-9bdb-7138e3f92848 tempest-AttachVolumeTestJSON-1224274971 None] Deleted volume successfully. Aug 31 15:16:50 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5d98ebfa-0c40-4eef-9bdb-7138e3f92848 tempest-AttachVolumeTestJSON-1224274971 None] Lock "cinder-94200774-b88b-4081-bf1a-76eae1bee759-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:16:51 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-16433c84-16f5-4a90-90d0-6c62e29993f8 tempest-AttachVolumeTestJSON-1224274971 None] Acquiring lock "cinder-eba67575-402b-48ad-9008-19e0f43f5b51-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:16:51 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-16433c84-16f5-4a90-90d0-6c62e29993f8 tempest-AttachVolumeTestJSON-1224274971 None] Lock "cinder-eba67575-402b-48ad-9008-19e0f43f5b51-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:16:51 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-16433c84-16f5-4a90-90d0-6c62e29993f8 tempest-AttachVolumeTestJSON-1224274971 None] Acquiring lock "cinder-quobyte-eba67575-402b-48ad-9008-19e0f43f5b51" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:16:51 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-16433c84-16f5-4a90-90d0-6c62e29993f8 tempest-AttachVolumeTestJSON-1224274971 None] Lock "cinder-quobyte-eba67575-402b-48ad-9008-19e0f43f5b51" acquired by "delete_volume" :: waited 0.032s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:16:51 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[805c4fe6-ba96-49c4-8e13-3c67a7ea39d8]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:16:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-16433c84-16f5-4a90-90d0-6c62e29993f8 tempest-AttachVolumeTestJSON-1224274971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eba67575-402b-48ad-9008-19e0f43f5b51 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:16:51 devstack sudo[92369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eba67575-402b-48ad-9008-19e0f43f5b51 Aug 31 15:16:51 devstack sudo[92369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:16:52 devstack sudo[92369]: pam_unix(sudo:session): session closed for user root Aug 31 15:16:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-16433c84-16f5-4a90-90d0-6c62e29993f8 tempest-AttachVolumeTestJSON-1224274971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eba67575-402b-48ad-9008-19e0f43f5b51" returned: 0 in 0.505s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:16:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-16433c84-16f5-4a90-90d0-6c62e29993f8 tempest-AttachVolumeTestJSON-1224274971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eba67575-402b-48ad-9008-19e0f43f5b51 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:16:52 devstack sudo[92376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eba67575-402b-48ad-9008-19e0f43f5b51 Aug 31 15:16:52 devstack sudo[92376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:16:52 devstack sudo[92376]: pam_unix(sudo:session): session closed for user root Aug 31 15:16:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-16433c84-16f5-4a90-90d0-6c62e29993f8 tempest-AttachVolumeTestJSON-1224274971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eba67575-402b-48ad-9008-19e0f43f5b51" returned: 0 in 0.493s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:16:52 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-16433c84-16f5-4a90-90d0-6c62e29993f8 tempest-AttachVolumeTestJSON-1224274971 None] Lock "cinder-quobyte-eba67575-402b-48ad-9008-19e0f43f5b51" released by "delete_volume" :: held 1.071s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:16:52 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-16433c84-16f5-4a90-90d0-6c62e29993f8 tempest-AttachVolumeTestJSON-1224274971 None] Created reservations ['d1f7888d-8301-49c8-bf5d-706ef6826453', '3c1a31ee-0749-4c40-9f37-2ffc121eed4e', 'a0c11d13-5cac-481a-8247-e9f1f4f2fd29', '2f8b7613-aded-422c-8250-3bd8850c4354'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:16:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-16433c84-16f5-4a90-90d0-6c62e29993f8 tempest-AttachVolumeTestJSON-1224274971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:16:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-16433c84-16f5-4a90-90d0-6c62e29993f8 tempest-AttachVolumeTestJSON-1224274971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:16:53 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-16433c84-16f5-4a90-90d0-6c62e29993f8 tempest-AttachVolumeTestJSON-1224274971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:16:53 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-16433c84-16f5-4a90-90d0-6c62e29993f8 tempest-AttachVolumeTestJSON-1224274971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:16:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-16433c84-16f5-4a90-90d0-6c62e29993f8 tempest-AttachVolumeTestJSON-1224274971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:16:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-16433c84-16f5-4a90-90d0-6c62e29993f8 tempest-AttachVolumeTestJSON-1224274971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:16:53 devstack sudo[92383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:16:53 devstack sudo[92383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:16:53 devstack sudo[92383]: pam_unix(sudo:session): session closed for user root Aug 31 15:16:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-16433c84-16f5-4a90-90d0-6c62e29993f8 tempest-AttachVolumeTestJSON-1224274971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.353s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:16:53 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-16433c84-16f5-4a90-90d0-6c62e29993f8 tempest-AttachVolumeTestJSON-1224274971 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:16:53 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-16433c84-16f5-4a90-90d0-6c62e29993f8 tempest-AttachVolumeTestJSON-1224274971 None] Deleted volume successfully. Aug 31 15:16:53 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-583ab120-086f-4546-8522-7be454caa055 req-7fcbcc81-7e33-446a-9f87-d4f15f785a7b tempest-AttachVolumeNegativeTest-1548450425 None] Terminate volume connection completed successfully. Aug 31 15:16:53 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-583ab120-086f-4546-8522-7be454caa055 req-7fcbcc81-7e33-446a-9f87-d4f15f785a7b tempest-AttachVolumeNegativeTest-1548450425 None] Deleting attachment 054b795d-a5d7-44f0-bd34-2712b2cd83cc. {{(pid=86000) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 31 15:16:53 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-16433c84-16f5-4a90-90d0-6c62e29993f8 tempest-AttachVolumeTestJSON-1224274971 None] Lock "cinder-eba67575-402b-48ad-9008-19e0f43f5b51-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:16:53 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-d2e349c8-8159-44b3-b792-2c684f9ddb3b req-64099bb1-1a6d-444b-afeb-e34bf44e81ea tempest-ServerActionsTestOtherA-1383095791 None] Terminate volume connection completed successfully. Aug 31 15:16:53 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-d2e349c8-8159-44b3-b792-2c684f9ddb3b req-64099bb1-1a6d-444b-afeb-e34bf44e81ea tempest-ServerActionsTestOtherA-1383095791 None] Deleting attachment c3a73545-8744-48d4-ba0a-3b79821cf24c. {{(pid=86000) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 31 15:16:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-d2e349c8-8159-44b3-b792-2c684f9ddb3b req-851fa068-ef5d-40cd-961b-8ce32bb6cad2 tempest-ServerActionsTestOtherA-1383095791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:16:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-d2e349c8-8159-44b3-b792-2c684f9ddb3b req-851fa068-ef5d-40cd-961b-8ce32bb6cad2 tempest-ServerActionsTestOtherA-1383095791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:16:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-d2e349c8-8159-44b3-b792-2c684f9ddb3b req-851fa068-ef5d-40cd-961b-8ce32bb6cad2 tempest-ServerActionsTestOtherA-1383095791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:16:55 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-d2e349c8-8159-44b3-b792-2c684f9ddb3b req-851fa068-ef5d-40cd-961b-8ce32bb6cad2 tempest-ServerActionsTestOtherA-1383095791 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77', 'name': 'volume-7d108717-f218-4bc2-b7ad-28b3f585c248', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fcb44443-caa4-4b46-a46f-bd481bb50aab', 'enforce_multipath': True} {{(pid=86000) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 31 15:16:55 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-d2e349c8-8159-44b3-b792-2c684f9ddb3b req-851fa068-ef5d-40cd-961b-8ce32bb6cad2 tempest-ServerActionsTestOtherA-1383095791 None] attachment_update completed successfully. Aug 31 15:17:05 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:SELECT=56,cinder:INSERT=9,cinder:UPDATE=44,cinder:DELETE=4 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:17:05 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:UPDATE=43,cinder:SELECT=65,cinder:DELETE=3,cinder:INSERT=7 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:17:23 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-9df37ceb-4156-470c-9afd-13f54897499b tempest-SnapshotsActionsTest-2022183587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:17:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9df37ceb-4156-470c-9afd-13f54897499b tempest-SnapshotsActionsTest-2022183587 None] Flow 'volume_create_manager' (5d0fb0a7-b668-47cc-b97d-3b875205f354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:17:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9df37ceb-4156-470c-9afd-13f54897499b tempest-SnapshotsActionsTest-2022183587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2f08a80-7444-4008-b9bb-6b0e1af70ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:17:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9df37ceb-4156-470c-9afd-13f54897499b tempest-SnapshotsActionsTest-2022183587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2f08a80-7444-4008-b9bb-6b0e1af70ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1460200343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54ddd8a-ed09-476d-ab56-5c670754268a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc6edc831dcc4a09b9505bc92f9ec9ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:17:24Z,use_quota=True,user_id='c2288e57ccbe4ae3add95f0cef602456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:17:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9df37ceb-4156-470c-9afd-13f54897499b tempest-SnapshotsActionsTest-2022183587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4c4b512-67eb-4b3f-9624-db56b7d2519d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:17:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9df37ceb-4156-470c-9afd-13f54897499b tempest-SnapshotsActionsTest-2022183587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4c4b512-67eb-4b3f-9624-db56b7d2519d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:17:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9df37ceb-4156-470c-9afd-13f54897499b tempest-SnapshotsActionsTest-2022183587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5beb025e-be47-4854-bc96-a07ce9f86ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:17:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9df37ceb-4156-470c-9afd-13f54897499b tempest-SnapshotsActionsTest-2022183587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5beb025e-be47-4854-bc96-a07ce9f86ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b54ddd8a-ed09-476d-ab56-5c670754268a', 'volume_name': 'volume-b54ddd8a-ed09-476d-ab56-5c670754268a', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:17:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9df37ceb-4156-470c-9afd-13f54897499b tempest-SnapshotsActionsTest-2022183587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83276cc2-1cde-46e4-b819-9ce2221bae6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:17:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9df37ceb-4156-470c-9afd-13f54897499b tempest-SnapshotsActionsTest-2022183587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83276cc2-1cde-46e4-b819-9ce2221bae6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:17:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9df37ceb-4156-470c-9afd-13f54897499b tempest-SnapshotsActionsTest-2022183587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29adbb4b-96e4-4320-a8d0-43629fe3df80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:17:23 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-9df37ceb-4156-470c-9afd-13f54897499b tempest-SnapshotsActionsTest-2022183587 None] Volume b54ddd8a-ed09-476d-ab56-5c670754268a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b54ddd8a-ed09-476d-ab56-5c670754268a', 'volume_size': 1} Aug 31 15:17:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9df37ceb-4156-470c-9afd-13f54897499b tempest-SnapshotsActionsTest-2022183587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:17:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9df37ceb-4156-470c-9afd-13f54897499b tempest-SnapshotsActionsTest-2022183587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:17:23 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-9df37ceb-4156-470c-9afd-13f54897499b tempest-SnapshotsActionsTest-2022183587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1460200343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54ddd8a-ed09-476d-ab56-5c670754268a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc6edc831dcc4a09b9505bc92f9ec9ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:17:24Z,use_quota=True,user_id='c2288e57ccbe4ae3add95f0cef602456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:17:23 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-9df37ceb-4156-470c-9afd-13f54897499b tempest-SnapshotsActionsTest-2022183587 None] Creating volume b54ddd8a-ed09-476d-ab56-5c670754268a {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:17:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9df37ceb-4156-470c-9afd-13f54897499b tempest-SnapshotsActionsTest-2022183587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:17:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9df37ceb-4156-470c-9afd-13f54897499b tempest-SnapshotsActionsTest-2022183587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:17:23 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-9df37ceb-4156-470c-9afd-13f54897499b tempest-SnapshotsActionsTest-2022183587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:17:23 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-9df37ceb-4156-470c-9afd-13f54897499b tempest-SnapshotsActionsTest-2022183587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:17:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9df37ceb-4156-470c-9afd-13f54897499b tempest-SnapshotsActionsTest-2022183587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:17:23 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-9df37ceb-4156-470c-9afd-13f54897499b tempest-SnapshotsActionsTest-2022183587 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:17:23 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-9df37ceb-4156-470c-9afd-13f54897499b tempest-SnapshotsActionsTest-2022183587 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:17:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9df37ceb-4156-470c-9afd-13f54897499b tempest-SnapshotsActionsTest-2022183587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:23 devstack sudo[93234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a 1073741824 Aug 31 15:17:23 devstack sudo[93234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:24 devstack sudo[93234]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9df37ceb-4156-470c-9afd-13f54897499b tempest-SnapshotsActionsTest-2022183587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a 1073741824" returned: 0 in 0.398s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9df37ceb-4156-470c-9afd-13f54897499b tempest-SnapshotsActionsTest-2022183587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:24 devstack sudo[93239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a Aug 31 15:17:24 devstack sudo[93239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:24 devstack sudo[93239]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9df37ceb-4156-470c-9afd-13f54897499b tempest-SnapshotsActionsTest-2022183587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a" returned: 0 in 0.248s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:24 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-9df37ceb-4156-470c-9afd-13f54897499b tempest-SnapshotsActionsTest-2022183587 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:17:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9df37ceb-4156-470c-9afd-13f54897499b tempest-SnapshotsActionsTest-2022183587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:17:24 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9df37ceb-4156-470c-9afd-13f54897499b tempest-SnapshotsActionsTest-2022183587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29adbb4b-96e4-4320-a8d0-43629fe3df80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b54ddd8a-ed09-476d-ab56-5c670754268a', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:17:24 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9df37ceb-4156-470c-9afd-13f54897499b tempest-SnapshotsActionsTest-2022183587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (236d33d6-9598-40cd-84ac-0c1ae6eb71e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:17:24 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-9df37ceb-4156-470c-9afd-13f54897499b tempest-SnapshotsActionsTest-2022183587 None] Volume volume-b54ddd8a-ed09-476d-ab56-5c670754268a (b54ddd8a-ed09-476d-ab56-5c670754268a): created successfully Aug 31 15:17:24 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9df37ceb-4156-470c-9afd-13f54897499b tempest-SnapshotsActionsTest-2022183587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (236d33d6-9598-40cd-84ac-0c1ae6eb71e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:17:24 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9df37ceb-4156-470c-9afd-13f54897499b tempest-SnapshotsActionsTest-2022183587 None] Flow 'volume_create_manager' (5d0fb0a7-b668-47cc-b97d-3b875205f354) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:17:24 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-9df37ceb-4156-470c-9afd-13f54897499b tempest-SnapshotsActionsTest-2022183587 None] Created volume successfully. Aug 31 15:17:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8e3bb767-c0c9-4a7c-9f71-645cc01b7ebc tempest-SnapshotsActionsTest-2022183587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:17:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8e3bb767-c0c9-4a7c-9f71-645cc01b7ebc tempest-SnapshotsActionsTest-2022183587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:17:24 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-8e3bb767-c0c9-4a7c-9f71-645cc01b7ebc tempest-SnapshotsActionsTest-2022183587 None] Creating offline snapshot 5c25c8a4-be3b-47b4-b8ef-ea461fcd9078 of volume b54ddd8a-ed09-476d-ab56-5c670754268a {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:17:24 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd295f4d-5383-4bd6-b6e6-c5dbe7ec2c0e]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:17:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8e3bb767-c0c9-4a7c-9f71-645cc01b7ebc tempest-SnapshotsActionsTest-2022183587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:24 devstack sudo[93242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a Aug 31 15:17:25 devstack sudo[93242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:25 devstack sudo[93242]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8e3bb767-c0c9-4a7c-9f71-645cc01b7ebc tempest-SnapshotsActionsTest-2022183587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a" returned: 0 in 0.412s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8e3bb767-c0c9-4a7c-9f71-645cc01b7ebc tempest-SnapshotsActionsTest-2022183587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:25 devstack sudo[93248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078 1G Aug 31 15:17:25 devstack sudo[93248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:25 devstack sudo[93248]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8e3bb767-c0c9-4a7c-9f71-645cc01b7ebc tempest-SnapshotsActionsTest-2022183587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078 1G" returned: 0 in 0.430s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8e3bb767-c0c9-4a7c-9f71-645cc01b7ebc tempest-SnapshotsActionsTest-2022183587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b54ddd8a-ed09-476d-ab56-5c670754268a -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:25 devstack sudo[93254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b54ddd8a-ed09-476d-ab56-5c670754268a -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078 Aug 31 15:17:25 devstack sudo[93254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:26 devstack sudo[93254]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8e3bb767-c0c9-4a7c-9f71-645cc01b7ebc tempest-SnapshotsActionsTest-2022183587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b54ddd8a-ed09-476d-ab56-5c670754268a -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078" returned: 0 in 0.327s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:26 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-8e3bb767-c0c9-4a7c-9f71-645cc01b7ebc tempest-SnapshotsActionsTest-2022183587 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078 is being set with open permissions: ugo+rw Aug 31 15:17:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8e3bb767-c0c9-4a7c-9f71-645cc01b7ebc tempest-SnapshotsActionsTest-2022183587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:26 devstack sudo[93262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078 Aug 31 15:17:26 devstack sudo[93262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:26 devstack sudo[93262]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8e3bb767-c0c9-4a7c-9f71-645cc01b7ebc tempest-SnapshotsActionsTest-2022183587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078" returned: 0 in 0.330s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8e3bb767-c0c9-4a7c-9f71-645cc01b7ebc tempest-SnapshotsActionsTest-2022183587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:26 devstack sudo[93265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.info Aug 31 15:17:26 devstack sudo[93265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:26 devstack sudo[93265]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8e3bb767-c0c9-4a7c-9f71-645cc01b7ebc tempest-SnapshotsActionsTest-2022183587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.info" returned: 0 in 0.304s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:26 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-8e3bb767-c0c9-4a7c-9f71-645cc01b7ebc tempest-SnapshotsActionsTest-2022183587 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.info is being set with open permissions: ugo+rw Aug 31 15:17:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8e3bb767-c0c9-4a7c-9f71-645cc01b7ebc tempest-SnapshotsActionsTest-2022183587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:26 devstack sudo[93268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.info Aug 31 15:17:26 devstack sudo[93268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:27 devstack sudo[93268]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8e3bb767-c0c9-4a7c-9f71-645cc01b7ebc tempest-SnapshotsActionsTest-2022183587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.info" returned: 0 in 0.294s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8e3bb767-c0c9-4a7c-9f71-645cc01b7ebc tempest-SnapshotsActionsTest-2022183587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.220s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:17:27 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-8e3bb767-c0c9-4a7c-9f71-645cc01b7ebc tempest-SnapshotsActionsTest-2022183587 None] Create snapshot completed successfully Aug 31 15:17:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bea44a4c-6cd9-45cc-b080-457157540964 tempest-SnapshotsActionsTest-2022183587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:17:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bea44a4c-6cd9-45cc-b080-457157540964 tempest-SnapshotsActionsTest-2022183587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:17:28 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-bea44a4c-6cd9-45cc-b080-457157540964 tempest-SnapshotsActionsTest-2022183587 None] Creating offline snapshot a1431163-fb52-4316-8731-78a357ee0352 of volume b54ddd8a-ed09-476d-ab56-5c670754268a {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:17:28 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d76f8e-bb99-47b2-8f6d-184863c23db9]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:17:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bea44a4c-6cd9-45cc-b080-457157540964 tempest-SnapshotsActionsTest-2022183587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:28 devstack sudo[93271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078 Aug 31 15:17:28 devstack sudo[93271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:28 devstack sudo[93271]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bea44a4c-6cd9-45cc-b080-457157540964 tempest-SnapshotsActionsTest-2022183587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078" returned: 0 in 0.373s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:28 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-bea44a4c-6cd9-45cc-b080-457157540964 tempest-SnapshotsActionsTest-2022183587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b54ddd8a-ed09-476d-ab56-5c670754268a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:17:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bea44a4c-6cd9-45cc-b080-457157540964 tempest-SnapshotsActionsTest-2022183587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.a1431163-fb52-4316-8731-78a357ee0352 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:28 devstack sudo[93276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.a1431163-fb52-4316-8731-78a357ee0352 1G Aug 31 15:17:28 devstack sudo[93276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:29 devstack sudo[93276]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bea44a4c-6cd9-45cc-b080-457157540964 tempest-SnapshotsActionsTest-2022183587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.a1431163-fb52-4316-8731-78a357ee0352 1G" returned: 0 in 0.468s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bea44a4c-6cd9-45cc-b080-457157540964 tempest-SnapshotsActionsTest-2022183587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.a1431163-fb52-4316-8731-78a357ee0352 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:29 devstack sudo[93282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.a1431163-fb52-4316-8731-78a357ee0352 Aug 31 15:17:29 devstack sudo[93282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:29 devstack sudo[93282]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bea44a4c-6cd9-45cc-b080-457157540964 tempest-SnapshotsActionsTest-2022183587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.a1431163-fb52-4316-8731-78a357ee0352" returned: 0 in 0.291s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:29 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-bea44a4c-6cd9-45cc-b080-457157540964 tempest-SnapshotsActionsTest-2022183587 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.a1431163-fb52-4316-8731-78a357ee0352 is being set with open permissions: ugo+rw Aug 31 15:17:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bea44a4c-6cd9-45cc-b080-457157540964 tempest-SnapshotsActionsTest-2022183587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.a1431163-fb52-4316-8731-78a357ee0352 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:29 devstack sudo[93287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.a1431163-fb52-4316-8731-78a357ee0352 Aug 31 15:17:29 devstack sudo[93287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:29 devstack sudo[93287]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bea44a4c-6cd9-45cc-b080-457157540964 tempest-SnapshotsActionsTest-2022183587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.a1431163-fb52-4316-8731-78a357ee0352" returned: 0 in 0.250s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bea44a4c-6cd9-45cc-b080-457157540964 tempest-SnapshotsActionsTest-2022183587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.493s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:17:30 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-bea44a4c-6cd9-45cc-b080-457157540964 tempest-SnapshotsActionsTest-2022183587 None] Create snapshot completed successfully Aug 31 15:17:30 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-49ac4e98-2e01-49b3-b1de-2036fc0f1bb4 tempest-SnapshotsActionsTest-190824735 None] Acquiring lock "cinder-a1431163-fb52-4316-8731-78a357ee0352-delete_snapshot" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:17:30 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-49ac4e98-2e01-49b3-b1de-2036fc0f1bb4 tempest-SnapshotsActionsTest-190824735 None] Lock "cinder-a1431163-fb52-4316-8731-78a357ee0352-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:17:30 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-49ac4e98-2e01-49b3-b1de-2036fc0f1bb4 tempest-SnapshotsActionsTest-190824735 None] Acquiring lock "cinder-quobyte-b54ddd8a-ed09-476d-ab56-5c670754268a" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:17:30 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-49ac4e98-2e01-49b3-b1de-2036fc0f1bb4 tempest-SnapshotsActionsTest-190824735 None] Lock "cinder-quobyte-b54ddd8a-ed09-476d-ab56-5c670754268a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:17:30 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-49ac4e98-2e01-49b3-b1de-2036fc0f1bb4 tempest-SnapshotsActionsTest-190824735 None] Acquiring lock "cinder-quobyte-a1431163-fb52-4316-8731-78a357ee0352" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:17:30 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-49ac4e98-2e01-49b3-b1de-2036fc0f1bb4 tempest-SnapshotsActionsTest-190824735 None] Lock "cinder-quobyte-a1431163-fb52-4316-8731-78a357ee0352" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:17:30 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-49ac4e98-2e01-49b3-b1de-2036fc0f1bb4 tempest-SnapshotsActionsTest-190824735 None] Deleting offline snapshot a1431163-fb52-4316-8731-78a357ee0352 of volume b54ddd8a-ed09-476d-ab56-5c670754268a {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:17:30 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-49ac4e98-2e01-49b3-b1de-2036fc0f1bb4 tempest-SnapshotsActionsTest-190824735 None] snapshot_file for this snap is: volume-b54ddd8a-ed09-476d-ab56-5c670754268a.a1431163-fb52-4316-8731-78a357ee0352 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:17:30 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f646c5-ece2-47b0-a627-8268ebf3b64d]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:17:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-49ac4e98-2e01-49b3-b1de-2036fc0f1bb4 tempest-SnapshotsActionsTest-190824735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.a1431163-fb52-4316-8731-78a357ee0352 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:30 devstack sudo[93290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.a1431163-fb52-4316-8731-78a357ee0352 Aug 31 15:17:30 devstack sudo[93290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:31 devstack sudo[93290]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-49ac4e98-2e01-49b3-b1de-2036fc0f1bb4 tempest-SnapshotsActionsTest-190824735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.a1431163-fb52-4316-8731-78a357ee0352" returned: 0 in 0.357s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:31 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-49ac4e98-2e01-49b3-b1de-2036fc0f1bb4 tempest-SnapshotsActionsTest-190824735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b54ddd8a-ed09-476d-ab56-5c670754268a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:17:31 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff9ab7a-8020-43f8-8e13-a1cb2ece5ba4]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:17:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-49ac4e98-2e01-49b3-b1de-2036fc0f1bb4 tempest-SnapshotsActionsTest-190824735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:31 devstack sudo[93295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078 Aug 31 15:17:31 devstack sudo[93295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:31 devstack sudo[93295]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-49ac4e98-2e01-49b3-b1de-2036fc0f1bb4 tempest-SnapshotsActionsTest-190824735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078" returned: 0 in 0.361s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:31 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-49ac4e98-2e01-49b3-b1de-2036fc0f1bb4 tempest-SnapshotsActionsTest-190824735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b54ddd8a-ed09-476d-ab56-5c670754268a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:17:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-49ac4e98-2e01-49b3-b1de-2036fc0f1bb4 tempest-SnapshotsActionsTest-190824735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.a1431163-fb52-4316-8731-78a357ee0352 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:31 devstack sudo[93300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.a1431163-fb52-4316-8731-78a357ee0352 Aug 31 15:17:31 devstack sudo[93300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:31 devstack sudo[93300]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-49ac4e98-2e01-49b3-b1de-2036fc0f1bb4 tempest-SnapshotsActionsTest-190824735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.a1431163-fb52-4316-8731-78a357ee0352" returned: 0 in 0.394s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-49ac4e98-2e01-49b3-b1de-2036fc0f1bb4 tempest-SnapshotsActionsTest-190824735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.a1431163-fb52-4316-8731-78a357ee0352 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:31 devstack sudo[93318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.a1431163-fb52-4316-8731-78a357ee0352 Aug 31 15:17:31 devstack sudo[93318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:32 devstack sudo[93318]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-49ac4e98-2e01-49b3-b1de-2036fc0f1bb4 tempest-SnapshotsActionsTest-190824735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.a1431163-fb52-4316-8731-78a357ee0352" returned: 0 in 0.240s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:32 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-49ac4e98-2e01-49b3-b1de-2036fc0f1bb4 tempest-SnapshotsActionsTest-190824735 None] Lock "cinder-quobyte-a1431163-fb52-4316-8731-78a357ee0352" released by "_delete_snapshot" :: held 1.436s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:17:32 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-49ac4e98-2e01-49b3-b1de-2036fc0f1bb4 tempest-SnapshotsActionsTest-190824735 None] Lock "cinder-quobyte-b54ddd8a-ed09-476d-ab56-5c670754268a" released by "delete_snapshot" :: held 1.460s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:17:32 devstack cinder-volume[86000]: WARNING cinder.quota [None req-49ac4e98-2e01-49b3-b1de-2036fc0f1bb4 tempest-SnapshotsActionsTest-190824735 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 31 15:17:32 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-49ac4e98-2e01-49b3-b1de-2036fc0f1bb4 tempest-SnapshotsActionsTest-190824735 None] Created reservations ['fb7805dd-59d0-4563-b1ce-d5d9188aa20c', 'aea433e5-683d-416f-aea4-ab506182ec41', 'd39c8890-0aa1-4e0c-8762-2312ec3ccd04', '3726e6ce-8fc0-47dd-9629-c8c73142c514'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:17:32 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-49ac4e98-2e01-49b3-b1de-2036fc0f1bb4 tempest-SnapshotsActionsTest-190824735 None] Delete snapshot completed successfully. Aug 31 15:17:32 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-49ac4e98-2e01-49b3-b1de-2036fc0f1bb4 tempest-SnapshotsActionsTest-190824735 None] Lock "cinder-a1431163-fb52-4316-8731-78a357ee0352-delete_snapshot" released by "delete_snapshot" :: held 1.619s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:17:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6cc009f5-e982-4cdc-8b1e-0eacd47d62f2 tempest-SnapshotsActionsTest-2022183587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:17:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6cc009f5-e982-4cdc-8b1e-0eacd47d62f2 tempest-SnapshotsActionsTest-2022183587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:17:33 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-6cc009f5-e982-4cdc-8b1e-0eacd47d62f2 tempest-SnapshotsActionsTest-2022183587 None] Creating offline snapshot 25b96ee8-f722-4d09-b4c3-e864764d85a7 of volume b54ddd8a-ed09-476d-ab56-5c670754268a {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:17:33 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac2b2a6-9f78-4ec0-94f2-02e73375e4ec]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:17:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6cc009f5-e982-4cdc-8b1e-0eacd47d62f2 tempest-SnapshotsActionsTest-2022183587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:33 devstack sudo[93322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078 Aug 31 15:17:33 devstack sudo[93322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:33 devstack sudo[93322]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6cc009f5-e982-4cdc-8b1e-0eacd47d62f2 tempest-SnapshotsActionsTest-2022183587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078" returned: 0 in 0.339s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:33 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-6cc009f5-e982-4cdc-8b1e-0eacd47d62f2 tempest-SnapshotsActionsTest-2022183587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b54ddd8a-ed09-476d-ab56-5c670754268a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:17:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6cc009f5-e982-4cdc-8b1e-0eacd47d62f2 tempest-SnapshotsActionsTest-2022183587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.25b96ee8-f722-4d09-b4c3-e864764d85a7 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:33 devstack sudo[93327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.25b96ee8-f722-4d09-b4c3-e864764d85a7 1G Aug 31 15:17:33 devstack sudo[93327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:33 devstack sudo[93327]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6cc009f5-e982-4cdc-8b1e-0eacd47d62f2 tempest-SnapshotsActionsTest-2022183587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.25b96ee8-f722-4d09-b4c3-e864764d85a7 1G" returned: 0 in 0.393s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6cc009f5-e982-4cdc-8b1e-0eacd47d62f2 tempest-SnapshotsActionsTest-2022183587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.25b96ee8-f722-4d09-b4c3-e864764d85a7 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:33 devstack sudo[93333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.25b96ee8-f722-4d09-b4c3-e864764d85a7 Aug 31 15:17:33 devstack sudo[93333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:34 devstack sudo[93333]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6cc009f5-e982-4cdc-8b1e-0eacd47d62f2 tempest-SnapshotsActionsTest-2022183587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.25b96ee8-f722-4d09-b4c3-e864764d85a7" returned: 0 in 0.289s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:34 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-6cc009f5-e982-4cdc-8b1e-0eacd47d62f2 tempest-SnapshotsActionsTest-2022183587 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.25b96ee8-f722-4d09-b4c3-e864764d85a7 is being set with open permissions: ugo+rw Aug 31 15:17:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6cc009f5-e982-4cdc-8b1e-0eacd47d62f2 tempest-SnapshotsActionsTest-2022183587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.25b96ee8-f722-4d09-b4c3-e864764d85a7 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:34 devstack sudo[93338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.25b96ee8-f722-4d09-b4c3-e864764d85a7 Aug 31 15:17:34 devstack sudo[93338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:34 devstack sudo[93338]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6cc009f5-e982-4cdc-8b1e-0eacd47d62f2 tempest-SnapshotsActionsTest-2022183587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.25b96ee8-f722-4d09-b4c3-e864764d85a7" returned: 0 in 0.232s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6cc009f5-e982-4cdc-8b1e-0eacd47d62f2 tempest-SnapshotsActionsTest-2022183587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.331s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:17:34 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-6cc009f5-e982-4cdc-8b1e-0eacd47d62f2 tempest-SnapshotsActionsTest-2022183587 None] Create snapshot completed successfully Aug 31 15:17:35 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-557e0d74-9f7a-4a95-96b2-ca90cf273c38 tempest-SnapshotsActionsTest-190824735 None] Acquiring lock "cinder-25b96ee8-f722-4d09-b4c3-e864764d85a7-delete_snapshot" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:17:35 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-557e0d74-9f7a-4a95-96b2-ca90cf273c38 tempest-SnapshotsActionsTest-190824735 None] Lock "cinder-25b96ee8-f722-4d09-b4c3-e864764d85a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:17:35 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-557e0d74-9f7a-4a95-96b2-ca90cf273c38 tempest-SnapshotsActionsTest-190824735 None] Acquiring lock "cinder-quobyte-b54ddd8a-ed09-476d-ab56-5c670754268a" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:17:35 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-557e0d74-9f7a-4a95-96b2-ca90cf273c38 tempest-SnapshotsActionsTest-190824735 None] Lock "cinder-quobyte-b54ddd8a-ed09-476d-ab56-5c670754268a" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:17:35 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-557e0d74-9f7a-4a95-96b2-ca90cf273c38 tempest-SnapshotsActionsTest-190824735 None] Acquiring lock "cinder-quobyte-25b96ee8-f722-4d09-b4c3-e864764d85a7" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:17:35 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-557e0d74-9f7a-4a95-96b2-ca90cf273c38 tempest-SnapshotsActionsTest-190824735 None] Lock "cinder-quobyte-25b96ee8-f722-4d09-b4c3-e864764d85a7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:17:35 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-557e0d74-9f7a-4a95-96b2-ca90cf273c38 tempest-SnapshotsActionsTest-190824735 None] Deleting offline snapshot 25b96ee8-f722-4d09-b4c3-e864764d85a7 of volume b54ddd8a-ed09-476d-ab56-5c670754268a {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:17:35 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-557e0d74-9f7a-4a95-96b2-ca90cf273c38 tempest-SnapshotsActionsTest-190824735 None] snapshot_file for this snap is: volume-b54ddd8a-ed09-476d-ab56-5c670754268a.25b96ee8-f722-4d09-b4c3-e864764d85a7 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:17:35 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cad27a-8468-4f97-9ba8-b6b6a0050f42]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:17:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-557e0d74-9f7a-4a95-96b2-ca90cf273c38 tempest-SnapshotsActionsTest-190824735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.25b96ee8-f722-4d09-b4c3-e864764d85a7 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:35 devstack sudo[93347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.25b96ee8-f722-4d09-b4c3-e864764d85a7 Aug 31 15:17:35 devstack sudo[93347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:35 devstack sudo[93347]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-557e0d74-9f7a-4a95-96b2-ca90cf273c38 tempest-SnapshotsActionsTest-190824735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.25b96ee8-f722-4d09-b4c3-e864764d85a7" returned: 0 in 0.345s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:35 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-557e0d74-9f7a-4a95-96b2-ca90cf273c38 tempest-SnapshotsActionsTest-190824735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b54ddd8a-ed09-476d-ab56-5c670754268a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:17:35 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d4cd11-7e05-4e13-a8ef-db2dd6617cff]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:17:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-557e0d74-9f7a-4a95-96b2-ca90cf273c38 tempest-SnapshotsActionsTest-190824735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:35 devstack sudo[93353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078 Aug 31 15:17:35 devstack sudo[93353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:36 devstack sudo[93353]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-557e0d74-9f7a-4a95-96b2-ca90cf273c38 tempest-SnapshotsActionsTest-190824735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078" returned: 0 in 0.341s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:36 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-557e0d74-9f7a-4a95-96b2-ca90cf273c38 tempest-SnapshotsActionsTest-190824735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b54ddd8a-ed09-476d-ab56-5c670754268a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:17:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-557e0d74-9f7a-4a95-96b2-ca90cf273c38 tempest-SnapshotsActionsTest-190824735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.25b96ee8-f722-4d09-b4c3-e864764d85a7 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:36 devstack sudo[93359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.25b96ee8-f722-4d09-b4c3-e864764d85a7 Aug 31 15:17:36 devstack sudo[93359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:36 devstack sudo[93359]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-557e0d74-9f7a-4a95-96b2-ca90cf273c38 tempest-SnapshotsActionsTest-190824735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.25b96ee8-f722-4d09-b4c3-e864764d85a7" returned: 0 in 0.344s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-557e0d74-9f7a-4a95-96b2-ca90cf273c38 tempest-SnapshotsActionsTest-190824735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.25b96ee8-f722-4d09-b4c3-e864764d85a7 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:36 devstack sudo[93365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.25b96ee8-f722-4d09-b4c3-e864764d85a7 Aug 31 15:17:36 devstack sudo[93365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:36 devstack sudo[93365]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-557e0d74-9f7a-4a95-96b2-ca90cf273c38 tempest-SnapshotsActionsTest-190824735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.25b96ee8-f722-4d09-b4c3-e864764d85a7" returned: 0 in 0.229s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:36 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-557e0d74-9f7a-4a95-96b2-ca90cf273c38 tempest-SnapshotsActionsTest-190824735 None] Lock "cinder-quobyte-25b96ee8-f722-4d09-b4c3-e864764d85a7" released by "_delete_snapshot" :: held 1.341s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:17:36 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-557e0d74-9f7a-4a95-96b2-ca90cf273c38 tempest-SnapshotsActionsTest-190824735 None] Lock "cinder-quobyte-b54ddd8a-ed09-476d-ab56-5c670754268a" released by "delete_snapshot" :: held 1.361s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:17:36 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-557e0d74-9f7a-4a95-96b2-ca90cf273c38 tempest-SnapshotsActionsTest-190824735 None] Created reservations ['d24a8ea9-34e6-4c69-a87f-7fc2d0195189', 'd645e0fe-cb95-47a6-bf1b-a92fe50e6dcc', '4abad115-c0fc-4021-babf-1aeb5968ea2c', '61960333-d61f-499a-abb8-dc7433c7e7d8'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:17:36 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-557e0d74-9f7a-4a95-96b2-ca90cf273c38 tempest-SnapshotsActionsTest-190824735 None] Delete snapshot completed successfully. Aug 31 15:17:36 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-557e0d74-9f7a-4a95-96b2-ca90cf273c38 tempest-SnapshotsActionsTest-190824735 None] Lock "cinder-25b96ee8-f722-4d09-b4c3-e864764d85a7-delete_snapshot" released by "delete_snapshot" :: held 1.489s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:17:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6b8d98f5-2af6-4dd9-a41b-d501bde6ccc2 tempest-SnapshotsActionsTest-2022183587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:17:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6b8d98f5-2af6-4dd9-a41b-d501bde6ccc2 tempest-SnapshotsActionsTest-2022183587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:17:37 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-6b8d98f5-2af6-4dd9-a41b-d501bde6ccc2 tempest-SnapshotsActionsTest-2022183587 None] Creating offline snapshot a677b6ba-e2f0-443f-a83c-0d3ac65d3f3d of volume b54ddd8a-ed09-476d-ab56-5c670754268a {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:17:37 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[def7ebda-c55e-4159-bded-625b4a2a1ffd]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:17:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6b8d98f5-2af6-4dd9-a41b-d501bde6ccc2 tempest-SnapshotsActionsTest-2022183587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:37 devstack sudo[93368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078 Aug 31 15:17:37 devstack sudo[93368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:38 devstack sudo[93368]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6b8d98f5-2af6-4dd9-a41b-d501bde6ccc2 tempest-SnapshotsActionsTest-2022183587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078" returned: 0 in 0.389s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:38 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-6b8d98f5-2af6-4dd9-a41b-d501bde6ccc2 tempest-SnapshotsActionsTest-2022183587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b54ddd8a-ed09-476d-ab56-5c670754268a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:17:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6b8d98f5-2af6-4dd9-a41b-d501bde6ccc2 tempest-SnapshotsActionsTest-2022183587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.a677b6ba-e2f0-443f-a83c-0d3ac65d3f3d 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:38 devstack sudo[93374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.a677b6ba-e2f0-443f-a83c-0d3ac65d3f3d 1G Aug 31 15:17:38 devstack sudo[93374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:38 devstack sudo[93374]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6b8d98f5-2af6-4dd9-a41b-d501bde6ccc2 tempest-SnapshotsActionsTest-2022183587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.a677b6ba-e2f0-443f-a83c-0d3ac65d3f3d 1G" returned: 0 in 0.428s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6b8d98f5-2af6-4dd9-a41b-d501bde6ccc2 tempest-SnapshotsActionsTest-2022183587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.a677b6ba-e2f0-443f-a83c-0d3ac65d3f3d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:38 devstack sudo[93379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.a677b6ba-e2f0-443f-a83c-0d3ac65d3f3d Aug 31 15:17:38 devstack sudo[93379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:38 devstack sudo[93379]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6b8d98f5-2af6-4dd9-a41b-d501bde6ccc2 tempest-SnapshotsActionsTest-2022183587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.a677b6ba-e2f0-443f-a83c-0d3ac65d3f3d" returned: 0 in 0.280s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:38 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-6b8d98f5-2af6-4dd9-a41b-d501bde6ccc2 tempest-SnapshotsActionsTest-2022183587 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.a677b6ba-e2f0-443f-a83c-0d3ac65d3f3d is being set with open permissions: ugo+rw Aug 31 15:17:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6b8d98f5-2af6-4dd9-a41b-d501bde6ccc2 tempest-SnapshotsActionsTest-2022183587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.a677b6ba-e2f0-443f-a83c-0d3ac65d3f3d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:38 devstack sudo[93384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.a677b6ba-e2f0-443f-a83c-0d3ac65d3f3d Aug 31 15:17:38 devstack sudo[93384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:39 devstack sudo[93384]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6b8d98f5-2af6-4dd9-a41b-d501bde6ccc2 tempest-SnapshotsActionsTest-2022183587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.a677b6ba-e2f0-443f-a83c-0d3ac65d3f3d" returned: 0 in 0.233s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6b8d98f5-2af6-4dd9-a41b-d501bde6ccc2 tempest-SnapshotsActionsTest-2022183587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.418s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:17:39 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-6b8d98f5-2af6-4dd9-a41b-d501bde6ccc2 tempest-SnapshotsActionsTest-2022183587 None] Create snapshot completed successfully Aug 31 15:17:40 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6195e70d-8a35-40fb-8f6c-b95b20579983 tempest-SnapshotsActionsTest-190824735 None] Acquiring lock "cinder-a677b6ba-e2f0-443f-a83c-0d3ac65d3f3d-delete_snapshot" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:17:40 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6195e70d-8a35-40fb-8f6c-b95b20579983 tempest-SnapshotsActionsTest-190824735 None] Lock "cinder-a677b6ba-e2f0-443f-a83c-0d3ac65d3f3d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:17:40 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6195e70d-8a35-40fb-8f6c-b95b20579983 tempest-SnapshotsActionsTest-190824735 None] Acquiring lock "cinder-quobyte-b54ddd8a-ed09-476d-ab56-5c670754268a" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:17:40 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6195e70d-8a35-40fb-8f6c-b95b20579983 tempest-SnapshotsActionsTest-190824735 None] Lock "cinder-quobyte-b54ddd8a-ed09-476d-ab56-5c670754268a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:17:40 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6195e70d-8a35-40fb-8f6c-b95b20579983 tempest-SnapshotsActionsTest-190824735 None] Acquiring lock "cinder-quobyte-a677b6ba-e2f0-443f-a83c-0d3ac65d3f3d" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:17:40 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6195e70d-8a35-40fb-8f6c-b95b20579983 tempest-SnapshotsActionsTest-190824735 None] Lock "cinder-quobyte-a677b6ba-e2f0-443f-a83c-0d3ac65d3f3d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:17:40 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-6195e70d-8a35-40fb-8f6c-b95b20579983 tempest-SnapshotsActionsTest-190824735 None] Deleting offline snapshot a677b6ba-e2f0-443f-a83c-0d3ac65d3f3d of volume b54ddd8a-ed09-476d-ab56-5c670754268a {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:17:40 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-6195e70d-8a35-40fb-8f6c-b95b20579983 tempest-SnapshotsActionsTest-190824735 None] snapshot_file for this snap is: volume-b54ddd8a-ed09-476d-ab56-5c670754268a.a677b6ba-e2f0-443f-a83c-0d3ac65d3f3d {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:17:40 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ca3e94-f898-405a-b370-16d00db242f0]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:17:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6195e70d-8a35-40fb-8f6c-b95b20579983 tempest-SnapshotsActionsTest-190824735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.a677b6ba-e2f0-443f-a83c-0d3ac65d3f3d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:40 devstack sudo[93391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.a677b6ba-e2f0-443f-a83c-0d3ac65d3f3d Aug 31 15:17:40 devstack sudo[93391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:40 devstack sudo[93391]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6195e70d-8a35-40fb-8f6c-b95b20579983 tempest-SnapshotsActionsTest-190824735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.a677b6ba-e2f0-443f-a83c-0d3ac65d3f3d" returned: 0 in 0.378s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:40 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-6195e70d-8a35-40fb-8f6c-b95b20579983 tempest-SnapshotsActionsTest-190824735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b54ddd8a-ed09-476d-ab56-5c670754268a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:17:40 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89fb964-c140-4fbb-a37b-bb0ce3223099]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:17:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6195e70d-8a35-40fb-8f6c-b95b20579983 tempest-SnapshotsActionsTest-190824735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:40 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-18e0bcc0-7da0-4ff1-8a9f-2217091d9ece req-628d079f-ef56-4e9b-9abb-5bfe51d0b76c tempest-ServerActionsTestOtherA-1383095791 None] Terminate volume connection completed successfully. Aug 31 15:17:40 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-18e0bcc0-7da0-4ff1-8a9f-2217091d9ece req-628d079f-ef56-4e9b-9abb-5bfe51d0b76c tempest-ServerActionsTestOtherA-1383095791 None] Deleting attachment fcb44443-caa4-4b46-a46f-bd481bb50aab. {{(pid=86000) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 31 15:17:40 devstack sudo[93401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078 Aug 31 15:17:40 devstack sudo[93401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:40 devstack sudo[93401]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6195e70d-8a35-40fb-8f6c-b95b20579983 tempest-SnapshotsActionsTest-190824735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078" returned: 0 in 0.403s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:40 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-6195e70d-8a35-40fb-8f6c-b95b20579983 tempest-SnapshotsActionsTest-190824735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b54ddd8a-ed09-476d-ab56-5c670754268a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:17:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6195e70d-8a35-40fb-8f6c-b95b20579983 tempest-SnapshotsActionsTest-190824735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.a677b6ba-e2f0-443f-a83c-0d3ac65d3f3d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:40 devstack sudo[93407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.a677b6ba-e2f0-443f-a83c-0d3ac65d3f3d Aug 31 15:17:40 devstack sudo[93407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:41 devstack sudo[93407]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6195e70d-8a35-40fb-8f6c-b95b20579983 tempest-SnapshotsActionsTest-190824735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.a677b6ba-e2f0-443f-a83c-0d3ac65d3f3d" returned: 0 in 0.608s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6195e70d-8a35-40fb-8f6c-b95b20579983 tempest-SnapshotsActionsTest-190824735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.a677b6ba-e2f0-443f-a83c-0d3ac65d3f3d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:41 devstack sudo[93431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.a677b6ba-e2f0-443f-a83c-0d3ac65d3f3d Aug 31 15:17:41 devstack sudo[93431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:41 devstack sudo[93431]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6195e70d-8a35-40fb-8f6c-b95b20579983 tempest-SnapshotsActionsTest-190824735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.a677b6ba-e2f0-443f-a83c-0d3ac65d3f3d" returned: 0 in 0.443s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:42 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6195e70d-8a35-40fb-8f6c-b95b20579983 tempest-SnapshotsActionsTest-190824735 None] Lock "cinder-quobyte-a677b6ba-e2f0-443f-a83c-0d3ac65d3f3d" released by "_delete_snapshot" :: held 1.987s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:17:42 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6195e70d-8a35-40fb-8f6c-b95b20579983 tempest-SnapshotsActionsTest-190824735 None] Lock "cinder-quobyte-b54ddd8a-ed09-476d-ab56-5c670754268a" released by "delete_snapshot" :: held 2.014s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:17:42 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-6195e70d-8a35-40fb-8f6c-b95b20579983 tempest-SnapshotsActionsTest-190824735 None] Created reservations ['8f4e9979-3c14-464c-b64a-77e503c43b0c', 'd1af9f18-c6d5-4b68-9f8b-8d87138cd7b0', '4b4e8857-4e50-4686-92e1-e887f7a7f515', 'edefbb87-acdd-41a6-ad61-26bea13b4a73'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:17:42 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-6195e70d-8a35-40fb-8f6c-b95b20579983 tempest-SnapshotsActionsTest-190824735 None] Delete snapshot completed successfully. Aug 31 15:17:42 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6195e70d-8a35-40fb-8f6c-b95b20579983 tempest-SnapshotsActionsTest-190824735 None] Lock "cinder-a677b6ba-e2f0-443f-a83c-0d3ac65d3f3d-delete_snapshot" released by "delete_snapshot" :: held 2.477s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:17:42 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ab7355c-41b6-4cfd-8a7f-f446d0268c83 tempest-AttachVolumeNegativeTest-1548450425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:17:42 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5ab7355c-41b6-4cfd-8a7f-f446d0268c83 tempest-AttachVolumeNegativeTest-1548450425 None] Flow 'volume_create_manager' (6f9f3469-fd28-4cd3-8cd8-215947683c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:17:42 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5ab7355c-41b6-4cfd-8a7f-f446d0268c83 tempest-AttachVolumeNegativeTest-1548450425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (764cad8e-0c33-42f3-9e65-4bcc16dd6381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:17:42 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5ab7355c-41b6-4cfd-8a7f-f446d0268c83 tempest-AttachVolumeNegativeTest-1548450425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (764cad8e-0c33-42f3-9e65-4bcc16dd6381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1136206574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38937e4f-81b8-4984-bf96-0980c09b1678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32c0ba9f9fcb4b72adfe9348cc89b3f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:17:43Z,use_quota=True,user_id='e9851aff44c84b328eef6abb7e631932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:17:42 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5ab7355c-41b6-4cfd-8a7f-f446d0268c83 tempest-AttachVolumeNegativeTest-1548450425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ee5abc8-d416-4779-aaf4-445625a51750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:17:42 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5ab7355c-41b6-4cfd-8a7f-f446d0268c83 tempest-AttachVolumeNegativeTest-1548450425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ee5abc8-d416-4779-aaf4-445625a51750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:17:42 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5ab7355c-41b6-4cfd-8a7f-f446d0268c83 tempest-AttachVolumeNegativeTest-1548450425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9cb372b-0244-408f-ae3d-a58c3c37b8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:17:42 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5ab7355c-41b6-4cfd-8a7f-f446d0268c83 tempest-AttachVolumeNegativeTest-1548450425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9cb372b-0244-408f-ae3d-a58c3c37b8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38937e4f-81b8-4984-bf96-0980c09b1678', 'volume_name': 'volume-38937e4f-81b8-4984-bf96-0980c09b1678', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:17:42 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5ab7355c-41b6-4cfd-8a7f-f446d0268c83 tempest-AttachVolumeNegativeTest-1548450425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb717e91-c676-4791-8762-6ed830c7a416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:17:42 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5ab7355c-41b6-4cfd-8a7f-f446d0268c83 tempest-AttachVolumeNegativeTest-1548450425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb717e91-c676-4791-8762-6ed830c7a416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:17:42 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5ab7355c-41b6-4cfd-8a7f-f446d0268c83 tempest-AttachVolumeNegativeTest-1548450425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5791576f-a4dc-40e6-b238-e42b2f01724e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:17:42 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-5ab7355c-41b6-4cfd-8a7f-f446d0268c83 tempest-AttachVolumeNegativeTest-1548450425 None] Volume 38937e4f-81b8-4984-bf96-0980c09b1678: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38937e4f-81b8-4984-bf96-0980c09b1678', 'volume_size': 1} Aug 31 15:17:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5ab7355c-41b6-4cfd-8a7f-f446d0268c83 tempest-AttachVolumeNegativeTest-1548450425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:17:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5ab7355c-41b6-4cfd-8a7f-f446d0268c83 tempest-AttachVolumeNegativeTest-1548450425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:17:42 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5ab7355c-41b6-4cfd-8a7f-f446d0268c83 tempest-AttachVolumeNegativeTest-1548450425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1136206574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38937e4f-81b8-4984-bf96-0980c09b1678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32c0ba9f9fcb4b72adfe9348cc89b3f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:17:43Z,use_quota=True,user_id='e9851aff44c84b328eef6abb7e631932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:17:42 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-5ab7355c-41b6-4cfd-8a7f-f446d0268c83 tempest-AttachVolumeNegativeTest-1548450425 None] Creating volume 38937e4f-81b8-4984-bf96-0980c09b1678 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:17:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5ab7355c-41b6-4cfd-8a7f-f446d0268c83 tempest-AttachVolumeNegativeTest-1548450425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:17:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5ab7355c-41b6-4cfd-8a7f-f446d0268c83 tempest-AttachVolumeNegativeTest-1548450425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:17:42 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5ab7355c-41b6-4cfd-8a7f-f446d0268c83 tempest-AttachVolumeNegativeTest-1548450425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:17:42 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5ab7355c-41b6-4cfd-8a7f-f446d0268c83 tempest-AttachVolumeNegativeTest-1548450425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:17:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5ab7355c-41b6-4cfd-8a7f-f446d0268c83 tempest-AttachVolumeNegativeTest-1548450425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:17:42 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5ab7355c-41b6-4cfd-8a7f-f446d0268c83 tempest-AttachVolumeNegativeTest-1548450425 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:17:42 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-5ab7355c-41b6-4cfd-8a7f-f446d0268c83 tempest-AttachVolumeNegativeTest-1548450425 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:17:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5ab7355c-41b6-4cfd-8a7f-f446d0268c83 tempest-AttachVolumeNegativeTest-1548450425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-38937e4f-81b8-4984-bf96-0980c09b1678 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:42 devstack sudo[93459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-38937e4f-81b8-4984-bf96-0980c09b1678 1073741824 Aug 31 15:17:42 devstack sudo[93459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:43 devstack sudo[93459]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5ab7355c-41b6-4cfd-8a7f-f446d0268c83 tempest-AttachVolumeNegativeTest-1548450425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-38937e4f-81b8-4984-bf96-0980c09b1678 1073741824" returned: 0 in 0.708s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5ab7355c-41b6-4cfd-8a7f-f446d0268c83 tempest-AttachVolumeNegativeTest-1548450425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-38937e4f-81b8-4984-bf96-0980c09b1678 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:43 devstack sudo[93468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-38937e4f-81b8-4984-bf96-0980c09b1678 Aug 31 15:17:43 devstack sudo[93468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-efae2de1-a305-44f5-a785-39c1a2c2ef2f tempest-SnapshotsActionsTest-2022183587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:17:43 devstack sudo[93468]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5ab7355c-41b6-4cfd-8a7f-f446d0268c83 tempest-AttachVolumeNegativeTest-1548450425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-38937e4f-81b8-4984-bf96-0980c09b1678" returned: 0 in 0.411s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:43 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5ab7355c-41b6-4cfd-8a7f-f446d0268c83 tempest-AttachVolumeNegativeTest-1548450425 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:17:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5ab7355c-41b6-4cfd-8a7f-f446d0268c83 tempest-AttachVolumeNegativeTest-1548450425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:17:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-efae2de1-a305-44f5-a785-39c1a2c2ef2f tempest-SnapshotsActionsTest-2022183587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.012s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:17:43 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5ab7355c-41b6-4cfd-8a7f-f446d0268c83 tempest-AttachVolumeNegativeTest-1548450425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5791576f-a4dc-40e6-b238-e42b2f01724e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38937e4f-81b8-4984-bf96-0980c09b1678', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:17:43 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5ab7355c-41b6-4cfd-8a7f-f446d0268c83 tempest-AttachVolumeNegativeTest-1548450425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6a407eb-49cf-4699-9586-e4895f589aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:17:43 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-efae2de1-a305-44f5-a785-39c1a2c2ef2f tempest-SnapshotsActionsTest-2022183587 None] Creating offline snapshot 2939d544-2ae6-41c2-a5d3-40e0bb4d81b8 of volume b54ddd8a-ed09-476d-ab56-5c670754268a {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:17:44 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-5ab7355c-41b6-4cfd-8a7f-f446d0268c83 tempest-AttachVolumeNegativeTest-1548450425 None] Volume volume-38937e4f-81b8-4984-bf96-0980c09b1678 (38937e4f-81b8-4984-bf96-0980c09b1678): created successfully Aug 31 15:17:44 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5ab7355c-41b6-4cfd-8a7f-f446d0268c83 tempest-AttachVolumeNegativeTest-1548450425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6a407eb-49cf-4699-9586-e4895f589aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:17:44 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5ab7355c-41b6-4cfd-8a7f-f446d0268c83 tempest-AttachVolumeNegativeTest-1548450425 None] Flow 'volume_create_manager' (6f9f3469-fd28-4cd3-8cd8-215947683c94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:17:44 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[246f097a-9d3b-44d3-9112-da822aa7b4b0]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:17:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-efae2de1-a305-44f5-a785-39c1a2c2ef2f tempest-SnapshotsActionsTest-2022183587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:44 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-5ab7355c-41b6-4cfd-8a7f-f446d0268c83 tempest-AttachVolumeNegativeTest-1548450425 None] Created volume successfully. Aug 31 15:17:44 devstack sudo[93472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078 Aug 31 15:17:44 devstack sudo[93472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:44 devstack sudo[93472]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-efae2de1-a305-44f5-a785-39c1a2c2ef2f tempest-SnapshotsActionsTest-2022183587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078" returned: 0 in 0.428s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:44 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-efae2de1-a305-44f5-a785-39c1a2c2ef2f tempest-SnapshotsActionsTest-2022183587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b54ddd8a-ed09-476d-ab56-5c670754268a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:17:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-efae2de1-a305-44f5-a785-39c1a2c2ef2f tempest-SnapshotsActionsTest-2022183587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.2939d544-2ae6-41c2-a5d3-40e0bb4d81b8 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:44 devstack sudo[93481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.2939d544-2ae6-41c2-a5d3-40e0bb4d81b8 1G Aug 31 15:17:44 devstack sudo[93481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:45 devstack cinder-volume[86000]: DEBUG oslo_service.periodic_task [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86000) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:17:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:17:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:17:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:17:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:17:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:17:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:45 devstack sudo[93490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:17:45 devstack sudo[93490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:45 devstack sudo[93481]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-efae2de1-a305-44f5-a785-39c1a2c2ef2f tempest-SnapshotsActionsTest-2022183587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.2939d544-2ae6-41c2-a5d3-40e0bb4d81b8 1G" returned: 0 in 0.612s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-efae2de1-a305-44f5-a785-39c1a2c2ef2f tempest-SnapshotsActionsTest-2022183587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.2939d544-2ae6-41c2-a5d3-40e0bb4d81b8 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:45 devstack sudo[93492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.2939d544-2ae6-41c2-a5d3-40e0bb4d81b8 Aug 31 15:17:45 devstack sudo[93492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:45 devstack sudo[93490]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.451s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:45 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:17:45 devstack cinder-volume[86000]: DEBUG oslo_service.periodic_task [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running periodic task VolumeManager._thread_info {{(pid=86000) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:17:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] thread count: 8 {{(pid=86000) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 31 15:17:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] thread info: [<_MainThread(MainThread, started 137631281086592)>, , , , , , , ] {{(pid=86000) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 31 15:17:45 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5dd9b306-fba9-4bdf-bb02-74a00cc23685 tempest-AttachVolumeShelveTestJSON-1820842392 None] Acquiring lock "cinder-26ebf820-f8b8-40d7-a4d5-2297f4515358-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:17:45 devstack sudo[93492]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-efae2de1-a305-44f5-a785-39c1a2c2ef2f tempest-SnapshotsActionsTest-2022183587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.2939d544-2ae6-41c2-a5d3-40e0bb4d81b8" returned: 0 in 0.525s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:45 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-efae2de1-a305-44f5-a785-39c1a2c2ef2f tempest-SnapshotsActionsTest-2022183587 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.2939d544-2ae6-41c2-a5d3-40e0bb4d81b8 is being set with open permissions: ugo+rw Aug 31 15:17:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-efae2de1-a305-44f5-a785-39c1a2c2ef2f tempest-SnapshotsActionsTest-2022183587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.2939d544-2ae6-41c2-a5d3-40e0bb4d81b8 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:45 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5dd9b306-fba9-4bdf-bb02-74a00cc23685 tempest-AttachVolumeShelveTestJSON-1820842392 None] Lock "cinder-26ebf820-f8b8-40d7-a4d5-2297f4515358-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:17:45 devstack sudo[93506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.2939d544-2ae6-41c2-a5d3-40e0bb4d81b8 Aug 31 15:17:45 devstack sudo[93506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:45 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5dd9b306-fba9-4bdf-bb02-74a00cc23685 tempest-AttachVolumeShelveTestJSON-1820842392 None] Acquiring lock "cinder-quobyte-26ebf820-f8b8-40d7-a4d5-2297f4515358" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:17:45 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5dd9b306-fba9-4bdf-bb02-74a00cc23685 tempest-AttachVolumeShelveTestJSON-1820842392 None] Lock "cinder-quobyte-26ebf820-f8b8-40d7-a4d5-2297f4515358" acquired by "delete_volume" :: waited 0.038s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:17:45 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c91a296-8ceb-4401-9036-e98bbb6d1cb5]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:17:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5dd9b306-fba9-4bdf-bb02-74a00cc23685 tempest-AttachVolumeShelveTestJSON-1820842392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-26ebf820-f8b8-40d7-a4d5-2297f4515358 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-9756f860-0431-4786-8cd3-f67ec9f3e493 req-769575a4-d0b4-49b0-b26f-6dfd5bfbbea1 tempest-AttachVolumeNegativeTest-1548450425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:17:46 devstack sudo[93508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-26ebf820-f8b8-40d7-a4d5-2297f4515358 Aug 31 15:17:46 devstack sudo[93508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:46 devstack sudo[93506]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-efae2de1-a305-44f5-a785-39c1a2c2ef2f tempest-SnapshotsActionsTest-2022183587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.2939d544-2ae6-41c2-a5d3-40e0bb4d81b8" returned: 0 in 0.382s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-efae2de1-a305-44f5-a785-39c1a2c2ef2f tempest-SnapshotsActionsTest-2022183587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.156s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:17:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-9756f860-0431-4786-8cd3-f67ec9f3e493 req-769575a4-d0b4-49b0-b26f-6dfd5bfbbea1 tempest-AttachVolumeNegativeTest-1548450425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.198s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:17:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-9756f860-0431-4786-8cd3-f67ec9f3e493 req-769575a4-d0b4-49b0-b26f-6dfd5bfbbea1 tempest-AttachVolumeNegativeTest-1548450425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:17:46 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-efae2de1-a305-44f5-a785-39c1a2c2ef2f tempest-SnapshotsActionsTest-2022183587 None] Create snapshot completed successfully Aug 31 15:17:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-9756f860-0431-4786-8cd3-f67ec9f3e493 req-769575a4-d0b4-49b0-b26f-6dfd5bfbbea1 tempest-AttachVolumeNegativeTest-1548450425 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77', 'name': 'volume-38937e4f-81b8-4984-bf96-0980c09b1678', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f90e5108-b37e-462d-ac37-425eefe5e9d3', 'enforce_multipath': True} {{(pid=86000) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 31 15:17:46 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-9756f860-0431-4786-8cd3-f67ec9f3e493 req-769575a4-d0b4-49b0-b26f-6dfd5bfbbea1 tempest-AttachVolumeNegativeTest-1548450425 None] attachment_update completed successfully. Aug 31 15:17:46 devstack sudo[93508]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5dd9b306-fba9-4bdf-bb02-74a00cc23685 tempest-AttachVolumeShelveTestJSON-1820842392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-26ebf820-f8b8-40d7-a4d5-2297f4515358" returned: 0 in 0.483s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5dd9b306-fba9-4bdf-bb02-74a00cc23685 tempest-AttachVolumeShelveTestJSON-1820842392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-26ebf820-f8b8-40d7-a4d5-2297f4515358 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:46 devstack sudo[93516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-26ebf820-f8b8-40d7-a4d5-2297f4515358 Aug 31 15:17:46 devstack sudo[93516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:46 devstack sudo[93516]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5dd9b306-fba9-4bdf-bb02-74a00cc23685 tempest-AttachVolumeShelveTestJSON-1820842392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-26ebf820-f8b8-40d7-a4d5-2297f4515358" returned: 0 in 0.297s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:46 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5dd9b306-fba9-4bdf-bb02-74a00cc23685 tempest-AttachVolumeShelveTestJSON-1820842392 None] Lock "cinder-quobyte-26ebf820-f8b8-40d7-a4d5-2297f4515358" released by "delete_volume" :: held 0.840s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:17:46 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-5dd9b306-fba9-4bdf-bb02-74a00cc23685 tempest-AttachVolumeShelveTestJSON-1820842392 None] Created reservations ['728afb27-9e66-4c91-a8c3-77230f5accbe', '3a503c7d-b3b8-49d2-bfdc-02ebf4ee9ae8', 'f106618b-c348-4801-930f-005f5e4add3f', '2d679d58-7c5b-4718-94c2-fa101352e5c6'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:17:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5dd9b306-fba9-4bdf-bb02-74a00cc23685 tempest-AttachVolumeShelveTestJSON-1820842392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:17:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5dd9b306-fba9-4bdf-bb02-74a00cc23685 tempest-AttachVolumeShelveTestJSON-1820842392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:17:46 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5dd9b306-fba9-4bdf-bb02-74a00cc23685 tempest-AttachVolumeShelveTestJSON-1820842392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:17:46 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5dd9b306-fba9-4bdf-bb02-74a00cc23685 tempest-AttachVolumeShelveTestJSON-1820842392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:17:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5dd9b306-fba9-4bdf-bb02-74a00cc23685 tempest-AttachVolumeShelveTestJSON-1820842392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:17:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5dd9b306-fba9-4bdf-bb02-74a00cc23685 tempest-AttachVolumeShelveTestJSON-1820842392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:46 devstack sudo[93901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:17:46 devstack sudo[93901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:47 devstack sudo[93901]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5dd9b306-fba9-4bdf-bb02-74a00cc23685 tempest-AttachVolumeShelveTestJSON-1820842392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.369s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:47 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-5dd9b306-fba9-4bdf-bb02-74a00cc23685 tempest-AttachVolumeShelveTestJSON-1820842392 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:17:47 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-5dd9b306-fba9-4bdf-bb02-74a00cc23685 tempest-AttachVolumeShelveTestJSON-1820842392 None] Deleted volume successfully. Aug 31 15:17:47 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5dd9b306-fba9-4bdf-bb02-74a00cc23685 tempest-AttachVolumeShelveTestJSON-1820842392 None] Lock "cinder-26ebf820-f8b8-40d7-a4d5-2297f4515358-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:17:47 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4779ba3a-2125-4800-8247-ca0cddb89f6a tempest-SnapshotsActionsTest-190824735 None] Acquiring lock "cinder-2939d544-2ae6-41c2-a5d3-40e0bb4d81b8-delete_snapshot" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:17:47 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4779ba3a-2125-4800-8247-ca0cddb89f6a tempest-SnapshotsActionsTest-190824735 None] Lock "cinder-2939d544-2ae6-41c2-a5d3-40e0bb4d81b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:17:47 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4779ba3a-2125-4800-8247-ca0cddb89f6a tempest-SnapshotsActionsTest-190824735 None] Acquiring lock "cinder-quobyte-b54ddd8a-ed09-476d-ab56-5c670754268a" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:17:47 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4779ba3a-2125-4800-8247-ca0cddb89f6a tempest-SnapshotsActionsTest-190824735 None] Lock "cinder-quobyte-b54ddd8a-ed09-476d-ab56-5c670754268a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:17:47 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4779ba3a-2125-4800-8247-ca0cddb89f6a tempest-SnapshotsActionsTest-190824735 None] Acquiring lock "cinder-quobyte-2939d544-2ae6-41c2-a5d3-40e0bb4d81b8" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:17:47 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4779ba3a-2125-4800-8247-ca0cddb89f6a tempest-SnapshotsActionsTest-190824735 None] Lock "cinder-quobyte-2939d544-2ae6-41c2-a5d3-40e0bb4d81b8" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:17:47 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-4779ba3a-2125-4800-8247-ca0cddb89f6a tempest-SnapshotsActionsTest-190824735 None] Deleting offline snapshot 2939d544-2ae6-41c2-a5d3-40e0bb4d81b8 of volume b54ddd8a-ed09-476d-ab56-5c670754268a {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:17:47 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-4779ba3a-2125-4800-8247-ca0cddb89f6a tempest-SnapshotsActionsTest-190824735 None] snapshot_file for this snap is: volume-b54ddd8a-ed09-476d-ab56-5c670754268a.2939d544-2ae6-41c2-a5d3-40e0bb4d81b8 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:17:47 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a577fc-03ae-437d-8eff-368f2b71b101]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:17:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4779ba3a-2125-4800-8247-ca0cddb89f6a tempest-SnapshotsActionsTest-190824735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.2939d544-2ae6-41c2-a5d3-40e0bb4d81b8 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:47 devstack sudo[93904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.2939d544-2ae6-41c2-a5d3-40e0bb4d81b8 Aug 31 15:17:47 devstack sudo[93904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:47 devstack sudo[93904]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4779ba3a-2125-4800-8247-ca0cddb89f6a tempest-SnapshotsActionsTest-190824735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.2939d544-2ae6-41c2-a5d3-40e0bb4d81b8" returned: 0 in 0.481s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:47 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-4779ba3a-2125-4800-8247-ca0cddb89f6a tempest-SnapshotsActionsTest-190824735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b54ddd8a-ed09-476d-ab56-5c670754268a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:17:47 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c87497-c428-47f2-b634-d17f759e99bd]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:17:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4779ba3a-2125-4800-8247-ca0cddb89f6a tempest-SnapshotsActionsTest-190824735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:48 devstack sudo[93909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078 Aug 31 15:17:48 devstack sudo[93909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:48 devstack sudo[93909]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4779ba3a-2125-4800-8247-ca0cddb89f6a tempest-SnapshotsActionsTest-190824735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078" returned: 0 in 0.498s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:48 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-4779ba3a-2125-4800-8247-ca0cddb89f6a tempest-SnapshotsActionsTest-190824735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b54ddd8a-ed09-476d-ab56-5c670754268a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:17:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4779ba3a-2125-4800-8247-ca0cddb89f6a tempest-SnapshotsActionsTest-190824735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.2939d544-2ae6-41c2-a5d3-40e0bb4d81b8 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:48 devstack sudo[93914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.2939d544-2ae6-41c2-a5d3-40e0bb4d81b8 Aug 31 15:17:48 devstack sudo[93914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:48 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-a402bb30-9660-451c-8ebe-323c957bb3b7 req-b15903ac-e0ff-4f58-9d24-1727d300259c tempest-AttachVolumeNegativeTest-1548450425 None] Terminate volume connection completed successfully. Aug 31 15:17:48 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-a402bb30-9660-451c-8ebe-323c957bb3b7 req-b15903ac-e0ff-4f58-9d24-1727d300259c tempest-AttachVolumeNegativeTest-1548450425 None] Deleting attachment f90e5108-b37e-462d-ac37-425eefe5e9d3. {{(pid=86000) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 31 15:17:48 devstack sudo[93914]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4779ba3a-2125-4800-8247-ca0cddb89f6a tempest-SnapshotsActionsTest-190824735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.2939d544-2ae6-41c2-a5d3-40e0bb4d81b8" returned: 0 in 0.524s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4779ba3a-2125-4800-8247-ca0cddb89f6a tempest-SnapshotsActionsTest-190824735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.2939d544-2ae6-41c2-a5d3-40e0bb4d81b8 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:48 devstack sudo[93947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.2939d544-2ae6-41c2-a5d3-40e0bb4d81b8 Aug 31 15:17:48 devstack sudo[93947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:49 devstack sudo[93947]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4779ba3a-2125-4800-8247-ca0cddb89f6a tempest-SnapshotsActionsTest-190824735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.2939d544-2ae6-41c2-a5d3-40e0bb4d81b8" returned: 0 in 0.276s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:49 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4779ba3a-2125-4800-8247-ca0cddb89f6a tempest-SnapshotsActionsTest-190824735 None] Lock "cinder-quobyte-2939d544-2ae6-41c2-a5d3-40e0bb4d81b8" released by "_delete_snapshot" :: held 1.913s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:17:49 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4779ba3a-2125-4800-8247-ca0cddb89f6a tempest-SnapshotsActionsTest-190824735 None] Lock "cinder-quobyte-b54ddd8a-ed09-476d-ab56-5c670754268a" released by "delete_snapshot" :: held 1.950s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:17:49 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-4779ba3a-2125-4800-8247-ca0cddb89f6a tempest-SnapshotsActionsTest-190824735 None] Created reservations ['183efd00-1b05-4ea7-b1b7-8f0dff524c52', '18a1972c-ae83-46c6-8f78-2130c2cbbcc8', 'd0c1e2dd-5a8d-457c-891b-e6123a2d029b', 'cc926735-c217-418d-bc6a-cfcdad21a1bf'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:17:49 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-4779ba3a-2125-4800-8247-ca0cddb89f6a tempest-SnapshotsActionsTest-190824735 None] Delete snapshot completed successfully. Aug 31 15:17:49 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4779ba3a-2125-4800-8247-ca0cddb89f6a tempest-SnapshotsActionsTest-190824735 None] Lock "cinder-2939d544-2ae6-41c2-a5d3-40e0bb4d81b8-delete_snapshot" released by "delete_snapshot" :: held 2.125s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:17:49 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:17:49 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Flow 'volume_create_manager' (ffbb5357-7ef5-4ab8-a28a-b22c4d10ec99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:17:49 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15be399d-2ab0-4df7-b075-cbe8017a1cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:17:49 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15be399d-2ab0-4df7-b075-cbe8017a1cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2098798717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ead9bc3-ff41-4835-9ae5-e094a887962c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d51adb80a5c745e2b42f7a484d7120a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:17:50Z,use_quota=True,user_id='0e451b482e4e4febae00cdbf8361fcaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:17:49 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2237be2e-ae5f-411a-b3c1-ac2a2c59deba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:17:49 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2237be2e-ae5f-411a-b3c1-ac2a2c59deba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:17:49 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fd73280-1718-470c-96d9-ca60b03da2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:17:49 devstack cinder-volume[86000]: DEBUG cinder.image.glance [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Creating Keystone auth plugin from conf {{(pid=86000) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 31 15:17:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fd73280-1718-470c-96d9-ca60b03da2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2ead9bc3-ff41-4835-9ae5-e094a887962c', 'volume_name': 'volume-2ead9bc3-ff41-4835-9ae5-e094a887962c', 'volume_size': 1, 'image_id': '20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '567fd89339ed4743bca5bfab8ec3766d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'created_at': datetime.datetime(2026, 8, 31, 13, 6, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 13, 6, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20bdf4f4-1731-4a30-8e37-8e698c01bf5d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:17:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53ee2bef-bd76-4d9a-91dd-8a47ca87c00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:17:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53ee2bef-bd76-4d9a-91dd-8a47ca87c00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:17:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5c4f968-0210-46cc-9bcf-1547e25be409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:17:50 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Volume 2ead9bc3-ff41-4835-9ae5-e094a887962c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2ead9bc3-ff41-4835-9ae5-e094a887962c', 'volume_size': 1, 'image_id': '20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '567fd89339ed4743bca5bfab8ec3766d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'created_at': datetime.datetime(2026, 8, 31, 13, 6, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 13, 6, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20bdf4f4-1731-4a30-8e37-8e698c01bf5d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 31 15:17:50 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Trying to clone 2ead9bc3-ff41-4835-9ae5-e094a887962c from image 20bdf4f4-1731-4a30-8e37-8e698c01bf5d at location (None, [{'url': 'file:///opt/stack/data/glance/images/20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'metadata': {}}]). {{(pid=86000) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 31 15:17:51 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b5584fd9-cfd9-4859-982b-4e51a9d4968a tempest-SnapshotsActionsTest-2022183587 None] Acquiring lock "cinder-5c25c8a4-be3b-47b4-b8ef-ea461fcd9078-delete_snapshot" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:17:51 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b5584fd9-cfd9-4859-982b-4e51a9d4968a tempest-SnapshotsActionsTest-2022183587 None] Lock "cinder-5c25c8a4-be3b-47b4-b8ef-ea461fcd9078-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:17:51 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b5584fd9-cfd9-4859-982b-4e51a9d4968a tempest-SnapshotsActionsTest-2022183587 None] Acquiring lock "cinder-quobyte-b54ddd8a-ed09-476d-ab56-5c670754268a" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:17:51 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b5584fd9-cfd9-4859-982b-4e51a9d4968a tempest-SnapshotsActionsTest-2022183587 None] Lock "cinder-quobyte-b54ddd8a-ed09-476d-ab56-5c670754268a" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:17:51 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b5584fd9-cfd9-4859-982b-4e51a9d4968a tempest-SnapshotsActionsTest-2022183587 None] Acquiring lock "cinder-quobyte-5c25c8a4-be3b-47b4-b8ef-ea461fcd9078" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:17:51 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b5584fd9-cfd9-4859-982b-4e51a9d4968a tempest-SnapshotsActionsTest-2022183587 None] Lock "cinder-quobyte-5c25c8a4-be3b-47b4-b8ef-ea461fcd9078" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:17:51 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-b5584fd9-cfd9-4859-982b-4e51a9d4968a tempest-SnapshotsActionsTest-2022183587 None] Deleting offline snapshot 5c25c8a4-be3b-47b4-b8ef-ea461fcd9078 of volume b54ddd8a-ed09-476d-ab56-5c670754268a {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:17:51 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-b5584fd9-cfd9-4859-982b-4e51a9d4968a tempest-SnapshotsActionsTest-2022183587 None] snapshot_file for this snap is: volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:17:51 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_5eod3f1pdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86000) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 31 15:17:51 devstack cinder-volume[86000]: INFO cinder.image.image_utils [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Image download 20.69 MB at 20.69 MB/s Aug 31 15:17:51 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb8bdbc-70b4-4853-a85b-0c1b4f6957dd]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:17:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b5584fd9-cfd9-4859-982b-4e51a9d4968a tempest-SnapshotsActionsTest-2022183587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:51 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[598adf10-d186-411c-a5ab-4a85121da1a4]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:17:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_5eod3f1pdevstack@QuobyteHD {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:51 devstack sudo[93994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078 Aug 31 15:17:51 devstack sudo[93994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:51 devstack sudo[93995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_5eod3f1pdevstack@QuobyteHD Aug 31 15:17:51 devstack sudo[93995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:51 devstack sudo[93994]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b5584fd9-cfd9-4859-982b-4e51a9d4968a tempest-SnapshotsActionsTest-2022183587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078" returned: 0 in 0.481s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:51 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-b5584fd9-cfd9-4859-982b-4e51a9d4968a tempest-SnapshotsActionsTest-2022183587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b54ddd8a-ed09-476d-ab56-5c670754268a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:17:51 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5584b4a-c7c7-4c6f-93d3-af776f8bf0db]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:17:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b5584fd9-cfd9-4859-982b-4e51a9d4968a tempest-SnapshotsActionsTest-2022183587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:51 devstack sudo[94003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a Aug 31 15:17:51 devstack sudo[94003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:51 devstack sudo[93995]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_5eod3f1pdevstack@QuobyteHD" returned: 0 in 0.621s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:51 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Temporary image 20bdf4f4-1731-4a30-8e37-8e698c01bf5d is fetched for user 0e451b482e4e4febae00cdbf8361fcaa. {{(pid=86000) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 31 15:17:52 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c22372-94cf-43b6-8850-4bc722ae9d4d]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:17:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_5eod3f1pdevstack@QuobyteHD {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:52 devstack sudo[94009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_5eod3f1pdevstack@QuobyteHD Aug 31 15:17:52 devstack sudo[94009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:52 devstack sudo[94003]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b5584fd9-cfd9-4859-982b-4e51a9d4968a tempest-SnapshotsActionsTest-2022183587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a" returned: 0 in 0.468s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b5584fd9-cfd9-4859-982b-4e51a9d4968a tempest-SnapshotsActionsTest-2022183587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:52 devstack sudo[94014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078 Aug 31 15:17:52 devstack sudo[94014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:52 devstack sudo[94009]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_5eod3f1pdevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:17:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:17:52 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2098798717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ead9bc3-ff41-4835-9ae5-e094a887962c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d51adb80a5c745e2b42f7a484d7120a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:17:50Z,use_quota=True,user_id='0e451b482e4e4febae00cdbf8361fcaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:17:52 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Creating volume 2ead9bc3-ff41-4835-9ae5-e094a887962c {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:17:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:17:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:17:52 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:17:52 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:17:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:17:52 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:17:52 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:17:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2ead9bc3-ff41-4835-9ae5-e094a887962c 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:52 devstack sudo[94019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2ead9bc3-ff41-4835-9ae5-e094a887962c 1073741824 Aug 31 15:17:52 devstack sudo[94019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:52 devstack sudo[94014]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b5584fd9-cfd9-4859-982b-4e51a9d4968a tempest-SnapshotsActionsTest-2022183587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078" returned: 0 in 0.378s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b5584fd9-cfd9-4859-982b-4e51a9d4968a tempest-SnapshotsActionsTest-2022183587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:52 devstack sudo[94025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078 Aug 31 15:17:52 devstack sudo[94025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:52 devstack sudo[94025]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b5584fd9-cfd9-4859-982b-4e51a9d4968a tempest-SnapshotsActionsTest-2022183587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a.5c25c8a4-be3b-47b4-b8ef-ea461fcd9078" returned: 0 in 0.345s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:52 devstack sudo[94019]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2ead9bc3-ff41-4835-9ae5-e094a887962c 1073741824" returned: 0 in 0.570s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:53 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b5584fd9-cfd9-4859-982b-4e51a9d4968a tempest-SnapshotsActionsTest-2022183587 None] Lock "cinder-quobyte-5c25c8a4-be3b-47b4-b8ef-ea461fcd9078" released by "_delete_snapshot" :: held 1.853s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:17:53 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b5584fd9-cfd9-4859-982b-4e51a9d4968a tempest-SnapshotsActionsTest-2022183587 None] Lock "cinder-quobyte-b54ddd8a-ed09-476d-ab56-5c670754268a" released by "delete_snapshot" :: held 1.889s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:17:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2ead9bc3-ff41-4835-9ae5-e094a887962c {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:53 devstack sudo[94032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2ead9bc3-ff41-4835-9ae5-e094a887962c Aug 31 15:17:53 devstack sudo[94032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:53 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-b5584fd9-cfd9-4859-982b-4e51a9d4968a tempest-SnapshotsActionsTest-2022183587 None] Created reservations ['3c9ab780-49e7-4028-add4-d4af08920fd8', '6b113c2c-e03b-4746-8b16-6c1c1de85d3a', '7be22174-dc29-423a-a0ad-d9b32be0de86', 'c2cd1d02-3f9a-48f6-8eae-021823b7a83c'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:17:53 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-b5584fd9-cfd9-4859-982b-4e51a9d4968a tempest-SnapshotsActionsTest-2022183587 None] Delete snapshot completed successfully. Aug 31 15:17:53 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b5584fd9-cfd9-4859-982b-4e51a9d4968a tempest-SnapshotsActionsTest-2022183587 None] Lock "cinder-5c25c8a4-be3b-47b4-b8ef-ea461fcd9078-delete_snapshot" released by "delete_snapshot" :: held 2.186s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:17:53 devstack sudo[94032]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2ead9bc3-ff41-4835-9ae5-e094a887962c" returned: 0 in 0.343s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:53 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:17:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:17:53 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-bfd60b55-d708-4fa3-a03a-f97911ce9721 tempest-SnapshotsActionsTest-2022183587 None] Acquiring lock "cinder-b54ddd8a-ed09-476d-ab56-5c670754268a-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:17:53 devstack cinder-volume[86000]: DEBUG cinder.volume.volume_utils [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Attempting download of 20bdf4f4-1731-4a30-8e37-8e698c01bf5d ((None, [{'url': 'file:///opt/stack/data/glance/images/20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'metadata': {}}])) to volume 2ead9bc3-ff41-4835-9ae5-e094a887962c. {{(pid=86000) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 31 15:17:53 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-bfd60b55-d708-4fa3-a03a-f97911ce9721 tempest-SnapshotsActionsTest-2022183587 None] Lock "cinder-b54ddd8a-ed09-476d-ab56-5c670754268a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:17:53 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96f9fb0-7a76-4adf-89f2-5051e4f99847]: (4, 'raw') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:17:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_cou0zt4t {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:53 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-bfd60b55-d708-4fa3-a03a-f97911ce9721 tempest-SnapshotsActionsTest-2022183587 None] Acquiring lock "cinder-quobyte-b54ddd8a-ed09-476d-ab56-5c670754268a" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:17:53 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-bfd60b55-d708-4fa3-a03a-f97911ce9721 tempest-SnapshotsActionsTest-2022183587 None] Lock "cinder-quobyte-b54ddd8a-ed09-476d-ab56-5c670754268a" acquired by "delete_volume" :: waited 0.037s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:17:53 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[35821992-0e36-479b-97e8-4086edba11c9]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:17:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bfd60b55-d708-4fa3-a03a-f97911ce9721 tempest-SnapshotsActionsTest-2022183587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:53 devstack sudo[94035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_cou0zt4t Aug 31 15:17:53 devstack sudo[94035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:53 devstack sudo[94036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a Aug 31 15:17:53 devstack sudo[94036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:53 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-72b6baea-4d78-4288-b9c2-78a4088e6bad tempest-AttachVolumeNegativeTest-1548450425 None] Acquiring lock "cinder-38937e4f-81b8-4984-bf96-0980c09b1678-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:17:53 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-72b6baea-4d78-4288-b9c2-78a4088e6bad tempest-AttachVolumeNegativeTest-1548450425 None] Lock "cinder-38937e4f-81b8-4984-bf96-0980c09b1678-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:17:53 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-72b6baea-4d78-4288-b9c2-78a4088e6bad tempest-AttachVolumeNegativeTest-1548450425 None] Acquiring lock "cinder-quobyte-38937e4f-81b8-4984-bf96-0980c09b1678" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:17:53 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-72b6baea-4d78-4288-b9c2-78a4088e6bad tempest-AttachVolumeNegativeTest-1548450425 None] Lock "cinder-quobyte-38937e4f-81b8-4984-bf96-0980c09b1678" acquired by "delete_volume" :: waited 0.016s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:17:53 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[df84ff78-d985-48e3-a65c-95af7413ddb6]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:17:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-72b6baea-4d78-4288-b9c2-78a4088e6bad tempest-AttachVolumeNegativeTest-1548450425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-38937e4f-81b8-4984-bf96-0980c09b1678 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:54 devstack sudo[94035]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_cou0zt4t" returned: 0 in 0.526s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_cou0zt4t {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:54 devstack sudo[94039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-38937e4f-81b8-4984-bf96-0980c09b1678 Aug 31 15:17:54 devstack sudo[94039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:54 devstack sudo[94042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_cou0zt4t Aug 31 15:17:54 devstack sudo[94042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:54 devstack sudo[94036]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bfd60b55-d708-4fa3-a03a-f97911ce9721 tempest-SnapshotsActionsTest-2022183587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a" returned: 0 in 0.556s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bfd60b55-d708-4fa3-a03a-f97911ce9721 tempest-SnapshotsActionsTest-2022183587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:54 devstack sudo[94050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a Aug 31 15:17:54 devstack sudo[94050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:54 devstack sudo[94039]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-72b6baea-4d78-4288-b9c2-78a4088e6bad tempest-AttachVolumeNegativeTest-1548450425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-38937e4f-81b8-4984-bf96-0980c09b1678" returned: 0 in 0.446s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-72b6baea-4d78-4288-b9c2-78a4088e6bad tempest-AttachVolumeNegativeTest-1548450425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-38937e4f-81b8-4984-bf96-0980c09b1678 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:54 devstack sudo[94055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-38937e4f-81b8-4984-bf96-0980c09b1678 Aug 31 15:17:54 devstack sudo[94055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:54 devstack sudo[94042]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_cou0zt4t" returned: 1 in 0.395s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_cou0zt4t' failed. Not Retrying. {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 31 15:17:54 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3e8b53-4c4c-4995-8308-32ca56ffa561]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:17:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_5eod3f1pdevstack@QuobyteHD {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:54 devstack sudo[94050]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bfd60b55-d708-4fa3-a03a-f97911ce9721 tempest-SnapshotsActionsTest-2022183587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b54ddd8a-ed09-476d-ab56-5c670754268a" returned: 0 in 0.274s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:54 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-bfd60b55-d708-4fa3-a03a-f97911ce9721 tempest-SnapshotsActionsTest-2022183587 None] Lock "cinder-quobyte-b54ddd8a-ed09-476d-ab56-5c670754268a" released by "delete_volume" :: held 0.911s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:17:54 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-bfd60b55-d708-4fa3-a03a-f97911ce9721 tempest-SnapshotsActionsTest-2022183587 None] Created reservations ['0c779a56-1b55-4069-946b-3a015aa7257e', '85398cc9-2303-4ab3-a4b3-abbaaaf587f5', '37c1f09a-cf30-4b64-863b-72f6be1b7470', '3b1e3888-fbd7-40e5-804f-43fc6209fe36'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:17:54 devstack sudo[94060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_5eod3f1pdevstack@QuobyteHD Aug 31 15:17:54 devstack sudo[94060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:54 devstack sudo[94055]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-72b6baea-4d78-4288-b9c2-78a4088e6bad tempest-AttachVolumeNegativeTest-1548450425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-38937e4f-81b8-4984-bf96-0980c09b1678" returned: 0 in 0.297s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bfd60b55-d708-4fa3-a03a-f97911ce9721 tempest-SnapshotsActionsTest-2022183587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:17:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bfd60b55-d708-4fa3-a03a-f97911ce9721 tempest-SnapshotsActionsTest-2022183587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:17:54 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-bfd60b55-d708-4fa3-a03a-f97911ce9721 tempest-SnapshotsActionsTest-2022183587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:17:54 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-bfd60b55-d708-4fa3-a03a-f97911ce9721 tempest-SnapshotsActionsTest-2022183587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:17:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bfd60b55-d708-4fa3-a03a-f97911ce9721 tempest-SnapshotsActionsTest-2022183587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:17:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bfd60b55-d708-4fa3-a03a-f97911ce9721 tempest-SnapshotsActionsTest-2022183587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:54 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-72b6baea-4d78-4288-b9c2-78a4088e6bad tempest-AttachVolumeNegativeTest-1548450425 None] Lock "cinder-quobyte-38937e4f-81b8-4984-bf96-0980c09b1678" released by "delete_volume" :: held 0.815s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:17:54 devstack sudo[94063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:17:54 devstack sudo[94063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:54 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-72b6baea-4d78-4288-b9c2-78a4088e6bad tempest-AttachVolumeNegativeTest-1548450425 None] Created reservations ['a2877642-8ca2-49e2-815b-00865e5c1473', '1734cff0-6f08-44b0-8440-f0fb9a3d8823', '06db5f4c-334b-4abd-ad71-ae3f8952f61a', '95517cd8-ea57-4e76-a9ba-eeddaa19b6bb'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:17:54 devstack sudo[94060]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_5eod3f1pdevstack@QuobyteHD" returned: 0 in 0.394s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:54 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] 20bdf4f4-1731-4a30-8e37-8e698c01bf5d was qcow2, converting to qcow2 {{(pid=86000) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 31 15:17:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_5eod3f1pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2ead9bc3-ff41-4835-9ae5-e094a887962c {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:54 devstack sudo[94069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_5eod3f1pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2ead9bc3-ff41-4835-9ae5-e094a887962c Aug 31 15:17:54 devstack sudo[94069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-72b6baea-4d78-4288-b9c2-78a4088e6bad tempest-AttachVolumeNegativeTest-1548450425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:17:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-72b6baea-4d78-4288-b9c2-78a4088e6bad tempest-AttachVolumeNegativeTest-1548450425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:17:54 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-72b6baea-4d78-4288-b9c2-78a4088e6bad tempest-AttachVolumeNegativeTest-1548450425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:17:55 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-72b6baea-4d78-4288-b9c2-78a4088e6bad tempest-AttachVolumeNegativeTest-1548450425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:17:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-72b6baea-4d78-4288-b9c2-78a4088e6bad tempest-AttachVolumeNegativeTest-1548450425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:17:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-72b6baea-4d78-4288-b9c2-78a4088e6bad tempest-AttachVolumeNegativeTest-1548450425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:55 devstack sudo[94072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:17:55 devstack sudo[94072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:55 devstack sudo[94063]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bfd60b55-d708-4fa3-a03a-f97911ce9721 tempest-SnapshotsActionsTest-2022183587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.322s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:55 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-bfd60b55-d708-4fa3-a03a-f97911ce9721 tempest-SnapshotsActionsTest-2022183587 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:17:55 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-bfd60b55-d708-4fa3-a03a-f97911ce9721 tempest-SnapshotsActionsTest-2022183587 None] Deleted volume successfully. Aug 31 15:17:55 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-bfd60b55-d708-4fa3-a03a-f97911ce9721 tempest-SnapshotsActionsTest-2022183587 None] Lock "cinder-b54ddd8a-ed09-476d-ab56-5c670754268a-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:17:55 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-c48aae6d-2409-49a4-9af1-208eb657b87a tempest-AttachVolumeNegativeTest-1548450425 None] Acquiring lock "cinder-a87ac511-3281-4961-b04c-1c319cd4715f-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:17:55 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-c48aae6d-2409-49a4-9af1-208eb657b87a tempest-AttachVolumeNegativeTest-1548450425 None] Lock "cinder-a87ac511-3281-4961-b04c-1c319cd4715f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:17:55 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-c48aae6d-2409-49a4-9af1-208eb657b87a tempest-AttachVolumeNegativeTest-1548450425 None] Acquiring lock "cinder-quobyte-a87ac511-3281-4961-b04c-1c319cd4715f" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:17:55 devstack sudo[94072]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-72b6baea-4d78-4288-b9c2-78a4088e6bad tempest-AttachVolumeNegativeTest-1548450425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.381s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:55 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-72b6baea-4d78-4288-b9c2-78a4088e6bad tempest-AttachVolumeNegativeTest-1548450425 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:17:55 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-72b6baea-4d78-4288-b9c2-78a4088e6bad tempest-AttachVolumeNegativeTest-1548450425 None] Deleted volume successfully. Aug 31 15:17:55 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-c48aae6d-2409-49a4-9af1-208eb657b87a tempest-AttachVolumeNegativeTest-1548450425 None] Lock "cinder-quobyte-a87ac511-3281-4961-b04c-1c319cd4715f" acquired by "delete_volume" :: waited 0.027s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:17:55 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-72b6baea-4d78-4288-b9c2-78a4088e6bad tempest-AttachVolumeNegativeTest-1548450425 None] Lock "cinder-38937e4f-81b8-4984-bf96-0980c09b1678-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:17:55 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58670c2-ccf9-4985-bd64-d6be1dc2ac01]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:17:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c48aae6d-2409-49a4-9af1-208eb657b87a tempest-AttachVolumeNegativeTest-1548450425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a87ac511-3281-4961-b04c-1c319cd4715f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:55 devstack sudo[94079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a87ac511-3281-4961-b04c-1c319cd4715f Aug 31 15:17:55 devstack sudo[94079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:55 devstack sudo[94079]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c48aae6d-2409-49a4-9af1-208eb657b87a tempest-AttachVolumeNegativeTest-1548450425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a87ac511-3281-4961-b04c-1c319cd4715f" returned: 0 in 0.474s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c48aae6d-2409-49a4-9af1-208eb657b87a tempest-AttachVolumeNegativeTest-1548450425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a87ac511-3281-4961-b04c-1c319cd4715f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:55 devstack sudo[94088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a87ac511-3281-4961-b04c-1c319cd4715f Aug 31 15:17:55 devstack sudo[94088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:56 devstack sudo[94088]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c48aae6d-2409-49a4-9af1-208eb657b87a tempest-AttachVolumeNegativeTest-1548450425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a87ac511-3281-4961-b04c-1c319cd4715f" returned: 0 in 0.402s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:56 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-c48aae6d-2409-49a4-9af1-208eb657b87a tempest-AttachVolumeNegativeTest-1548450425 None] Lock "cinder-quobyte-a87ac511-3281-4961-b04c-1c319cd4715f" released by "delete_volume" :: held 0.970s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:17:56 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-c48aae6d-2409-49a4-9af1-208eb657b87a tempest-AttachVolumeNegativeTest-1548450425 None] Created reservations ['53f4a94f-aee1-41b9-b42f-f5067ffaf6f9', '4041ae08-a37d-4719-a9f8-0be4014c681f', '9b8eae0a-f476-480d-a185-1bc9668b1f1a', 'bc631e74-9259-419a-b10d-98892209353f'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:17:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c48aae6d-2409-49a4-9af1-208eb657b87a tempest-AttachVolumeNegativeTest-1548450425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:17:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c48aae6d-2409-49a4-9af1-208eb657b87a tempest-AttachVolumeNegativeTest-1548450425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:17:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c48aae6d-2409-49a4-9af1-208eb657b87a tempest-AttachVolumeNegativeTest-1548450425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:17:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c48aae6d-2409-49a4-9af1-208eb657b87a tempest-AttachVolumeNegativeTest-1548450425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:17:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c48aae6d-2409-49a4-9af1-208eb657b87a tempest-AttachVolumeNegativeTest-1548450425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:17:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c48aae6d-2409-49a4-9af1-208eb657b87a tempest-AttachVolumeNegativeTest-1548450425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:56 devstack sudo[94091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:17:56 devstack sudo[94091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:56 devstack sudo[94091]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c48aae6d-2409-49a4-9af1-208eb657b87a tempest-AttachVolumeNegativeTest-1548450425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.294s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:56 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-c48aae6d-2409-49a4-9af1-208eb657b87a tempest-AttachVolumeNegativeTest-1548450425 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:17:56 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-c48aae6d-2409-49a4-9af1-208eb657b87a tempest-AttachVolumeNegativeTest-1548450425 None] Deleted volume successfully. Aug 31 15:17:56 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-c48aae6d-2409-49a4-9af1-208eb657b87a tempest-AttachVolumeNegativeTest-1548450425 None] Lock "cinder-a87ac511-3281-4961-b04c-1c319cd4715f-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:17:57 devstack sudo[94069]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_5eod3f1pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2ead9bc3-ff41-4835-9ae5-e094a887962c" returned: 0 in 2.503s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:57 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_5eod3f1pdevstack@QuobyteHD, size 112.00 MB, duration 2.50 sec, destination /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2ead9bc3-ff41-4835-9ae5-e094a887962c {{(pid=86000) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 31 15:17:57 devstack cinder-volume[86000]: INFO cinder.image.image_utils [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Converted 112.00 MB image at 44.73 MB/s Aug 31 15:17:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2ead9bc3-ff41-4835-9ae5-e094a887962c 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:57 devstack sudo[94094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2ead9bc3-ff41-4835-9ae5-e094a887962c 1G Aug 31 15:17:57 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [req-d7c6efa0-2c81-4329-9cdb-14f3f17b3ef4 req-8cc8edf8-dd90-40d5-8b1f-8f02cb0196e0 tempest-VolumesSnapshotsTestJSON-1242097268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:17:57 devstack sudo[94094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-d7c6efa0-2c81-4329-9cdb-14f3f17b3ef4 req-8cc8edf8-dd90-40d5-8b1f-8f02cb0196e0 tempest-VolumesSnapshotsTestJSON-1242097268 None] Flow 'volume_create_manager' (9ed0bddc-0d9b-4df0-9f92-ff2a5b6f3266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:17:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-d7c6efa0-2c81-4329-9cdb-14f3f17b3ef4 req-8cc8edf8-dd90-40d5-8b1f-8f02cb0196e0 tempest-VolumesSnapshotsTestJSON-1242097268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfd51230-9c08-4bf0-a80a-8750735c310e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:17:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-d7c6efa0-2c81-4329-9cdb-14f3f17b3ef4 req-8cc8edf8-dd90-40d5-8b1f-8f02cb0196e0 tempest-VolumesSnapshotsTestJSON-1242097268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfd51230-9c08-4bf0-a80a-8750735c310e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-775992049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f17fa832-e36a-438a-a618-b4c96c700601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c0ed28ffb604a958ecdd19266b2b0a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:17:57Z,use_quota=True,user_id='a825dd00da32478faf291c935881b029',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:17:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-d7c6efa0-2c81-4329-9cdb-14f3f17b3ef4 req-8cc8edf8-dd90-40d5-8b1f-8f02cb0196e0 tempest-VolumesSnapshotsTestJSON-1242097268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb967654-5c69-4fa6-941d-795c24d72c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:17:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-d7c6efa0-2c81-4329-9cdb-14f3f17b3ef4 req-8cc8edf8-dd90-40d5-8b1f-8f02cb0196e0 tempest-VolumesSnapshotsTestJSON-1242097268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb967654-5c69-4fa6-941d-795c24d72c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:17:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-d7c6efa0-2c81-4329-9cdb-14f3f17b3ef4 req-8cc8edf8-dd90-40d5-8b1f-8f02cb0196e0 tempest-VolumesSnapshotsTestJSON-1242097268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d577c08-51c3-46c5-a121-8f0ec33c0a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:17:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-d7c6efa0-2c81-4329-9cdb-14f3f17b3ef4 req-8cc8edf8-dd90-40d5-8b1f-8f02cb0196e0 tempest-VolumesSnapshotsTestJSON-1242097268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d577c08-51c3-46c5-a121-8f0ec33c0a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f17fa832-e36a-438a-a618-b4c96c700601', 'volume_name': 'volume-f17fa832-e36a-438a-a618-b4c96c700601', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:17:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-d7c6efa0-2c81-4329-9cdb-14f3f17b3ef4 req-8cc8edf8-dd90-40d5-8b1f-8f02cb0196e0 tempest-VolumesSnapshotsTestJSON-1242097268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb4c9576-e1c7-4ff6-bdc8-8cb1a082762e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:17:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-d7c6efa0-2c81-4329-9cdb-14f3f17b3ef4 req-8cc8edf8-dd90-40d5-8b1f-8f02cb0196e0 tempest-VolumesSnapshotsTestJSON-1242097268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb4c9576-e1c7-4ff6-bdc8-8cb1a082762e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:17:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-d7c6efa0-2c81-4329-9cdb-14f3f17b3ef4 req-8cc8edf8-dd90-40d5-8b1f-8f02cb0196e0 tempest-VolumesSnapshotsTestJSON-1242097268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a2a393-1efb-4151-b0dc-4b61db3b1922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:17:57 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [req-d7c6efa0-2c81-4329-9cdb-14f3f17b3ef4 req-8cc8edf8-dd90-40d5-8b1f-8f02cb0196e0 tempest-VolumesSnapshotsTestJSON-1242097268 None] Volume f17fa832-e36a-438a-a618-b4c96c700601: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f17fa832-e36a-438a-a618-b4c96c700601', 'volume_size': 1} Aug 31 15:17:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-d7c6efa0-2c81-4329-9cdb-14f3f17b3ef4 req-8cc8edf8-dd90-40d5-8b1f-8f02cb0196e0 tempest-VolumesSnapshotsTestJSON-1242097268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:17:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-d7c6efa0-2c81-4329-9cdb-14f3f17b3ef4 req-8cc8edf8-dd90-40d5-8b1f-8f02cb0196e0 tempest-VolumesSnapshotsTestJSON-1242097268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:17:57 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [req-d7c6efa0-2c81-4329-9cdb-14f3f17b3ef4 req-8cc8edf8-dd90-40d5-8b1f-8f02cb0196e0 tempest-VolumesSnapshotsTestJSON-1242097268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-775992049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f17fa832-e36a-438a-a618-b4c96c700601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c0ed28ffb604a958ecdd19266b2b0a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:17:57Z,use_quota=True,user_id='a825dd00da32478faf291c935881b029',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:17:57 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [req-d7c6efa0-2c81-4329-9cdb-14f3f17b3ef4 req-8cc8edf8-dd90-40d5-8b1f-8f02cb0196e0 tempest-VolumesSnapshotsTestJSON-1242097268 None] Creating volume f17fa832-e36a-438a-a618-b4c96c700601 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:17:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-d7c6efa0-2c81-4329-9cdb-14f3f17b3ef4 req-8cc8edf8-dd90-40d5-8b1f-8f02cb0196e0 tempest-VolumesSnapshotsTestJSON-1242097268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:17:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-d7c6efa0-2c81-4329-9cdb-14f3f17b3ef4 req-8cc8edf8-dd90-40d5-8b1f-8f02cb0196e0 tempest-VolumesSnapshotsTestJSON-1242097268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:17:57 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [req-d7c6efa0-2c81-4329-9cdb-14f3f17b3ef4 req-8cc8edf8-dd90-40d5-8b1f-8f02cb0196e0 tempest-VolumesSnapshotsTestJSON-1242097268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:17:57 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [req-d7c6efa0-2c81-4329-9cdb-14f3f17b3ef4 req-8cc8edf8-dd90-40d5-8b1f-8f02cb0196e0 tempest-VolumesSnapshotsTestJSON-1242097268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:17:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-d7c6efa0-2c81-4329-9cdb-14f3f17b3ef4 req-8cc8edf8-dd90-40d5-8b1f-8f02cb0196e0 tempest-VolumesSnapshotsTestJSON-1242097268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:17:57 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [req-d7c6efa0-2c81-4329-9cdb-14f3f17b3ef4 req-8cc8edf8-dd90-40d5-8b1f-8f02cb0196e0 tempest-VolumesSnapshotsTestJSON-1242097268 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:17:57 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [req-d7c6efa0-2c81-4329-9cdb-14f3f17b3ef4 req-8cc8edf8-dd90-40d5-8b1f-8f02cb0196e0 tempest-VolumesSnapshotsTestJSON-1242097268 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:17:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-d7c6efa0-2c81-4329-9cdb-14f3f17b3ef4 req-8cc8edf8-dd90-40d5-8b1f-8f02cb0196e0 tempest-VolumesSnapshotsTestJSON-1242097268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:57 devstack sudo[94096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601 1073741824 Aug 31 15:17:57 devstack sudo[94096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:57 devstack sudo[94094]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2ead9bc3-ff41-4835-9ae5-e094a887962c 1G" returned: 0 in 0.393s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:57 devstack cinder-volume[86000]: DEBUG cinder.volume.volume_utils [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Downloaded image 20bdf4f4-1731-4a30-8e37-8e698c01bf5d ((None, [{'url': 'file:///opt/stack/data/glance/images/20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'metadata': {}}])) to volume 2ead9bc3-ff41-4835-9ae5-e094a887962c successfully. {{(pid=86000) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 31 15:17:57 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Temporary image 20bdf4f4-1731-4a30-8e37-8e698c01bf5d for user 0e451b482e4e4febae00cdbf8361fcaa is deleted. {{(pid=86000) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 31 15:17:57 devstack cinder-volume[86000]: DEBUG cinder.volume.volume_utils [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Marking volume 2ead9bc3-ff41-4835-9ae5-e094a887962c as bootable. {{(pid=86000) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 31 15:17:57 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-edcbca4d-13a9-453a-9533-df06cd3e3485 tempest-AttachVolumeNegativeTest-1548450425 None] Acquiring lock "cinder-654b7439-8b11-407e-9ad4-e45081c01d76-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:17:57 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Copying metadata from image 20bdf4f4-1731-4a30-8e37-8e698c01bf5d to 2ead9bc3-ff41-4835-9ae5-e094a887962c. {{(pid=86000) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 31 15:17:57 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Creating volume glance metadata for volume 2ead9bc3-ff41-4835-9ae5-e094a887962c backed by image 20bdf4f4-1731-4a30-8e37-8e698c01bf5d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86000) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 31 15:17:57 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-edcbca4d-13a9-453a-9533-df06cd3e3485 tempest-AttachVolumeNegativeTest-1548450425 None] Lock "cinder-654b7439-8b11-407e-9ad4-e45081c01d76-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:17:57 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-edcbca4d-13a9-453a-9533-df06cd3e3485 tempest-AttachVolumeNegativeTest-1548450425 None] Acquiring lock "cinder-quobyte-654b7439-8b11-407e-9ad4-e45081c01d76" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:17:57 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-edcbca4d-13a9-453a-9533-df06cd3e3485 tempest-AttachVolumeNegativeTest-1548450425 None] Lock "cinder-quobyte-654b7439-8b11-407e-9ad4-e45081c01d76" acquired by "delete_volume" :: waited 0.029s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:17:58 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[392eeb40-05e6-47a0-ae97-46227e67040f]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:17:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-edcbca4d-13a9-453a-9533-df06cd3e3485 tempest-AttachVolumeNegativeTest-1548450425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-654b7439-8b11-407e-9ad4-e45081c01d76 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5c4f968-0210-46cc-9bcf-1547e25be409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ead9bc3-ff41-4835-9ae5-e094a887962c', 'volume_size': 1, 'image_id': '20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '567fd89339ed4743bca5bfab8ec3766d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'created_at': datetime.datetime(2026, 8, 31, 13, 6, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 13, 6, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20bdf4f4-1731-4a30-8e37-8e698c01bf5d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:17:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e328d9e1-a12c-421e-8b1b-b67a47706d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:17:58 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Volume volume-2ead9bc3-ff41-4835-9ae5-e094a887962c (2ead9bc3-ff41-4835-9ae5-e094a887962c): created successfully Aug 31 15:17:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e328d9e1-a12c-421e-8b1b-b67a47706d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:17:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Flow 'volume_create_manager' (ffbb5357-7ef5-4ab8-a28a-b22c4d10ec99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:17:58 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-ec17311b-9e67-4db4-9d60-f7288e791b0d tempest-ServerActionsTestOtherA-1383095791 None] Created volume successfully. Aug 31 15:17:58 devstack sudo[94096]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-d7c6efa0-2c81-4329-9cdb-14f3f17b3ef4 req-8cc8edf8-dd90-40d5-8b1f-8f02cb0196e0 tempest-VolumesSnapshotsTestJSON-1242097268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601 1073741824" returned: 0 in 0.587s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:58 devstack sudo[94106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-654b7439-8b11-407e-9ad4-e45081c01d76 Aug 31 15:17:58 devstack sudo[94106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-d7c6efa0-2c81-4329-9cdb-14f3f17b3ef4 req-8cc8edf8-dd90-40d5-8b1f-8f02cb0196e0 tempest-VolumesSnapshotsTestJSON-1242097268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:58 devstack sudo[94108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601 Aug 31 15:17:58 devstack sudo[94108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:58 devstack sudo[94108]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-d7c6efa0-2c81-4329-9cdb-14f3f17b3ef4 req-8cc8edf8-dd90-40d5-8b1f-8f02cb0196e0 tempest-VolumesSnapshotsTestJSON-1242097268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601" returned: 0 in 0.262s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:58 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [req-d7c6efa0-2c81-4329-9cdb-14f3f17b3ef4 req-8cc8edf8-dd90-40d5-8b1f-8f02cb0196e0 tempest-VolumesSnapshotsTestJSON-1242097268 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:17:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-d7c6efa0-2c81-4329-9cdb-14f3f17b3ef4 req-8cc8edf8-dd90-40d5-8b1f-8f02cb0196e0 tempest-VolumesSnapshotsTestJSON-1242097268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:17:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-d7c6efa0-2c81-4329-9cdb-14f3f17b3ef4 req-8cc8edf8-dd90-40d5-8b1f-8f02cb0196e0 tempest-VolumesSnapshotsTestJSON-1242097268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a2a393-1efb-4151-b0dc-4b61db3b1922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f17fa832-e36a-438a-a618-b4c96c700601', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:17:58 devstack sudo[94106]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-d7c6efa0-2c81-4329-9cdb-14f3f17b3ef4 req-8cc8edf8-dd90-40d5-8b1f-8f02cb0196e0 tempest-VolumesSnapshotsTestJSON-1242097268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55254e2c-cd78-4edc-a107-629fc9870d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:17:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-edcbca4d-13a9-453a-9533-df06cd3e3485 tempest-AttachVolumeNegativeTest-1548450425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-654b7439-8b11-407e-9ad4-e45081c01d76" returned: 0 in 0.479s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-edcbca4d-13a9-453a-9533-df06cd3e3485 tempest-AttachVolumeNegativeTest-1548450425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-654b7439-8b11-407e-9ad4-e45081c01d76 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:58 devstack sudo[94114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-654b7439-8b11-407e-9ad4-e45081c01d76 Aug 31 15:17:58 devstack sudo[94114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:58 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [req-d7c6efa0-2c81-4329-9cdb-14f3f17b3ef4 req-8cc8edf8-dd90-40d5-8b1f-8f02cb0196e0 tempest-VolumesSnapshotsTestJSON-1242097268 None] Volume volume-f17fa832-e36a-438a-a618-b4c96c700601 (f17fa832-e36a-438a-a618-b4c96c700601): created successfully Aug 31 15:17:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-d7c6efa0-2c81-4329-9cdb-14f3f17b3ef4 req-8cc8edf8-dd90-40d5-8b1f-8f02cb0196e0 tempest-VolumesSnapshotsTestJSON-1242097268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55254e2c-cd78-4edc-a107-629fc9870d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:17:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-d7c6efa0-2c81-4329-9cdb-14f3f17b3ef4 req-8cc8edf8-dd90-40d5-8b1f-8f02cb0196e0 tempest-VolumesSnapshotsTestJSON-1242097268 None] Flow 'volume_create_manager' (9ed0bddc-0d9b-4df0-9f92-ff2a5b6f3266) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:17:58 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-d7c6efa0-2c81-4329-9cdb-14f3f17b3ef4 req-8cc8edf8-dd90-40d5-8b1f-8f02cb0196e0 tempest-VolumesSnapshotsTestJSON-1242097268 None] Created volume successfully. Aug 31 15:17:58 devstack sudo[94114]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-edcbca4d-13a9-453a-9533-df06cd3e3485 tempest-AttachVolumeNegativeTest-1548450425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-654b7439-8b11-407e-9ad4-e45081c01d76" returned: 0 in 0.302s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:58 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-edcbca4d-13a9-453a-9533-df06cd3e3485 tempest-AttachVolumeNegativeTest-1548450425 None] Lock "cinder-quobyte-654b7439-8b11-407e-9ad4-e45081c01d76" released by "delete_volume" :: held 0.838s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:17:58 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-edcbca4d-13a9-453a-9533-df06cd3e3485 tempest-AttachVolumeNegativeTest-1548450425 None] Created reservations ['19670875-a5c2-4379-92c1-aa5bd2ba9385', '5987fc37-c8a9-45b5-ad12-bad9565371a0', '843d1728-4400-46b0-8f59-89aaa0fbe196', '8fcbc667-15a4-402d-ac01-f16e151c52ee'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:17:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-edcbca4d-13a9-453a-9533-df06cd3e3485 tempest-AttachVolumeNegativeTest-1548450425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:17:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-edcbca4d-13a9-453a-9533-df06cd3e3485 tempest-AttachVolumeNegativeTest-1548450425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:17:58 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-edcbca4d-13a9-453a-9533-df06cd3e3485 tempest-AttachVolumeNegativeTest-1548450425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:17:58 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-edcbca4d-13a9-453a-9533-df06cd3e3485 tempest-AttachVolumeNegativeTest-1548450425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:17:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-edcbca4d-13a9-453a-9533-df06cd3e3485 tempest-AttachVolumeNegativeTest-1548450425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:17:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-edcbca4d-13a9-453a-9533-df06cd3e3485 tempest-AttachVolumeNegativeTest-1548450425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:17:58 devstack sudo[94117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:17:58 devstack sudo[94117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:17:59 devstack sudo[94117]: pam_unix(sudo:session): session closed for user root Aug 31 15:17:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-edcbca4d-13a9-453a-9533-df06cd3e3485 tempest-AttachVolumeNegativeTest-1548450425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.325s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:17:59 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-edcbca4d-13a9-453a-9533-df06cd3e3485 tempest-AttachVolumeNegativeTest-1548450425 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:17:59 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-edcbca4d-13a9-453a-9533-df06cd3e3485 tempest-AttachVolumeNegativeTest-1548450425 None] Deleted volume successfully. Aug 31 15:17:59 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-edcbca4d-13a9-453a-9533-df06cd3e3485 tempest-AttachVolumeNegativeTest-1548450425 None] Lock "cinder-654b7439-8b11-407e-9ad4-e45081c01d76-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:18:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-8ba6a01f-5ff7-480f-b913-8008416af9b9 req-19566395-339c-4dbc-aafe-5fd8b211c447 tempest-VolumesSnapshotsTestJSON-1242097268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:18:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-8ba6a01f-5ff7-480f-b913-8008416af9b9 req-19566395-339c-4dbc-aafe-5fd8b211c447 tempest-VolumesSnapshotsTestJSON-1242097268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:18:00 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [req-8ba6a01f-5ff7-480f-b913-8008416af9b9 req-19566395-339c-4dbc-aafe-5fd8b211c447 tempest-VolumesSnapshotsTestJSON-1242097268 None] Creating offline snapshot 2d532a21-ff1a-4789-b141-ccb2c05ec956 of volume f17fa832-e36a-438a-a618-b4c96c700601 {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:18:00 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aedd2dd-986a-4305-b46f-5a6aedfc43bf]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:18:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-8ba6a01f-5ff7-480f-b913-8008416af9b9 req-19566395-339c-4dbc-aafe-5fd8b211c447 tempest-VolumesSnapshotsTestJSON-1242097268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:00 devstack sudo[94122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601 Aug 31 15:18:00 devstack sudo[94122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:00 devstack sudo[94122]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-8ba6a01f-5ff7-480f-b913-8008416af9b9 req-19566395-339c-4dbc-aafe-5fd8b211c447 tempest-VolumesSnapshotsTestJSON-1242097268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601" returned: 0 in 0.601s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-8ba6a01f-5ff7-480f-b913-8008416af9b9 req-19566395-339c-4dbc-aafe-5fd8b211c447 tempest-VolumesSnapshotsTestJSON-1242097268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601.2d532a21-ff1a-4789-b141-ccb2c05ec956 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:00 devstack sudo[94129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601.2d532a21-ff1a-4789-b141-ccb2c05ec956 1G Aug 31 15:18:00 devstack sudo[94129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:01 devstack sudo[94129]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-8ba6a01f-5ff7-480f-b913-8008416af9b9 req-19566395-339c-4dbc-aafe-5fd8b211c447 tempest-VolumesSnapshotsTestJSON-1242097268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601.2d532a21-ff1a-4789-b141-ccb2c05ec956 1G" returned: 0 in 0.565s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-8ba6a01f-5ff7-480f-b913-8008416af9b9 req-19566395-339c-4dbc-aafe-5fd8b211c447 tempest-VolumesSnapshotsTestJSON-1242097268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f17fa832-e36a-438a-a618-b4c96c700601 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601.2d532a21-ff1a-4789-b141-ccb2c05ec956 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:01 devstack sudo[94135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f17fa832-e36a-438a-a618-b4c96c700601 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601.2d532a21-ff1a-4789-b141-ccb2c05ec956 Aug 31 15:18:01 devstack sudo[94135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:01 devstack sudo[94135]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-8ba6a01f-5ff7-480f-b913-8008416af9b9 req-19566395-339c-4dbc-aafe-5fd8b211c447 tempest-VolumesSnapshotsTestJSON-1242097268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f17fa832-e36a-438a-a618-b4c96c700601 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601.2d532a21-ff1a-4789-b141-ccb2c05ec956" returned: 0 in 0.474s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:01 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [req-8ba6a01f-5ff7-480f-b913-8008416af9b9 req-19566395-339c-4dbc-aafe-5fd8b211c447 tempest-VolumesSnapshotsTestJSON-1242097268 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601.2d532a21-ff1a-4789-b141-ccb2c05ec956 is being set with open permissions: ugo+rw Aug 31 15:18:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-8ba6a01f-5ff7-480f-b913-8008416af9b9 req-19566395-339c-4dbc-aafe-5fd8b211c447 tempest-VolumesSnapshotsTestJSON-1242097268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601.2d532a21-ff1a-4789-b141-ccb2c05ec956 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:01 devstack sudo[94140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601.2d532a21-ff1a-4789-b141-ccb2c05ec956 Aug 31 15:18:01 devstack sudo[94140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:02 devstack sudo[94140]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-8ba6a01f-5ff7-480f-b913-8008416af9b9 req-19566395-339c-4dbc-aafe-5fd8b211c447 tempest-VolumesSnapshotsTestJSON-1242097268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601.2d532a21-ff1a-4789-b141-ccb2c05ec956" returned: 0 in 0.356s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-8ba6a01f-5ff7-480f-b913-8008416af9b9 req-19566395-339c-4dbc-aafe-5fd8b211c447 tempest-VolumesSnapshotsTestJSON-1242097268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:02 devstack sudo[94145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601.info Aug 31 15:18:02 devstack sudo[94145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-471058e6-02e4-4c62-a7fa-317886241848 req-a78d24c2-5ef8-418e-93ef-84e95368d022 tempest-ServerActionsTestOtherA-1383095791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:18:02 devstack sudo[94145]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-8ba6a01f-5ff7-480f-b913-8008416af9b9 req-19566395-339c-4dbc-aafe-5fd8b211c447 tempest-VolumesSnapshotsTestJSON-1242097268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601.info" returned: 0 in 0.386s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:02 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [req-8ba6a01f-5ff7-480f-b913-8008416af9b9 req-19566395-339c-4dbc-aafe-5fd8b211c447 tempest-VolumesSnapshotsTestJSON-1242097268 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601.info is being set with open permissions: ugo+rw Aug 31 15:18:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-8ba6a01f-5ff7-480f-b913-8008416af9b9 req-19566395-339c-4dbc-aafe-5fd8b211c447 tempest-VolumesSnapshotsTestJSON-1242097268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:02 devstack sudo[94155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601.info Aug 31 15:18:02 devstack sudo[94155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:02 devstack sudo[94155]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-8ba6a01f-5ff7-480f-b913-8008416af9b9 req-19566395-339c-4dbc-aafe-5fd8b211c447 tempest-VolumesSnapshotsTestJSON-1242097268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601.info" returned: 0 in 0.354s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-8ba6a01f-5ff7-480f-b913-8008416af9b9 req-19566395-339c-4dbc-aafe-5fd8b211c447 tempest-VolumesSnapshotsTestJSON-1242097268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.905s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:18:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-471058e6-02e4-4c62-a7fa-317886241848 req-a78d24c2-5ef8-418e-93ef-84e95368d022 tempest-ServerActionsTestOtherA-1383095791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.441s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:18:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-471058e6-02e4-4c62-a7fa-317886241848 req-a78d24c2-5ef8-418e-93ef-84e95368d022 tempest-ServerActionsTestOtherA-1383095791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.046s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:18:03 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-8ba6a01f-5ff7-480f-b913-8008416af9b9 req-19566395-339c-4dbc-aafe-5fd8b211c447 tempest-VolumesSnapshotsTestJSON-1242097268 None] Create snapshot completed successfully Aug 31 15:18:03 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-471058e6-02e4-4c62-a7fa-317886241848 req-a78d24c2-5ef8-418e-93ef-84e95368d022 tempest-ServerActionsTestOtherA-1383095791 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77', 'name': 'volume-2ead9bc3-ff41-4835-9ae5-e094a887962c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '08850893-f32e-4b48-a3cb-6b620ac60f7c', 'enforce_multipath': True} {{(pid=86000) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 31 15:18:03 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-471058e6-02e4-4c62-a7fa-317886241848 req-a78d24c2-5ef8-418e-93ef-84e95368d022 tempest-ServerActionsTestOtherA-1383095791 None] attachment_update completed successfully. Aug 31 15:18:03 devstack cinder-volume[86000]: DEBUG cinder.coordination [req-2a6d1675-d5e6-4c00-b663-070390d16807 req-caafb979-88e4-4378-9598-3b83f5f79ba6 tempest-VolumesSnapshotsTestJSON-1242097268 None] Acquiring lock "cinder-2d532a21-ff1a-4789-b141-ccb2c05ec956-delete_snapshot" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:18:04 devstack cinder-volume[86000]: DEBUG cinder.coordination [req-2a6d1675-d5e6-4c00-b663-070390d16807 req-caafb979-88e4-4378-9598-3b83f5f79ba6 tempest-VolumesSnapshotsTestJSON-1242097268 None] Lock "cinder-2d532a21-ff1a-4789-b141-ccb2c05ec956-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:18:04 devstack cinder-volume[86000]: DEBUG cinder.coordination [req-2a6d1675-d5e6-4c00-b663-070390d16807 req-caafb979-88e4-4378-9598-3b83f5f79ba6 tempest-VolumesSnapshotsTestJSON-1242097268 None] Acquiring lock "cinder-quobyte-f17fa832-e36a-438a-a618-b4c96c700601" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:18:04 devstack cinder-volume[86000]: DEBUG cinder.coordination [req-2a6d1675-d5e6-4c00-b663-070390d16807 req-caafb979-88e4-4378-9598-3b83f5f79ba6 tempest-VolumesSnapshotsTestJSON-1242097268 None] Lock "cinder-quobyte-f17fa832-e36a-438a-a618-b4c96c700601" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:18:04 devstack cinder-volume[86000]: DEBUG cinder.coordination [req-2a6d1675-d5e6-4c00-b663-070390d16807 req-caafb979-88e4-4378-9598-3b83f5f79ba6 tempest-VolumesSnapshotsTestJSON-1242097268 None] Acquiring lock "cinder-quobyte-2d532a21-ff1a-4789-b141-ccb2c05ec956" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:18:04 devstack cinder-volume[86000]: DEBUG cinder.coordination [req-2a6d1675-d5e6-4c00-b663-070390d16807 req-caafb979-88e4-4378-9598-3b83f5f79ba6 tempest-VolumesSnapshotsTestJSON-1242097268 None] Lock "cinder-quobyte-2d532a21-ff1a-4789-b141-ccb2c05ec956" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:18:04 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [req-2a6d1675-d5e6-4c00-b663-070390d16807 req-caafb979-88e4-4378-9598-3b83f5f79ba6 tempest-VolumesSnapshotsTestJSON-1242097268 None] Deleting offline snapshot 2d532a21-ff1a-4789-b141-ccb2c05ec956 of volume f17fa832-e36a-438a-a618-b4c96c700601 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:18:04 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [req-2a6d1675-d5e6-4c00-b663-070390d16807 req-caafb979-88e4-4378-9598-3b83f5f79ba6 tempest-VolumesSnapshotsTestJSON-1242097268 None] snapshot_file for this snap is: volume-f17fa832-e36a-438a-a618-b4c96c700601.2d532a21-ff1a-4789-b141-ccb2c05ec956 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:18:04 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d129c9a-25ff-442e-9d60-1824261c6507]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:18:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-2a6d1675-d5e6-4c00-b663-070390d16807 req-caafb979-88e4-4378-9598-3b83f5f79ba6 tempest-VolumesSnapshotsTestJSON-1242097268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601.2d532a21-ff1a-4789-b141-ccb2c05ec956 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:04 devstack sudo[94158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601.2d532a21-ff1a-4789-b141-ccb2c05ec956 Aug 31 15:18:04 devstack sudo[94158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:04 devstack sudo[94158]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-2a6d1675-d5e6-4c00-b663-070390d16807 req-caafb979-88e4-4378-9598-3b83f5f79ba6 tempest-VolumesSnapshotsTestJSON-1242097268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601.2d532a21-ff1a-4789-b141-ccb2c05ec956" returned: 0 in 0.381s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:04 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [req-2a6d1675-d5e6-4c00-b663-070390d16807 req-caafb979-88e4-4378-9598-3b83f5f79ba6 tempest-VolumesSnapshotsTestJSON-1242097268 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f17fa832-e36a-438a-a618-b4c96c700601(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:18:04 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ce2104-6db6-43fe-9e3e-5722aca14ac9]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:18:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-2a6d1675-d5e6-4c00-b663-070390d16807 req-caafb979-88e4-4378-9598-3b83f5f79ba6 tempest-VolumesSnapshotsTestJSON-1242097268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:04 devstack sudo[94163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601 Aug 31 15:18:04 devstack sudo[94163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:04 devstack sudo[94163]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-2a6d1675-d5e6-4c00-b663-070390d16807 req-caafb979-88e4-4378-9598-3b83f5f79ba6 tempest-VolumesSnapshotsTestJSON-1242097268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601" returned: 0 in 0.417s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-2a6d1675-d5e6-4c00-b663-070390d16807 req-caafb979-88e4-4378-9598-3b83f5f79ba6 tempest-VolumesSnapshotsTestJSON-1242097268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601.2d532a21-ff1a-4789-b141-ccb2c05ec956 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:05 devstack sudo[94169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601.2d532a21-ff1a-4789-b141-ccb2c05ec956 Aug 31 15:18:05 devstack sudo[94169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:05 devstack sudo[94169]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-2a6d1675-d5e6-4c00-b663-070390d16807 req-caafb979-88e4-4378-9598-3b83f5f79ba6 tempest-VolumesSnapshotsTestJSON-1242097268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601.2d532a21-ff1a-4789-b141-ccb2c05ec956" returned: 0 in 0.503s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-2a6d1675-d5e6-4c00-b663-070390d16807 req-caafb979-88e4-4378-9598-3b83f5f79ba6 tempest-VolumesSnapshotsTestJSON-1242097268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601.2d532a21-ff1a-4789-b141-ccb2c05ec956 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:05 devstack sudo[94175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601.2d532a21-ff1a-4789-b141-ccb2c05ec956 Aug 31 15:18:05 devstack sudo[94175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:05 devstack sudo[94175]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-2a6d1675-d5e6-4c00-b663-070390d16807 req-caafb979-88e4-4378-9598-3b83f5f79ba6 tempest-VolumesSnapshotsTestJSON-1242097268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601.2d532a21-ff1a-4789-b141-ccb2c05ec956" returned: 0 in 0.282s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:05 devstack cinder-volume[86000]: DEBUG cinder.coordination [req-2a6d1675-d5e6-4c00-b663-070390d16807 req-caafb979-88e4-4378-9598-3b83f5f79ba6 tempest-VolumesSnapshotsTestJSON-1242097268 None] Lock "cinder-quobyte-2d532a21-ff1a-4789-b141-ccb2c05ec956" released by "_delete_snapshot" :: held 1.744s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:18:05 devstack cinder-volume[86000]: DEBUG cinder.coordination [req-2a6d1675-d5e6-4c00-b663-070390d16807 req-caafb979-88e4-4378-9598-3b83f5f79ba6 tempest-VolumesSnapshotsTestJSON-1242097268 None] Lock "cinder-quobyte-f17fa832-e36a-438a-a618-b4c96c700601" released by "delete_snapshot" :: held 1.777s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:18:05 devstack cinder-volume[86000]: DEBUG cinder.quota [req-2a6d1675-d5e6-4c00-b663-070390d16807 req-caafb979-88e4-4378-9598-3b83f5f79ba6 tempest-VolumesSnapshotsTestJSON-1242097268 None] Created reservations ['bc928b39-b650-4fe6-9391-52759de4e7c7', '9562df33-fdd5-4bba-82fa-f747544e1189', '6f3c86d9-e812-4d07-a354-19c86b0f1703', 'da0f9690-1a3b-443c-88b6-eeaa2d625867'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:18:06 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-2a6d1675-d5e6-4c00-b663-070390d16807 req-caafb979-88e4-4378-9598-3b83f5f79ba6 tempest-VolumesSnapshotsTestJSON-1242097268 None] Delete snapshot completed successfully. Aug 31 15:18:06 devstack cinder-volume[86000]: DEBUG cinder.coordination [req-2a6d1675-d5e6-4c00-b663-070390d16807 req-caafb979-88e4-4378-9598-3b83f5f79ba6 tempest-VolumesSnapshotsTestJSON-1242097268 None] Lock "cinder-2d532a21-ff1a-4789-b141-ccb2c05ec956-delete_snapshot" released by "delete_snapshot" :: held 1.998s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:18:06 devstack cinder-volume[86000]: DEBUG cinder.coordination [req-e0bcf1ed-b8db-413c-ab4d-d3e9eb62f075 req-3bfbfa63-e74f-4edd-8922-70ffe1624c60 tempest-VolumesSnapshotsTestJSON-1242097268 None] Acquiring lock "cinder-f17fa832-e36a-438a-a618-b4c96c700601-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:18:06 devstack cinder-volume[86000]: DEBUG cinder.coordination [req-e0bcf1ed-b8db-413c-ab4d-d3e9eb62f075 req-3bfbfa63-e74f-4edd-8922-70ffe1624c60 tempest-VolumesSnapshotsTestJSON-1242097268 None] Lock "cinder-f17fa832-e36a-438a-a618-b4c96c700601-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:18:06 devstack cinder-volume[86000]: DEBUG cinder.coordination [req-e0bcf1ed-b8db-413c-ab4d-d3e9eb62f075 req-3bfbfa63-e74f-4edd-8922-70ffe1624c60 tempest-VolumesSnapshotsTestJSON-1242097268 None] Acquiring lock "cinder-quobyte-f17fa832-e36a-438a-a618-b4c96c700601" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:18:06 devstack cinder-volume[86000]: DEBUG cinder.coordination [req-e0bcf1ed-b8db-413c-ab4d-d3e9eb62f075 req-3bfbfa63-e74f-4edd-8922-70ffe1624c60 tempest-VolumesSnapshotsTestJSON-1242097268 None] Lock "cinder-quobyte-f17fa832-e36a-438a-a618-b4c96c700601" acquired by "delete_volume" :: waited 0.021s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:18:06 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b4901f-7f95-40f4-95b5-427687787355]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:18:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-e0bcf1ed-b8db-413c-ab4d-d3e9eb62f075 req-3bfbfa63-e74f-4edd-8922-70ffe1624c60 tempest-VolumesSnapshotsTestJSON-1242097268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:06 devstack sudo[94179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601 Aug 31 15:18:06 devstack sudo[94179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:07 devstack sudo[94179]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-e0bcf1ed-b8db-413c-ab4d-d3e9eb62f075 req-3bfbfa63-e74f-4edd-8922-70ffe1624c60 tempest-VolumesSnapshotsTestJSON-1242097268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601" returned: 0 in 0.552s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-e0bcf1ed-b8db-413c-ab4d-d3e9eb62f075 req-3bfbfa63-e74f-4edd-8922-70ffe1624c60 tempest-VolumesSnapshotsTestJSON-1242097268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:07 devstack sudo[94252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601 Aug 31 15:18:07 devstack sudo[94252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:07 devstack sudo[94252]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-e0bcf1ed-b8db-413c-ab4d-d3e9eb62f075 req-3bfbfa63-e74f-4edd-8922-70ffe1624c60 tempest-VolumesSnapshotsTestJSON-1242097268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f17fa832-e36a-438a-a618-b4c96c700601" returned: 0 in 0.489s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:07 devstack cinder-volume[86000]: DEBUG cinder.coordination [req-e0bcf1ed-b8db-413c-ab4d-d3e9eb62f075 req-3bfbfa63-e74f-4edd-8922-70ffe1624c60 tempest-VolumesSnapshotsTestJSON-1242097268 None] Lock "cinder-quobyte-f17fa832-e36a-438a-a618-b4c96c700601" released by "delete_volume" :: held 1.160s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:18:07 devstack cinder-volume[86000]: DEBUG cinder.quota [req-e0bcf1ed-b8db-413c-ab4d-d3e9eb62f075 req-3bfbfa63-e74f-4edd-8922-70ffe1624c60 tempest-VolumesSnapshotsTestJSON-1242097268 None] Created reservations ['629572c6-63e3-413b-afe8-c4dee778db4c', '6e78cb63-0001-4eff-92c8-f42f51306ef3', '220b3447-ff7e-4439-9bc2-b4479514aef9', 'be9aa35a-1645-42f2-82f7-b31b2d777351'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:18:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-e0bcf1ed-b8db-413c-ab4d-d3e9eb62f075 req-3bfbfa63-e74f-4edd-8922-70ffe1624c60 tempest-VolumesSnapshotsTestJSON-1242097268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:18:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-e0bcf1ed-b8db-413c-ab4d-d3e9eb62f075 req-3bfbfa63-e74f-4edd-8922-70ffe1624c60 tempest-VolumesSnapshotsTestJSON-1242097268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:18:08 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [req-e0bcf1ed-b8db-413c-ab4d-d3e9eb62f075 req-3bfbfa63-e74f-4edd-8922-70ffe1624c60 tempest-VolumesSnapshotsTestJSON-1242097268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:18:08 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [req-e0bcf1ed-b8db-413c-ab4d-d3e9eb62f075 req-3bfbfa63-e74f-4edd-8922-70ffe1624c60 tempest-VolumesSnapshotsTestJSON-1242097268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:18:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-e0bcf1ed-b8db-413c-ab4d-d3e9eb62f075 req-3bfbfa63-e74f-4edd-8922-70ffe1624c60 tempest-VolumesSnapshotsTestJSON-1242097268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:18:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-e0bcf1ed-b8db-413c-ab4d-d3e9eb62f075 req-3bfbfa63-e74f-4edd-8922-70ffe1624c60 tempest-VolumesSnapshotsTestJSON-1242097268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:08 devstack sudo[94595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:18:08 devstack sudo[94595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:08 devstack sudo[94595]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-e0bcf1ed-b8db-413c-ab4d-d3e9eb62f075 req-3bfbfa63-e74f-4edd-8922-70ffe1624c60 tempest-VolumesSnapshotsTestJSON-1242097268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.446s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:08 devstack cinder-volume[86000]: DEBUG cinder.manager [req-e0bcf1ed-b8db-413c-ab4d-d3e9eb62f075 req-3bfbfa63-e74f-4edd-8922-70ffe1624c60 tempest-VolumesSnapshotsTestJSON-1242097268 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:18:08 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-e0bcf1ed-b8db-413c-ab4d-d3e9eb62f075 req-3bfbfa63-e74f-4edd-8922-70ffe1624c60 tempest-VolumesSnapshotsTestJSON-1242097268 None] Deleted volume successfully. Aug 31 15:18:08 devstack cinder-volume[86000]: DEBUG cinder.coordination [req-e0bcf1ed-b8db-413c-ab4d-d3e9eb62f075 req-3bfbfa63-e74f-4edd-8922-70ffe1624c60 tempest-VolumesSnapshotsTestJSON-1242097268 None] Lock "cinder-f17fa832-e36a-438a-a618-b4c96c700601-delete_volume" released by "delete_volume" :: held 2.052s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:18:14 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [req-a9fbb5f3-5c75-42f9-9f4c-6dfa4a344512 req-b8c06e22-9725-4299-bb85-1002869df597 tempest-VolumesGetTestJSON-893482716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:18:14 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-a9fbb5f3-5c75-42f9-9f4c-6dfa4a344512 req-b8c06e22-9725-4299-bb85-1002869df597 tempest-VolumesGetTestJSON-893482716 None] Flow 'volume_create_manager' (99e292ad-73a6-44e3-aa47-ec957e795ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:18:14 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-a9fbb5f3-5c75-42f9-9f4c-6dfa4a344512 req-b8c06e22-9725-4299-bb85-1002869df597 tempest-VolumesGetTestJSON-893482716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (358583d5-6847-4a09-8a8e-07f3702920f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:18:14 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-a9fbb5f3-5c75-42f9-9f4c-6dfa4a344512 req-b8c06e22-9725-4299-bb85-1002869df597 tempest-VolumesGetTestJSON-893482716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (358583d5-6847-4a09-8a8e-07f3702920f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1988144338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbd89dbb-a1b6-4772-9665-a677a43bfac5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4b0667c90b664e74bcdc3378229e8372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:18:14Z,use_quota=True,user_id='ff9ebc309bcc4e76917daed2086dc8aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:18:14 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-a9fbb5f3-5c75-42f9-9f4c-6dfa4a344512 req-b8c06e22-9725-4299-bb85-1002869df597 tempest-VolumesGetTestJSON-893482716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab3a3d84-9286-4ed0-b061-7e1645c25613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:18:14 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-a9fbb5f3-5c75-42f9-9f4c-6dfa4a344512 req-b8c06e22-9725-4299-bb85-1002869df597 tempest-VolumesGetTestJSON-893482716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab3a3d84-9286-4ed0-b061-7e1645c25613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:18:14 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-a9fbb5f3-5c75-42f9-9f4c-6dfa4a344512 req-b8c06e22-9725-4299-bb85-1002869df597 tempest-VolumesGetTestJSON-893482716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b447d170-48d5-4076-b655-7a093eb363c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:18:14 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-a9fbb5f3-5c75-42f9-9f4c-6dfa4a344512 req-b8c06e22-9725-4299-bb85-1002869df597 tempest-VolumesGetTestJSON-893482716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b447d170-48d5-4076-b655-7a093eb363c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbd89dbb-a1b6-4772-9665-a677a43bfac5', 'volume_name': 'volume-fbd89dbb-a1b6-4772-9665-a677a43bfac5', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:18:14 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-a9fbb5f3-5c75-42f9-9f4c-6dfa4a344512 req-b8c06e22-9725-4299-bb85-1002869df597 tempest-VolumesGetTestJSON-893482716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c08b1876-768a-4ed2-97c7-ea32e4219a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:18:14 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-a9fbb5f3-5c75-42f9-9f4c-6dfa4a344512 req-b8c06e22-9725-4299-bb85-1002869df597 tempest-VolumesGetTestJSON-893482716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c08b1876-768a-4ed2-97c7-ea32e4219a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:18:14 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-a9fbb5f3-5c75-42f9-9f4c-6dfa4a344512 req-b8c06e22-9725-4299-bb85-1002869df597 tempest-VolumesGetTestJSON-893482716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54a4bdda-0058-4069-ab08-7d5f6b116ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:18:14 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [req-a9fbb5f3-5c75-42f9-9f4c-6dfa4a344512 req-b8c06e22-9725-4299-bb85-1002869df597 tempest-VolumesGetTestJSON-893482716 None] Volume fbd89dbb-a1b6-4772-9665-a677a43bfac5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbd89dbb-a1b6-4772-9665-a677a43bfac5', 'volume_size': 1} Aug 31 15:18:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-a9fbb5f3-5c75-42f9-9f4c-6dfa4a344512 req-b8c06e22-9725-4299-bb85-1002869df597 tempest-VolumesGetTestJSON-893482716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:18:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-a9fbb5f3-5c75-42f9-9f4c-6dfa4a344512 req-b8c06e22-9725-4299-bb85-1002869df597 tempest-VolumesGetTestJSON-893482716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:18:14 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [req-a9fbb5f3-5c75-42f9-9f4c-6dfa4a344512 req-b8c06e22-9725-4299-bb85-1002869df597 tempest-VolumesGetTestJSON-893482716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1988144338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbd89dbb-a1b6-4772-9665-a677a43bfac5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4b0667c90b664e74bcdc3378229e8372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:18:14Z,use_quota=True,user_id='ff9ebc309bcc4e76917daed2086dc8aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:18:14 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [req-a9fbb5f3-5c75-42f9-9f4c-6dfa4a344512 req-b8c06e22-9725-4299-bb85-1002869df597 tempest-VolumesGetTestJSON-893482716 None] Creating volume fbd89dbb-a1b6-4772-9665-a677a43bfac5 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:18:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-a9fbb5f3-5c75-42f9-9f4c-6dfa4a344512 req-b8c06e22-9725-4299-bb85-1002869df597 tempest-VolumesGetTestJSON-893482716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:18:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-a9fbb5f3-5c75-42f9-9f4c-6dfa4a344512 req-b8c06e22-9725-4299-bb85-1002869df597 tempest-VolumesGetTestJSON-893482716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:18:14 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [req-a9fbb5f3-5c75-42f9-9f4c-6dfa4a344512 req-b8c06e22-9725-4299-bb85-1002869df597 tempest-VolumesGetTestJSON-893482716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:18:14 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [req-a9fbb5f3-5c75-42f9-9f4c-6dfa4a344512 req-b8c06e22-9725-4299-bb85-1002869df597 tempest-VolumesGetTestJSON-893482716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:18:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-a9fbb5f3-5c75-42f9-9f4c-6dfa4a344512 req-b8c06e22-9725-4299-bb85-1002869df597 tempest-VolumesGetTestJSON-893482716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:18:14 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [req-a9fbb5f3-5c75-42f9-9f4c-6dfa4a344512 req-b8c06e22-9725-4299-bb85-1002869df597 tempest-VolumesGetTestJSON-893482716 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:18:14 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [req-a9fbb5f3-5c75-42f9-9f4c-6dfa4a344512 req-b8c06e22-9725-4299-bb85-1002869df597 tempest-VolumesGetTestJSON-893482716 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:18:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-a9fbb5f3-5c75-42f9-9f4c-6dfa4a344512 req-b8c06e22-9725-4299-bb85-1002869df597 tempest-VolumesGetTestJSON-893482716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-fbd89dbb-a1b6-4772-9665-a677a43bfac5 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:14 devstack sudo[94633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-fbd89dbb-a1b6-4772-9665-a677a43bfac5 1073741824 Aug 31 15:18:14 devstack sudo[94633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:14 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-77a86f2b-35e1-4773-87ba-35592f490622 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:18:14 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-77a86f2b-35e1-4773-87ba-35592f490622 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Flow 'volume_create_manager' (7e754bf8-eb81-4f2c-b4b0-339fc8ec0361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:18:14 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-77a86f2b-35e1-4773-87ba-35592f490622 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0aa471e-6d13-4765-b7d0-41c764e2824d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:18:14 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-77a86f2b-35e1-4773-87ba-35592f490622 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0aa471e-6d13-4765-b7d0-41c764e2824d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1129367834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74474b42-4d9b-4564-bc16-6ed813428f4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bccd5d0fd9ec4ce49b8e0540a0335f4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:18:15Z,use_quota=True,user_id='f0f74a4cc93547baa2649ea8b1f116e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3836ec5-9d0a-4e20-b781-9a3534363f12),volume_type_id=e3836ec5-9d0a-4e20-b781-9a3534363f12)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:18:14 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-77a86f2b-35e1-4773-87ba-35592f490622 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d53b51-5ded-4404-985b-401edb202c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:18:15 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-77a86f2b-35e1-4773-87ba-35592f490622 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d53b51-5ded-4404-985b-401edb202c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:18:15 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-77a86f2b-35e1-4773-87ba-35592f490622 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3dede2e-1426-437c-8bdb-94bb634bf5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:18:15 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-77a86f2b-35e1-4773-87ba-35592f490622 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3dede2e-1426-437c-8bdb-94bb634bf5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74474b42-4d9b-4564-bc16-6ed813428f4f', 'volume_name': 'volume-74474b42-4d9b-4564-bc16-6ed813428f4f', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:18:15 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-77a86f2b-35e1-4773-87ba-35592f490622 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3546df9a-fcc0-4a41-8a03-e8e7f8a5353e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:18:15 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-77a86f2b-35e1-4773-87ba-35592f490622 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3546df9a-fcc0-4a41-8a03-e8e7f8a5353e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:18:15 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-77a86f2b-35e1-4773-87ba-35592f490622 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc17c6a6-57ba-4e79-b1e8-cf183d914d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:18:15 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-77a86f2b-35e1-4773-87ba-35592f490622 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Volume 74474b42-4d9b-4564-bc16-6ed813428f4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74474b42-4d9b-4564-bc16-6ed813428f4f', 'volume_size': 1} Aug 31 15:18:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-77a86f2b-35e1-4773-87ba-35592f490622 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:18:15 devstack sudo[94633]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-a9fbb5f3-5c75-42f9-9f4c-6dfa4a344512 req-b8c06e22-9725-4299-bb85-1002869df597 tempest-VolumesGetTestJSON-893482716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-fbd89dbb-a1b6-4772-9665-a677a43bfac5 1073741824" returned: 0 in 1.050s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:15 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:SELECT=110,cinder:INSERT=32,cinder:UPDATE=97,cinder:DELETE=9 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:18:15 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:SELECT=109,cinder:UPDATE=116,cinder:DELETE=7,cinder:INSERT=35 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:18:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-a9fbb5f3-5c75-42f9-9f4c-6dfa4a344512 req-b8c06e22-9725-4299-bb85-1002869df597 tempest-VolumesGetTestJSON-893482716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-fbd89dbb-a1b6-4772-9665-a677a43bfac5 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:15 devstack sudo[94662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-fbd89dbb-a1b6-4772-9665-a677a43bfac5 Aug 31 15:18:15 devstack sudo[94662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:16 devstack sudo[94662]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-a9fbb5f3-5c75-42f9-9f4c-6dfa4a344512 req-b8c06e22-9725-4299-bb85-1002869df597 tempest-VolumesGetTestJSON-893482716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-fbd89dbb-a1b6-4772-9665-a677a43bfac5" returned: 0 in 0.597s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:16 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [req-a9fbb5f3-5c75-42f9-9f4c-6dfa4a344512 req-b8c06e22-9725-4299-bb85-1002869df597 tempest-VolumesGetTestJSON-893482716 None] <== create_volume: return (1777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:18:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-a9fbb5f3-5c75-42f9-9f4c-6dfa4a344512 req-b8c06e22-9725-4299-bb85-1002869df597 tempest-VolumesGetTestJSON-893482716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.786s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:18:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-77a86f2b-35e1-4773-87ba-35592f490622 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.437s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:18:16 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-77a86f2b-35e1-4773-87ba-35592f490622 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1129367834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74474b42-4d9b-4564-bc16-6ed813428f4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bccd5d0fd9ec4ce49b8e0540a0335f4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:18:15Z,use_quota=True,user_id='f0f74a4cc93547baa2649ea8b1f116e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3836ec5-9d0a-4e20-b781-9a3534363f12),volume_type_id=e3836ec5-9d0a-4e20-b781-9a3534363f12)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:18:16 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-77a86f2b-35e1-4773-87ba-35592f490622 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Creating volume 74474b42-4d9b-4564-bc16-6ed813428f4f {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:18:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-77a86f2b-35e1-4773-87ba-35592f490622 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:18:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-77a86f2b-35e1-4773-87ba-35592f490622 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:18:16 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-77a86f2b-35e1-4773-87ba-35592f490622 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:18:16 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-77a86f2b-35e1-4773-87ba-35592f490622 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:18:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-77a86f2b-35e1-4773-87ba-35592f490622 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:18:16 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-77a86f2b-35e1-4773-87ba-35592f490622 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:18:16 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-77a86f2b-35e1-4773-87ba-35592f490622 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:18:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-77a86f2b-35e1-4773-87ba-35592f490622 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-74474b42-4d9b-4564-bc16-6ed813428f4f 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-a9fbb5f3-5c75-42f9-9f4c-6dfa4a344512 req-b8c06e22-9725-4299-bb85-1002869df597 tempest-VolumesGetTestJSON-893482716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54a4bdda-0058-4069-ab08-7d5f6b116ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbd89dbb-a1b6-4772-9665-a677a43bfac5', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:18:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-a9fbb5f3-5c75-42f9-9f4c-6dfa4a344512 req-b8c06e22-9725-4299-bb85-1002869df597 tempest-VolumesGetTestJSON-893482716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (980ed951-58b2-4b68-8c12-1816c882b318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:18:16 devstack sudo[94671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-74474b42-4d9b-4564-bc16-6ed813428f4f 1073741824 Aug 31 15:18:16 devstack sudo[94671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:16 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [req-a9fbb5f3-5c75-42f9-9f4c-6dfa4a344512 req-b8c06e22-9725-4299-bb85-1002869df597 tempest-VolumesGetTestJSON-893482716 None] Volume volume-fbd89dbb-a1b6-4772-9665-a677a43bfac5 (fbd89dbb-a1b6-4772-9665-a677a43bfac5): created successfully Aug 31 15:18:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-a9fbb5f3-5c75-42f9-9f4c-6dfa4a344512 req-b8c06e22-9725-4299-bb85-1002869df597 tempest-VolumesGetTestJSON-893482716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (980ed951-58b2-4b68-8c12-1816c882b318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:18:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-a9fbb5f3-5c75-42f9-9f4c-6dfa4a344512 req-b8c06e22-9725-4299-bb85-1002869df597 tempest-VolumesGetTestJSON-893482716 None] Flow 'volume_create_manager' (99e292ad-73a6-44e3-aa47-ec957e795ab9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:18:16 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-a9fbb5f3-5c75-42f9-9f4c-6dfa4a344512 req-b8c06e22-9725-4299-bb85-1002869df597 tempest-VolumesGetTestJSON-893482716 None] Created volume successfully. Aug 31 15:18:17 devstack sudo[94671]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-77a86f2b-35e1-4773-87ba-35592f490622 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-74474b42-4d9b-4564-bc16-6ed813428f4f 1073741824" returned: 0 in 0.842s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-77a86f2b-35e1-4773-87ba-35592f490622 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-74474b42-4d9b-4564-bc16-6ed813428f4f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:17 devstack sudo[94681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-74474b42-4d9b-4564-bc16-6ed813428f4f Aug 31 15:18:17 devstack sudo[94681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:17 devstack sudo[94681]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-77a86f2b-35e1-4773-87ba-35592f490622 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-74474b42-4d9b-4564-bc16-6ed813428f4f" returned: 0 in 0.313s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:17 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-77a86f2b-35e1-4773-87ba-35592f490622 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:18:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-77a86f2b-35e1-4773-87ba-35592f490622 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:18:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-77a86f2b-35e1-4773-87ba-35592f490622 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc17c6a6-57ba-4e79-b1e8-cf183d914d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74474b42-4d9b-4564-bc16-6ed813428f4f', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:18:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-77a86f2b-35e1-4773-87ba-35592f490622 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0db055c5-e625-4ac8-99c3-41186263f762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:18:17 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-77a86f2b-35e1-4773-87ba-35592f490622 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Volume volume-74474b42-4d9b-4564-bc16-6ed813428f4f (74474b42-4d9b-4564-bc16-6ed813428f4f): created successfully Aug 31 15:18:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-77a86f2b-35e1-4773-87ba-35592f490622 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0db055c5-e625-4ac8-99c3-41186263f762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:18:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-77a86f2b-35e1-4773-87ba-35592f490622 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Flow 'volume_create_manager' (7e754bf8-eb81-4f2c-b4b0-339fc8ec0361) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:18:17 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-77a86f2b-35e1-4773-87ba-35592f490622 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Created volume successfully. Aug 31 15:18:18 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-e3d89ebd-aba7-4453-ae13-fb8ef7446a8c tempest-GroupSnapshotsV319Test-1098587674 None] Group tempest-GroupSnapshotsV319Test-Group-1883004545: creating Aug 31 15:18:18 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-e3d89ebd-aba7-4453-ae13-fb8ef7446a8c tempest-GroupSnapshotsV319Test-1098587674 None] Group tempest-GroupSnapshotsV319Test-Group-1883004545: created successfully Aug 31 15:18:18 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-e3d89ebd-aba7-4453-ae13-fb8ef7446a8c tempest-GroupSnapshotsV319Test-1098587674 None] Create group completed successfully. Aug 31 15:18:18 devstack cinder-volume[86000]: DEBUG cinder.coordination [req-fd74cfb9-1551-4c04-b16c-1de3a5560a0a req-877cd026-c7cf-40fb-b102-8c10783dac29 tempest-VolumesGetTestJSON-893482716 None] Acquiring lock "cinder-fbd89dbb-a1b6-4772-9665-a677a43bfac5-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:18:18 devstack cinder-volume[86000]: DEBUG cinder.coordination [req-fd74cfb9-1551-4c04-b16c-1de3a5560a0a req-877cd026-c7cf-40fb-b102-8c10783dac29 tempest-VolumesGetTestJSON-893482716 None] Lock "cinder-fbd89dbb-a1b6-4772-9665-a677a43bfac5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:18:18 devstack cinder-volume[86000]: DEBUG cinder.coordination [req-fd74cfb9-1551-4c04-b16c-1de3a5560a0a req-877cd026-c7cf-40fb-b102-8c10783dac29 tempest-VolumesGetTestJSON-893482716 None] Acquiring lock "cinder-quobyte-fbd89dbb-a1b6-4772-9665-a677a43bfac5" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:18:18 devstack cinder-volume[86000]: DEBUG cinder.coordination [req-fd74cfb9-1551-4c04-b16c-1de3a5560a0a req-877cd026-c7cf-40fb-b102-8c10783dac29 tempest-VolumesGetTestJSON-893482716 None] Lock "cinder-quobyte-fbd89dbb-a1b6-4772-9665-a677a43bfac5" acquired by "delete_volume" :: waited 0.021s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:18:18 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2558a6-a13a-4d2b-80e0-9e3b7d81fa8a]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:18:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-fd74cfb9-1551-4c04-b16c-1de3a5560a0a req-877cd026-c7cf-40fb-b102-8c10783dac29 tempest-VolumesGetTestJSON-893482716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-fbd89dbb-a1b6-4772-9665-a677a43bfac5 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:18 devstack sudo[94686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-fbd89dbb-a1b6-4772-9665-a677a43bfac5 Aug 31 15:18:18 devstack sudo[94686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:19 devstack sudo[94686]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-fd74cfb9-1551-4c04-b16c-1de3a5560a0a req-877cd026-c7cf-40fb-b102-8c10783dac29 tempest-VolumesGetTestJSON-893482716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-fbd89dbb-a1b6-4772-9665-a677a43bfac5" returned: 0 in 0.543s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-fd74cfb9-1551-4c04-b16c-1de3a5560a0a req-877cd026-c7cf-40fb-b102-8c10783dac29 tempest-VolumesGetTestJSON-893482716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-fbd89dbb-a1b6-4772-9665-a677a43bfac5 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:19 devstack sudo[94692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-fbd89dbb-a1b6-4772-9665-a677a43bfac5 Aug 31 15:18:19 devstack sudo[94692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:19 devstack sudo[94692]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-fd74cfb9-1551-4c04-b16c-1de3a5560a0a req-877cd026-c7cf-40fb-b102-8c10783dac29 tempest-VolumesGetTestJSON-893482716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-fbd89dbb-a1b6-4772-9665-a677a43bfac5" returned: 0 in 0.489s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:19 devstack cinder-volume[86000]: DEBUG cinder.coordination [req-fd74cfb9-1551-4c04-b16c-1de3a5560a0a req-877cd026-c7cf-40fb-b102-8c10783dac29 tempest-VolumesGetTestJSON-893482716 None] Lock "cinder-quobyte-fbd89dbb-a1b6-4772-9665-a677a43bfac5" released by "delete_volume" :: held 1.086s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:18:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7109aaa9-e506-471f-a8b1-5a883503ab29 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:18:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7109aaa9-e506-471f-a8b1-5a883503ab29 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:18:19 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-7109aaa9-e506-471f-a8b1-5a883503ab29 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:18:19 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-7109aaa9-e506-471f-a8b1-5a883503ab29 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:18:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7109aaa9-e506-471f-a8b1-5a883503ab29 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:18:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7109aaa9-e506-471f-a8b1-5a883503ab29 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:19 devstack cinder-volume[86000]: DEBUG cinder.quota [req-fd74cfb9-1551-4c04-b16c-1de3a5560a0a req-877cd026-c7cf-40fb-b102-8c10783dac29 tempest-VolumesGetTestJSON-893482716 None] Created reservations ['9fe3953a-1cb3-40db-b517-55667a923af6', '3f745602-e947-4df0-b340-ca03476aeb89', '233d05cd-8d7c-4379-84e6-298ed6ce541a', '221922d3-0ed1-470f-9d55-2a403e320f21'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:18:19 devstack sudo[94696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:18:19 devstack sudo[94696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-fd74cfb9-1551-4c04-b16c-1de3a5560a0a req-877cd026-c7cf-40fb-b102-8c10783dac29 tempest-VolumesGetTestJSON-893482716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:18:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-fd74cfb9-1551-4c04-b16c-1de3a5560a0a req-877cd026-c7cf-40fb-b102-8c10783dac29 tempest-VolumesGetTestJSON-893482716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:18:19 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [req-fd74cfb9-1551-4c04-b16c-1de3a5560a0a req-877cd026-c7cf-40fb-b102-8c10783dac29 tempest-VolumesGetTestJSON-893482716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:18:19 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [req-fd74cfb9-1551-4c04-b16c-1de3a5560a0a req-877cd026-c7cf-40fb-b102-8c10783dac29 tempest-VolumesGetTestJSON-893482716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:18:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-fd74cfb9-1551-4c04-b16c-1de3a5560a0a req-877cd026-c7cf-40fb-b102-8c10783dac29 tempest-VolumesGetTestJSON-893482716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:18:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-fd74cfb9-1551-4c04-b16c-1de3a5560a0a req-877cd026-c7cf-40fb-b102-8c10783dac29 tempest-VolumesGetTestJSON-893482716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:19 devstack sudo[94698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:18:19 devstack sudo[94698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:20 devstack sudo[94698]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-fd74cfb9-1551-4c04-b16c-1de3a5560a0a req-877cd026-c7cf-40fb-b102-8c10783dac29 tempest-VolumesGetTestJSON-893482716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.455s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:20 devstack cinder-volume[86000]: DEBUG cinder.manager [req-fd74cfb9-1551-4c04-b16c-1de3a5560a0a req-877cd026-c7cf-40fb-b102-8c10783dac29 tempest-VolumesGetTestJSON-893482716 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:18:20 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-fd74cfb9-1551-4c04-b16c-1de3a5560a0a req-877cd026-c7cf-40fb-b102-8c10783dac29 tempest-VolumesGetTestJSON-893482716 None] Deleted volume successfully. Aug 31 15:18:20 devstack sudo[94696]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7109aaa9-e506-471f-a8b1-5a883503ab29 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.823s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:20 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-7109aaa9-e506-471f-a8b1-5a883503ab29 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:18:20 devstack cinder-volume[86000]: DEBUG cinder.coordination [req-fd74cfb9-1551-4c04-b16c-1de3a5560a0a req-877cd026-c7cf-40fb-b102-8c10783dac29 tempest-VolumesGetTestJSON-893482716 None] Lock "cinder-fbd89dbb-a1b6-4772-9665-a677a43bfac5-delete_volume" released by "delete_volume" :: held 2.128s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:18:20 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-7109aaa9-e506-471f-a8b1-5a883503ab29 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Retype volume completed successfully. Aug 31 15:18:20 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-cce2c74e-6059-4a87-8e65-9f37b270397f tempest-GroupSnapshotsV319Test-1098587674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:18:20 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cce2c74e-6059-4a87-8e65-9f37b270397f tempest-GroupSnapshotsV319Test-1098587674 None] Flow 'volume_create_manager' (4666337d-7162-4681-afd0-16982fe4fba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:18:20 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cce2c74e-6059-4a87-8e65-9f37b270397f tempest-GroupSnapshotsV319Test-1098587674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deb7b3e7-fdcb-47a7-886f-5d0489c7a169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:18:20 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cce2c74e-6059-4a87-8e65-9f37b270397f tempest-GroupSnapshotsV319Test-1098587674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deb7b3e7-fdcb-47a7-886f-5d0489c7a169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-593074584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4977582b-6272-430d-ac37-67f832499be8,host='devstack@QuobyteHD#QuobyteHD',id=529ea389-7c82-429a-af22-de1d6fa3370e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee950a4bbb2429f9e3312560273f768',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:18:20Z,use_quota=True,user_id='4ca13e8fda1641c893f3f2d9357c9788',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90667cb8-f5b5-47d1-9de5-059dbaf94cb3),volume_type_id=90667cb8-f5b5-47d1-9de5-059dbaf94cb3)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:18:20 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cce2c74e-6059-4a87-8e65-9f37b270397f tempest-GroupSnapshotsV319Test-1098587674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d13ce906-96bb-4db8-ad3d-f8cf4c8b78cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:18:20 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cce2c74e-6059-4a87-8e65-9f37b270397f tempest-GroupSnapshotsV319Test-1098587674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d13ce906-96bb-4db8-ad3d-f8cf4c8b78cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:18:20 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cce2c74e-6059-4a87-8e65-9f37b270397f tempest-GroupSnapshotsV319Test-1098587674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d4da33a-ddd2-4a34-8966-8f55452e6c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:18:20 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cce2c74e-6059-4a87-8e65-9f37b270397f tempest-GroupSnapshotsV319Test-1098587674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d4da33a-ddd2-4a34-8966-8f55452e6c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '529ea389-7c82-429a-af22-de1d6fa3370e', 'volume_name': 'volume-529ea389-7c82-429a-af22-de1d6fa3370e', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:18:20 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cce2c74e-6059-4a87-8e65-9f37b270397f tempest-GroupSnapshotsV319Test-1098587674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca96f298-9901-499e-84d9-9230160a1483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:18:20 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cce2c74e-6059-4a87-8e65-9f37b270397f tempest-GroupSnapshotsV319Test-1098587674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca96f298-9901-499e-84d9-9230160a1483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:18:20 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cce2c74e-6059-4a87-8e65-9f37b270397f tempest-GroupSnapshotsV319Test-1098587674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e165abce-0ba2-4114-9ce3-640ebe92a897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:18:20 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-cce2c74e-6059-4a87-8e65-9f37b270397f tempest-GroupSnapshotsV319Test-1098587674 None] Volume 529ea389-7c82-429a-af22-de1d6fa3370e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-529ea389-7c82-429a-af22-de1d6fa3370e', 'volume_size': 1} Aug 31 15:18:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-cce2c74e-6059-4a87-8e65-9f37b270397f tempest-GroupSnapshotsV319Test-1098587674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:18:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-cce2c74e-6059-4a87-8e65-9f37b270397f tempest-GroupSnapshotsV319Test-1098587674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:18:20 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-cce2c74e-6059-4a87-8e65-9f37b270397f tempest-GroupSnapshotsV319Test-1098587674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4977582b-6272-430d-ac37-67f832499be8,created_at=2026-08-31T13:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-593074584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4977582b-6272-430d-ac37-67f832499be8,host='devstack@QuobyteHD#QuobyteHD',id=529ea389-7c82-429a-af22-de1d6fa3370e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee950a4bbb2429f9e3312560273f768',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:18:20Z,use_quota=True,user_id='4ca13e8fda1641c893f3f2d9357c9788',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90667cb8-f5b5-47d1-9de5-059dbaf94cb3),volume_type_id=90667cb8-f5b5-47d1-9de5-059dbaf94cb3)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:18:20 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-cce2c74e-6059-4a87-8e65-9f37b270397f tempest-GroupSnapshotsV319Test-1098587674 None] Creating volume 529ea389-7c82-429a-af22-de1d6fa3370e {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:18:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-cce2c74e-6059-4a87-8e65-9f37b270397f tempest-GroupSnapshotsV319Test-1098587674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:18:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-cce2c74e-6059-4a87-8e65-9f37b270397f tempest-GroupSnapshotsV319Test-1098587674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:18:20 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-cce2c74e-6059-4a87-8e65-9f37b270397f tempest-GroupSnapshotsV319Test-1098587674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:18:20 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-cce2c74e-6059-4a87-8e65-9f37b270397f tempest-GroupSnapshotsV319Test-1098587674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:18:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-cce2c74e-6059-4a87-8e65-9f37b270397f tempest-GroupSnapshotsV319Test-1098587674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:18:20 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-cce2c74e-6059-4a87-8e65-9f37b270397f tempest-GroupSnapshotsV319Test-1098587674 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:18:20 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-cce2c74e-6059-4a87-8e65-9f37b270397f tempest-GroupSnapshotsV319Test-1098587674 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:18:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cce2c74e-6059-4a87-8e65-9f37b270397f tempest-GroupSnapshotsV319Test-1098587674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:20 devstack sudo[94702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e 1073741824 Aug 31 15:18:20 devstack sudo[94702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:20 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-bb98c390-2244-4f12-85b5-ec1eb186f121 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Acquiring lock "cinder-74474b42-4d9b-4564-bc16-6ed813428f4f-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:18:20 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-bb98c390-2244-4f12-85b5-ec1eb186f121 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Lock "cinder-74474b42-4d9b-4564-bc16-6ed813428f4f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:18:21 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-bb98c390-2244-4f12-85b5-ec1eb186f121 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Acquiring lock "cinder-quobyte-74474b42-4d9b-4564-bc16-6ed813428f4f" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:18:21 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-bb98c390-2244-4f12-85b5-ec1eb186f121 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Lock "cinder-quobyte-74474b42-4d9b-4564-bc16-6ed813428f4f" acquired by "delete_volume" :: waited 0.021s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:18:21 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[121fb614-b192-494d-81cf-48aba48757ff]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:18:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bb98c390-2244-4f12-85b5-ec1eb186f121 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-74474b42-4d9b-4564-bc16-6ed813428f4f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:21 devstack sudo[94704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-74474b42-4d9b-4564-bc16-6ed813428f4f Aug 31 15:18:21 devstack sudo[94704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:21 devstack sudo[94702]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cce2c74e-6059-4a87-8e65-9f37b270397f tempest-GroupSnapshotsV319Test-1098587674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e 1073741824" returned: 0 in 0.806s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cce2c74e-6059-4a87-8e65-9f37b270397f tempest-GroupSnapshotsV319Test-1098587674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:21 devstack sudo[94712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e Aug 31 15:18:21 devstack sudo[94712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:21 devstack sudo[94704]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bb98c390-2244-4f12-85b5-ec1eb186f121 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-74474b42-4d9b-4564-bc16-6ed813428f4f" returned: 0 in 0.689s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bb98c390-2244-4f12-85b5-ec1eb186f121 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-74474b42-4d9b-4564-bc16-6ed813428f4f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:21 devstack sudo[94720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-74474b42-4d9b-4564-bc16-6ed813428f4f Aug 31 15:18:21 devstack sudo[94720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:22 devstack sudo[94712]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cce2c74e-6059-4a87-8e65-9f37b270397f tempest-GroupSnapshotsV319Test-1098587674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e" returned: 0 in 0.508s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:22 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-cce2c74e-6059-4a87-8e65-9f37b270397f tempest-GroupSnapshotsV319Test-1098587674 None] <== create_volume: return (1389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:18:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-cce2c74e-6059-4a87-8e65-9f37b270397f tempest-GroupSnapshotsV319Test-1098587674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:18:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cce2c74e-6059-4a87-8e65-9f37b270397f tempest-GroupSnapshotsV319Test-1098587674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e165abce-0ba2-4114-9ce3-640ebe92a897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-529ea389-7c82-429a-af22-de1d6fa3370e', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:18:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cce2c74e-6059-4a87-8e65-9f37b270397f tempest-GroupSnapshotsV319Test-1098587674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ac7ee2a-c80e-4559-92c1-3a1eaab81210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:18:22 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-cce2c74e-6059-4a87-8e65-9f37b270397f tempest-GroupSnapshotsV319Test-1098587674 None] Volume volume-529ea389-7c82-429a-af22-de1d6fa3370e (529ea389-7c82-429a-af22-de1d6fa3370e): created successfully Aug 31 15:18:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cce2c74e-6059-4a87-8e65-9f37b270397f tempest-GroupSnapshotsV319Test-1098587674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ac7ee2a-c80e-4559-92c1-3a1eaab81210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:18:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cce2c74e-6059-4a87-8e65-9f37b270397f tempest-GroupSnapshotsV319Test-1098587674 None] Flow 'volume_create_manager' (4666337d-7162-4681-afd0-16982fe4fba0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:18:22 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-cce2c74e-6059-4a87-8e65-9f37b270397f tempest-GroupSnapshotsV319Test-1098587674 None] Created volume successfully. Aug 31 15:18:22 devstack sudo[94720]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bb98c390-2244-4f12-85b5-ec1eb186f121 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-74474b42-4d9b-4564-bc16-6ed813428f4f" returned: 0 in 0.605s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:22 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-2f611d16-cf5d-48bf-8c08-43b6ba86d296 req-1e5d6c28-9e16-4179-8728-98bb7c3a5687 tempest-ServerActionsTestOtherA-1383095791 None] Terminate volume connection completed successfully. Aug 31 15:18:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-2f611d16-cf5d-48bf-8c08-43b6ba86d296 req-1e5d6c28-9e16-4179-8728-98bb7c3a5687 tempest-ServerActionsTestOtherA-1383095791 None] Deleting attachment 08850893-f32e-4b48-a3cb-6b620ac60f7c. {{(pid=86000) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 31 15:18:22 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-bb98c390-2244-4f12-85b5-ec1eb186f121 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Lock "cinder-quobyte-74474b42-4d9b-4564-bc16-6ed813428f4f" released by "delete_volume" :: held 1.376s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:18:22 devstack cinder-volume[86000]: WARNING cinder.quota [None req-bb98c390-2244-4f12-85b5-ec1eb186f121 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 31 15:18:22 devstack cinder-volume[86000]: WARNING cinder.quota [None req-bb98c390-2244-4f12-85b5-ec1eb186f121 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 31 15:18:22 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-bb98c390-2244-4f12-85b5-ec1eb186f121 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Created reservations ['a70472dd-52c1-47e2-8b79-e8da86c4d8fd', 'd381c581-7806-42e3-b604-c052c3daffaa', 'd84621ac-f8d6-4b33-9ac2-9154aa5751c5', '328f6d1e-7bcd-4c88-8cdd-6b85409eee52'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:18:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bb98c390-2244-4f12-85b5-ec1eb186f121 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:18:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bb98c390-2244-4f12-85b5-ec1eb186f121 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:18:22 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-bb98c390-2244-4f12-85b5-ec1eb186f121 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:18:22 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-bb98c390-2244-4f12-85b5-ec1eb186f121 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:18:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bb98c390-2244-4f12-85b5-ec1eb186f121 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:18:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bb98c390-2244-4f12-85b5-ec1eb186f121 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:22 devstack sudo[94767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:18:22 devstack sudo[94767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:22 devstack sudo[94767]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bb98c390-2244-4f12-85b5-ec1eb186f121 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.331s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:23 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-bb98c390-2244-4f12-85b5-ec1eb186f121 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:18:23 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-bb98c390-2244-4f12-85b5-ec1eb186f121 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Deleted volume successfully. Aug 31 15:18:23 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-bb98c390-2244-4f12-85b5-ec1eb186f121 tempest-VolumeRetypeWithoutMigrationTest-1792015840 None] Lock "cinder-74474b42-4d9b-4564-bc16-6ed813428f4f-delete_volume" released by "delete_volume" :: held 2.068s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:18:23 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-186deaff-5dae-4b73-a9a7-a12bd1f34247 tempest-GroupSnapshotsV319Test-1098587674 None] GroupSnapshot d2f47777-ca0a-429c-93d0-e25a19838073: creating. Aug 31 15:18:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-186deaff-5dae-4b73-a9a7-a12bd1f34247 tempest-GroupSnapshotsV319Test-1098587674 None] Group snapshot d2f47777-ca0a-429c-93d0-e25a19838073: creating. {{(pid=86000) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 31 15:18:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-186deaff-5dae-4b73-a9a7-a12bd1f34247 tempest-GroupSnapshotsV319Test-1098587674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:18:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-186deaff-5dae-4b73-a9a7-a12bd1f34247 tempest-GroupSnapshotsV319Test-1098587674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:18:23 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-186deaff-5dae-4b73-a9a7-a12bd1f34247 tempest-GroupSnapshotsV319Test-1098587674 None] Creating offline snapshot bc2c859d-76f6-4c9d-9f92-c6bb57006e6d of volume 529ea389-7c82-429a-af22-de1d6fa3370e {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:18:23 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa70c05-a5cb-4bac-99fb-c2e34dd4de75]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:18:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-186deaff-5dae-4b73-a9a7-a12bd1f34247 tempest-GroupSnapshotsV319Test-1098587674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:23 devstack sudo[94771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e Aug 31 15:18:23 devstack sudo[94771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:24 devstack sudo[94771]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-186deaff-5dae-4b73-a9a7-a12bd1f34247 tempest-GroupSnapshotsV319Test-1098587674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e" returned: 0 in 0.472s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-186deaff-5dae-4b73-a9a7-a12bd1f34247 tempest-GroupSnapshotsV319Test-1098587674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e.bc2c859d-76f6-4c9d-9f92-c6bb57006e6d 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:24 devstack sudo[94776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e.bc2c859d-76f6-4c9d-9f92-c6bb57006e6d 1G Aug 31 15:18:24 devstack sudo[94776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-2f611d16-cf5d-48bf-8c08-43b6ba86d296 req-ac74787d-8d30-496b-bf4d-1c579221edea tempest-ServerActionsTestOtherA-1383095791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:18:24 devstack sudo[94776]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-186deaff-5dae-4b73-a9a7-a12bd1f34247 tempest-GroupSnapshotsV319Test-1098587674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e.bc2c859d-76f6-4c9d-9f92-c6bb57006e6d 1G" returned: 0 in 0.614s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-186deaff-5dae-4b73-a9a7-a12bd1f34247 tempest-GroupSnapshotsV319Test-1098587674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-529ea389-7c82-429a-af22-de1d6fa3370e -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e.bc2c859d-76f6-4c9d-9f92-c6bb57006e6d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:24 devstack sudo[94789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-529ea389-7c82-429a-af22-de1d6fa3370e -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e.bc2c859d-76f6-4c9d-9f92-c6bb57006e6d Aug 31 15:18:24 devstack sudo[94789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:25 devstack sudo[94789]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-186deaff-5dae-4b73-a9a7-a12bd1f34247 tempest-GroupSnapshotsV319Test-1098587674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-529ea389-7c82-429a-af22-de1d6fa3370e -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e.bc2c859d-76f6-4c9d-9f92-c6bb57006e6d" returned: 0 in 0.367s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:25 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-186deaff-5dae-4b73-a9a7-a12bd1f34247 tempest-GroupSnapshotsV319Test-1098587674 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e.bc2c859d-76f6-4c9d-9f92-c6bb57006e6d is being set with open permissions: ugo+rw: NotImplementedError Aug 31 15:18:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-186deaff-5dae-4b73-a9a7-a12bd1f34247 tempest-GroupSnapshotsV319Test-1098587674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e.bc2c859d-76f6-4c9d-9f92-c6bb57006e6d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:25 devstack sudo[94794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e.bc2c859d-76f6-4c9d-9f92-c6bb57006e6d Aug 31 15:18:25 devstack sudo[94794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:25 devstack sudo[94794]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-186deaff-5dae-4b73-a9a7-a12bd1f34247 tempest-GroupSnapshotsV319Test-1098587674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e.bc2c859d-76f6-4c9d-9f92-c6bb57006e6d" returned: 0 in 0.271s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-186deaff-5dae-4b73-a9a7-a12bd1f34247 tempest-GroupSnapshotsV319Test-1098587674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:25 devstack sudo[94797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e.info Aug 31 15:18:25 devstack sudo[94797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:25 devstack sudo[94797]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-186deaff-5dae-4b73-a9a7-a12bd1f34247 tempest-GroupSnapshotsV319Test-1098587674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e.info" returned: 0 in 0.282s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:25 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-186deaff-5dae-4b73-a9a7-a12bd1f34247 tempest-GroupSnapshotsV319Test-1098587674 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e.info is being set with open permissions: ugo+rw: NotImplementedError Aug 31 15:18:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-186deaff-5dae-4b73-a9a7-a12bd1f34247 tempest-GroupSnapshotsV319Test-1098587674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:25 devstack sudo[94800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e.info Aug 31 15:18:25 devstack sudo[94800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:25 devstack sudo[94800]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-186deaff-5dae-4b73-a9a7-a12bd1f34247 tempest-GroupSnapshotsV319Test-1098587674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e.info" returned: 0 in 0.261s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-186deaff-5dae-4b73-a9a7-a12bd1f34247 tempest-GroupSnapshotsV319Test-1098587674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.388s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:18:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-2f611d16-cf5d-48bf-8c08-43b6ba86d296 req-ac74787d-8d30-496b-bf4d-1c579221edea tempest-ServerActionsTestOtherA-1383095791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.360s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:18:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-2f611d16-cf5d-48bf-8c08-43b6ba86d296 req-ac74787d-8d30-496b-bf4d-1c579221edea tempest-ServerActionsTestOtherA-1383095791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:18:26 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-2f611d16-cf5d-48bf-8c08-43b6ba86d296 req-ac74787d-8d30-496b-bf4d-1c579221edea tempest-ServerActionsTestOtherA-1383095791 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77', 'name': 'volume-2ead9bc3-ff41-4835-9ae5-e094a887962c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd306de77-6ba4-4382-b8dc-6010c797b985', 'enforce_multipath': True} {{(pid=86000) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 31 15:18:26 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-186deaff-5dae-4b73-a9a7-a12bd1f34247 tempest-GroupSnapshotsV319Test-1098587674 None] group_snapshot d2f47777-ca0a-429c-93d0-e25a19838073: created successfully Aug 31 15:18:26 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-2f611d16-cf5d-48bf-8c08-43b6ba86d296 req-ac74787d-8d30-496b-bf4d-1c579221edea tempest-ServerActionsTestOtherA-1383095791 None] attachment_update completed successfully. Aug 31 15:18:26 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c382cc5f-05ce-4481-908d-a64ac8b32864 tempest-BackendsCapabilitiesAdminTestsJSON-2069318465 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.3757095336914, 'free_capacity_gb': 1774.3757095336914, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86000) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 31 15:18:26 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-37f62145-a707-4f2e-96c7-ed6d4b9b3443 tempest-BackendsCapabilitiesAdminTestsJSON-2069318465 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.3757095336914, 'free_capacity_gb': 1774.3757095336914, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86000) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 31 15:18:27 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-103803ee-e135-4130-9bbd-00d882a8499c tempest-GroupSnapshotsV319Test-1098587674 None] group_snapshot d2f47777-ca0a-429c-93d0-e25a19838073: deleting Aug 31 15:18:27 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-103803ee-e135-4130-9bbd-00d882a8499c tempest-GroupSnapshotsV319Test-1098587674 None] group_snapshot d2f47777-ca0a-429c-93d0-e25a19838073: deleting {{(pid=86000) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 31 15:18:27 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-103803ee-e135-4130-9bbd-00d882a8499c tempest-GroupSnapshotsV319Test-1098587674 None] Acquiring lock "cinder-quobyte-529ea389-7c82-429a-af22-de1d6fa3370e" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:18:27 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-103803ee-e135-4130-9bbd-00d882a8499c tempest-GroupSnapshotsV319Test-1098587674 None] Lock "cinder-quobyte-529ea389-7c82-429a-af22-de1d6fa3370e" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:18:27 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-103803ee-e135-4130-9bbd-00d882a8499c tempest-GroupSnapshotsV319Test-1098587674 None] Acquiring lock "cinder-quobyte-bc2c859d-76f6-4c9d-9f92-c6bb57006e6d" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:18:27 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-103803ee-e135-4130-9bbd-00d882a8499c tempest-GroupSnapshotsV319Test-1098587674 None] Lock "cinder-quobyte-bc2c859d-76f6-4c9d-9f92-c6bb57006e6d" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:18:27 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-103803ee-e135-4130-9bbd-00d882a8499c tempest-GroupSnapshotsV319Test-1098587674 None] Deleting offline snapshot bc2c859d-76f6-4c9d-9f92-c6bb57006e6d of volume 529ea389-7c82-429a-af22-de1d6fa3370e {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:18:28 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-103803ee-e135-4130-9bbd-00d882a8499c tempest-GroupSnapshotsV319Test-1098587674 None] snapshot_file for this snap is: volume-529ea389-7c82-429a-af22-de1d6fa3370e.bc2c859d-76f6-4c9d-9f92-c6bb57006e6d {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:18:28 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[68454a91-65c7-4be1-bf7b-48b5cf2d38f7]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:18:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-103803ee-e135-4130-9bbd-00d882a8499c tempest-GroupSnapshotsV319Test-1098587674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e.bc2c859d-76f6-4c9d-9f92-c6bb57006e6d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:28 devstack sudo[95222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e.bc2c859d-76f6-4c9d-9f92-c6bb57006e6d Aug 31 15:18:28 devstack sudo[95222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:28 devstack sudo[95222]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-103803ee-e135-4130-9bbd-00d882a8499c tempest-GroupSnapshotsV319Test-1098587674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e.bc2c859d-76f6-4c9d-9f92-c6bb57006e6d" returned: 0 in 0.596s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:28 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-103803ee-e135-4130-9bbd-00d882a8499c tempest-GroupSnapshotsV319Test-1098587674 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-529ea389-7c82-429a-af22-de1d6fa3370e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:18:28 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[621ce63d-cd75-4f01-8f75-bb95f474e617]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:18:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-103803ee-e135-4130-9bbd-00d882a8499c tempest-GroupSnapshotsV319Test-1098587674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:28 devstack sudo[95229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e Aug 31 15:18:28 devstack sudo[95229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:29 devstack sudo[95229]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-103803ee-e135-4130-9bbd-00d882a8499c tempest-GroupSnapshotsV319Test-1098587674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e" returned: 0 in 0.707s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-103803ee-e135-4130-9bbd-00d882a8499c tempest-GroupSnapshotsV319Test-1098587674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e.bc2c859d-76f6-4c9d-9f92-c6bb57006e6d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:29 devstack sudo[95237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e.bc2c859d-76f6-4c9d-9f92-c6bb57006e6d Aug 31 15:18:29 devstack sudo[95237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:29 devstack sudo[95237]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-103803ee-e135-4130-9bbd-00d882a8499c tempest-GroupSnapshotsV319Test-1098587674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e.bc2c859d-76f6-4c9d-9f92-c6bb57006e6d" returned: 0 in 0.613s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-103803ee-e135-4130-9bbd-00d882a8499c tempest-GroupSnapshotsV319Test-1098587674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e.bc2c859d-76f6-4c9d-9f92-c6bb57006e6d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:30 devstack sudo[95243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e.bc2c859d-76f6-4c9d-9f92-c6bb57006e6d Aug 31 15:18:30 devstack sudo[95243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:30 devstack sudo[95243]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-103803ee-e135-4130-9bbd-00d882a8499c tempest-GroupSnapshotsV319Test-1098587674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e.bc2c859d-76f6-4c9d-9f92-c6bb57006e6d" returned: 0 in 0.383s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:30 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-103803ee-e135-4130-9bbd-00d882a8499c tempest-GroupSnapshotsV319Test-1098587674 None] Lock "cinder-quobyte-bc2c859d-76f6-4c9d-9f92-c6bb57006e6d" released by "_delete_snapshot" :: held 2.485s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:18:30 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-103803ee-e135-4130-9bbd-00d882a8499c tempest-GroupSnapshotsV319Test-1098587674 None] Lock "cinder-quobyte-529ea389-7c82-429a-af22-de1d6fa3370e" released by "delete_snapshot" :: held 2.528s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:18:30 devstack cinder-volume[86000]: WARNING cinder.quota [None req-103803ee-e135-4130-9bbd-00d882a8499c tempest-GroupSnapshotsV319Test-1098587674 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1116657611 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1116657611, it is now deprecated. Please use the default quota class for default quota. Aug 31 15:18:30 devstack cinder-volume[86000]: WARNING cinder.quota [None req-103803ee-e135-4130-9bbd-00d882a8499c tempest-GroupSnapshotsV319Test-1098587674 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1116657611 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1116657611, it is now deprecated. Please use the default quota class for default quota. Aug 31 15:18:30 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-103803ee-e135-4130-9bbd-00d882a8499c tempest-GroupSnapshotsV319Test-1098587674 None] Created reservations ['59d335d7-c30f-427c-b7cf-a39fd33dc428', '1565b61f-d9a0-411b-973c-e6183dd6a801', 'a65da558-0254-4f97-a972-4efb3973b9e8', 'df243a42-5d7a-4fcd-b091-73a01ea3e17a'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:18:30 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-103803ee-e135-4130-9bbd-00d882a8499c tempest-GroupSnapshotsV319Test-1098587674 None] group_snapshot d2f47777-ca0a-429c-93d0-e25a19838073: deleted successfully Aug 31 15:18:32 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-be589d9c-c85f-4157-9d50-2e61d00b61c3 tempest-GroupSnapshotsV319Test-1098587674 None] Acquiring lock "cinder-quobyte-529ea389-7c82-429a-af22-de1d6fa3370e" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:18:32 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-be589d9c-c85f-4157-9d50-2e61d00b61c3 tempest-GroupSnapshotsV319Test-1098587674 None] Lock "cinder-quobyte-529ea389-7c82-429a-af22-de1d6fa3370e" acquired by "delete_volume" :: waited 0.030s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:18:32 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ccdda3-2e9e-463d-af01-635cac3bf635]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:18:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-be589d9c-c85f-4157-9d50-2e61d00b61c3 tempest-GroupSnapshotsV319Test-1098587674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:32 devstack sudo[95246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e Aug 31 15:18:32 devstack sudo[95246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:32 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-2077603d-304d-44b9-b0f2-8895364e8239 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:18:32 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-2077603d-304d-44b9-b0f2-8895364e8239 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Flow 'volume_create_manager' (f10d1e93-9237-426c-a8a1-3002cc6e2bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:18:32 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-2077603d-304d-44b9-b0f2-8895364e8239 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4b9f887-66ce-460d-94ea-a19775c5f136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:18:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-2077603d-304d-44b9-b0f2-8895364e8239 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4b9f887-66ce-460d-94ea-a19775c5f136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1572772139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=830d355b-92a2-470e-a2f4-be6bdc10231f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8628fe42ce5415da9fca922647b474f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:18:33Z,use_quota=True,user_id='6e85d8afa45547ddb6b4693a24e7a1a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:18:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-2077603d-304d-44b9-b0f2-8895364e8239 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c407d161-3f9e-4749-989f-824877d7f326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:18:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-2077603d-304d-44b9-b0f2-8895364e8239 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c407d161-3f9e-4749-989f-824877d7f326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:18:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-2077603d-304d-44b9-b0f2-8895364e8239 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5638b26-5111-4b9d-ac56-6696e1fd02ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:18:33 devstack sudo[95246]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-2077603d-304d-44b9-b0f2-8895364e8239 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5638b26-5111-4b9d-ac56-6696e1fd02ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '830d355b-92a2-470e-a2f4-be6bdc10231f', 'volume_name': 'volume-830d355b-92a2-470e-a2f4-be6bdc10231f', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:18:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-2077603d-304d-44b9-b0f2-8895364e8239 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdaa645c-2643-4f04-9ec7-5bbd11d23c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:18:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-2077603d-304d-44b9-b0f2-8895364e8239 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdaa645c-2643-4f04-9ec7-5bbd11d23c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:18:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-2077603d-304d-44b9-b0f2-8895364e8239 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c26e0a5-b2c7-4b42-961d-e2c197e01300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:18:33 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-2077603d-304d-44b9-b0f2-8895364e8239 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Volume 830d355b-92a2-470e-a2f4-be6bdc10231f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-830d355b-92a2-470e-a2f4-be6bdc10231f', 'volume_size': 1} Aug 31 15:18:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-2077603d-304d-44b9-b0f2-8895364e8239 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:18:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-2077603d-304d-44b9-b0f2-8895364e8239 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:18:33 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-2077603d-304d-44b9-b0f2-8895364e8239 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1572772139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=830d355b-92a2-470e-a2f4-be6bdc10231f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8628fe42ce5415da9fca922647b474f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:18:33Z,use_quota=True,user_id='6e85d8afa45547ddb6b4693a24e7a1a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:18:33 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-2077603d-304d-44b9-b0f2-8895364e8239 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Creating volume 830d355b-92a2-470e-a2f4-be6bdc10231f {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:18:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-2077603d-304d-44b9-b0f2-8895364e8239 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:18:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-2077603d-304d-44b9-b0f2-8895364e8239 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:18:33 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-2077603d-304d-44b9-b0f2-8895364e8239 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:18:33 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-2077603d-304d-44b9-b0f2-8895364e8239 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:18:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-2077603d-304d-44b9-b0f2-8895364e8239 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:18:33 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-2077603d-304d-44b9-b0f2-8895364e8239 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:18:33 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-2077603d-304d-44b9-b0f2-8895364e8239 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:18:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2077603d-304d-44b9-b0f2-8895364e8239 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-be589d9c-c85f-4157-9d50-2e61d00b61c3 tempest-GroupSnapshotsV319Test-1098587674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e" returned: 0 in 0.918s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-be589d9c-c85f-4157-9d50-2e61d00b61c3 tempest-GroupSnapshotsV319Test-1098587674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:33 devstack sudo[95251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f 1073741824 Aug 31 15:18:33 devstack sudo[95251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:33 devstack sudo[95252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e Aug 31 15:18:33 devstack sudo[95252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:33 devstack sudo[95252]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-be589d9c-c85f-4157-9d50-2e61d00b61c3 tempest-GroupSnapshotsV319Test-1098587674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-529ea389-7c82-429a-af22-de1d6fa3370e" returned: 0 in 0.534s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:33 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-be589d9c-c85f-4157-9d50-2e61d00b61c3 tempest-GroupSnapshotsV319Test-1098587674 None] Lock "cinder-quobyte-529ea389-7c82-429a-af22-de1d6fa3370e" released by "delete_volume" :: held 1.553s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:18:33 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-be589d9c-c85f-4157-9d50-2e61d00b61c3 tempest-GroupSnapshotsV319Test-1098587674 None] Created reservations ['0ac0c2b2-ab73-4c4d-9208-86498fbb8bef'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:18:33 devstack cinder-volume[86000]: WARNING cinder.quota [None req-be589d9c-c85f-4157-9d50-2e61d00b61c3 tempest-GroupSnapshotsV319Test-1098587674 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1116657611 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1116657611, it is now deprecated. Please use the default quota class for default quota. Aug 31 15:18:34 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-be589d9c-c85f-4157-9d50-2e61d00b61c3 tempest-GroupSnapshotsV319Test-1098587674 None] Created reservations ['b71e9a9f-4038-4f88-9842-4df492eac2bf', '6ff6dfc9-6812-4e2f-9bdc-6b1550a5c5c8', 'd7de0601-4464-495b-a0b7-143503b466a3', '446de4d3-44ae-48f1-b669-1d2fa7887ceb'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:18:34 devstack sudo[95251]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2077603d-304d-44b9-b0f2-8895364e8239 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f 1073741824" returned: 0 in 1.031s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-be589d9c-c85f-4157-9d50-2e61d00b61c3 tempest-GroupSnapshotsV319Test-1098587674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:18:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-be589d9c-c85f-4157-9d50-2e61d00b61c3 tempest-GroupSnapshotsV319Test-1098587674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:18:34 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-be589d9c-c85f-4157-9d50-2e61d00b61c3 tempest-GroupSnapshotsV319Test-1098587674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:18:34 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-be589d9c-c85f-4157-9d50-2e61d00b61c3 tempest-GroupSnapshotsV319Test-1098587674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:18:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-be589d9c-c85f-4157-9d50-2e61d00b61c3 tempest-GroupSnapshotsV319Test-1098587674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:18:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-be589d9c-c85f-4157-9d50-2e61d00b61c3 tempest-GroupSnapshotsV319Test-1098587674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2077603d-304d-44b9-b0f2-8895364e8239 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:34 devstack sudo[95260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:18:34 devstack sudo[95260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:34 devstack sudo[95262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f Aug 31 15:18:34 devstack sudo[95262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:34 devstack sudo[95260]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-be589d9c-c85f-4157-9d50-2e61d00b61c3 tempest-GroupSnapshotsV319Test-1098587674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.427s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:34 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-be589d9c-c85f-4157-9d50-2e61d00b61c3 tempest-GroupSnapshotsV319Test-1098587674 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:18:34 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-be589d9c-c85f-4157-9d50-2e61d00b61c3 tempest-GroupSnapshotsV319Test-1098587674 None] Delete group completed successfully. Aug 31 15:18:34 devstack sudo[95262]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2077603d-304d-44b9-b0f2-8895364e8239 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f" returned: 0 in 0.418s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:34 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-2077603d-304d-44b9-b0f2-8895364e8239 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:18:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-2077603d-304d-44b9-b0f2-8895364e8239 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:18:34 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-2077603d-304d-44b9-b0f2-8895364e8239 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c26e0a5-b2c7-4b42-961d-e2c197e01300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-830d355b-92a2-470e-a2f4-be6bdc10231f', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:18:34 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-2077603d-304d-44b9-b0f2-8895364e8239 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43159da9-75fe-4a52-a9d2-448383b08a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:18:34 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-2077603d-304d-44b9-b0f2-8895364e8239 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Volume volume-830d355b-92a2-470e-a2f4-be6bdc10231f (830d355b-92a2-470e-a2f4-be6bdc10231f): created successfully Aug 31 15:18:34 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-2077603d-304d-44b9-b0f2-8895364e8239 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43159da9-75fe-4a52-a9d2-448383b08a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:18:34 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-2077603d-304d-44b9-b0f2-8895364e8239 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Flow 'volume_create_manager' (f10d1e93-9237-426c-a8a1-3002cc6e2bfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:18:34 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-2077603d-304d-44b9-b0f2-8895364e8239 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Created volume successfully. Aug 31 15:18:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bf1311e8-bb8c-43de-a69a-1379c5b73559 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:18:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bf1311e8-bb8c-43de-a69a-1379c5b73559 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:18:35 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-bf1311e8-bb8c-43de-a69a-1379c5b73559 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Creating offline snapshot fa3bcf14-3ee0-43d5-9d3a-c1f3a8af2edf of volume 830d355b-92a2-470e-a2f4-be6bdc10231f {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:18:35 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95e451d-1a03-45f7-821c-ed2db3cbb09b]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:18:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bf1311e8-bb8c-43de-a69a-1379c5b73559 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:35 devstack sudo[95272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f Aug 31 15:18:35 devstack sudo[95272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:36 devstack sudo[95272]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bf1311e8-bb8c-43de-a69a-1379c5b73559 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f" returned: 0 in 0.474s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bf1311e8-bb8c-43de-a69a-1379c5b73559 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f.fa3bcf14-3ee0-43d5-9d3a-c1f3a8af2edf 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:36 devstack sudo[95278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f.fa3bcf14-3ee0-43d5-9d3a-c1f3a8af2edf 1G Aug 31 15:18:36 devstack sudo[95278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:36 devstack sudo[95278]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bf1311e8-bb8c-43de-a69a-1379c5b73559 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f.fa3bcf14-3ee0-43d5-9d3a-c1f3a8af2edf 1G" returned: 0 in 0.533s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bf1311e8-bb8c-43de-a69a-1379c5b73559 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-830d355b-92a2-470e-a2f4-be6bdc10231f -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f.fa3bcf14-3ee0-43d5-9d3a-c1f3a8af2edf {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:36 devstack sudo[95287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-830d355b-92a2-470e-a2f4-be6bdc10231f -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f.fa3bcf14-3ee0-43d5-9d3a-c1f3a8af2edf Aug 31 15:18:36 devstack sudo[95287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:37 devstack sudo[95287]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bf1311e8-bb8c-43de-a69a-1379c5b73559 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-830d355b-92a2-470e-a2f4-be6bdc10231f -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f.fa3bcf14-3ee0-43d5-9d3a-c1f3a8af2edf" returned: 0 in 0.446s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:37 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-bf1311e8-bb8c-43de-a69a-1379c5b73559 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f.fa3bcf14-3ee0-43d5-9d3a-c1f3a8af2edf is being set with open permissions: ugo+rw Aug 31 15:18:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bf1311e8-bb8c-43de-a69a-1379c5b73559 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f.fa3bcf14-3ee0-43d5-9d3a-c1f3a8af2edf {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:37 devstack sudo[95292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f.fa3bcf14-3ee0-43d5-9d3a-c1f3a8af2edf Aug 31 15:18:37 devstack sudo[95292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:37 devstack sudo[95292]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bf1311e8-bb8c-43de-a69a-1379c5b73559 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f.fa3bcf14-3ee0-43d5-9d3a-c1f3a8af2edf" returned: 0 in 0.299s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bf1311e8-bb8c-43de-a69a-1379c5b73559 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:37 devstack sudo[95295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f.info Aug 31 15:18:37 devstack sudo[95295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:37 devstack sudo[95295]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bf1311e8-bb8c-43de-a69a-1379c5b73559 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f.info" returned: 0 in 0.435s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:37 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-bf1311e8-bb8c-43de-a69a-1379c5b73559 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f.info is being set with open permissions: ugo+rw Aug 31 15:18:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bf1311e8-bb8c-43de-a69a-1379c5b73559 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:37 devstack sudo[95298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f.info Aug 31 15:18:37 devstack sudo[95298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:38 devstack sudo[95298]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bf1311e8-bb8c-43de-a69a-1379c5b73559 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f.info" returned: 0 in 0.321s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bf1311e8-bb8c-43de-a69a-1379c5b73559 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.650s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:18:38 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-bf1311e8-bb8c-43de-a69a-1379c5b73559 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Create snapshot completed successfully Aug 31 15:18:39 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-31012923-c0a1-4f4e-8977-e1a9e2e6610c tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Acquiring lock "cinder-fa3bcf14-3ee0-43d5-9d3a-c1f3a8af2edf-delete_snapshot" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:18:39 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-31012923-c0a1-4f4e-8977-e1a9e2e6610c tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Lock "cinder-fa3bcf14-3ee0-43d5-9d3a-c1f3a8af2edf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:18:39 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-31012923-c0a1-4f4e-8977-e1a9e2e6610c tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Acquiring lock "cinder-quobyte-830d355b-92a2-470e-a2f4-be6bdc10231f" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:18:39 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-31012923-c0a1-4f4e-8977-e1a9e2e6610c tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Lock "cinder-quobyte-830d355b-92a2-470e-a2f4-be6bdc10231f" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:18:39 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-31012923-c0a1-4f4e-8977-e1a9e2e6610c tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Acquiring lock "cinder-quobyte-fa3bcf14-3ee0-43d5-9d3a-c1f3a8af2edf" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:18:39 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-31012923-c0a1-4f4e-8977-e1a9e2e6610c tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Lock "cinder-quobyte-fa3bcf14-3ee0-43d5-9d3a-c1f3a8af2edf" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:18:39 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-31012923-c0a1-4f4e-8977-e1a9e2e6610c tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Deleting offline snapshot fa3bcf14-3ee0-43d5-9d3a-c1f3a8af2edf of volume 830d355b-92a2-470e-a2f4-be6bdc10231f {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:18:39 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-31012923-c0a1-4f4e-8977-e1a9e2e6610c tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] snapshot_file for this snap is: volume-830d355b-92a2-470e-a2f4-be6bdc10231f.fa3bcf14-3ee0-43d5-9d3a-c1f3a8af2edf {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:18:39 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e353857-d97f-46f8-b259-d22aa3025dbb]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:18:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-31012923-c0a1-4f4e-8977-e1a9e2e6610c tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f.fa3bcf14-3ee0-43d5-9d3a-c1f3a8af2edf {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:39 devstack sudo[95302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f.fa3bcf14-3ee0-43d5-9d3a-c1f3a8af2edf Aug 31 15:18:39 devstack sudo[95302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:40 devstack sudo[95302]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-31012923-c0a1-4f4e-8977-e1a9e2e6610c tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f.fa3bcf14-3ee0-43d5-9d3a-c1f3a8af2edf" returned: 0 in 0.576s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:40 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-31012923-c0a1-4f4e-8977-e1a9e2e6610c tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-830d355b-92a2-470e-a2f4-be6bdc10231f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:18:40 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[99499789-2817-4023-adaa-bdb9ea9c84a0]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:18:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-31012923-c0a1-4f4e-8977-e1a9e2e6610c tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:40 devstack sudo[95307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f Aug 31 15:18:40 devstack sudo[95307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:40 devstack sudo[95307]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-31012923-c0a1-4f4e-8977-e1a9e2e6610c tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f" returned: 0 in 0.484s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-31012923-c0a1-4f4e-8977-e1a9e2e6610c tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f.fa3bcf14-3ee0-43d5-9d3a-c1f3a8af2edf {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:40 devstack sudo[95312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f.fa3bcf14-3ee0-43d5-9d3a-c1f3a8af2edf Aug 31 15:18:40 devstack sudo[95312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:41 devstack sudo[95312]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-31012923-c0a1-4f4e-8977-e1a9e2e6610c tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f.fa3bcf14-3ee0-43d5-9d3a-c1f3a8af2edf" returned: 0 in 0.529s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-31012923-c0a1-4f4e-8977-e1a9e2e6610c tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f.fa3bcf14-3ee0-43d5-9d3a-c1f3a8af2edf {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:41 devstack sudo[95317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f.fa3bcf14-3ee0-43d5-9d3a-c1f3a8af2edf Aug 31 15:18:41 devstack sudo[95317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:41 devstack sudo[95317]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-31012923-c0a1-4f4e-8977-e1a9e2e6610c tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f.fa3bcf14-3ee0-43d5-9d3a-c1f3a8af2edf" returned: 0 in 0.388s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:41 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-31012923-c0a1-4f4e-8977-e1a9e2e6610c tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Lock "cinder-quobyte-fa3bcf14-3ee0-43d5-9d3a-c1f3a8af2edf" released by "_delete_snapshot" :: held 2.124s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:18:41 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-31012923-c0a1-4f4e-8977-e1a9e2e6610c tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Lock "cinder-quobyte-830d355b-92a2-470e-a2f4-be6bdc10231f" released by "delete_snapshot" :: held 2.152s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:18:41 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-31012923-c0a1-4f4e-8977-e1a9e2e6610c tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Created reservations ['e9cb979d-129c-40be-99b0-44d854e008db', 'd690a99b-68f8-4359-8e81-b547204b9309', '373c231a-cdd6-4f0c-983f-90e76b9ebb31', 'fc36b342-88aa-4a6e-b5e1-b1c448448668'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:18:41 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-31012923-c0a1-4f4e-8977-e1a9e2e6610c tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Delete snapshot completed successfully. Aug 31 15:18:41 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-31012923-c0a1-4f4e-8977-e1a9e2e6610c tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Lock "cinder-fa3bcf14-3ee0-43d5-9d3a-c1f3a8af2edf-delete_snapshot" released by "delete_snapshot" :: held 2.345s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:18:42 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-46d7ec0f-5daa-4334-b8b5-06ea3f36ac77 tempest-GroupsTest-1877539584 None] Group tempest-Group1-1134347061: creating Aug 31 15:18:42 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-46d7ec0f-5daa-4334-b8b5-06ea3f36ac77 tempest-GroupsTest-1877539584 None] Group tempest-Group1-1134347061: created successfully Aug 31 15:18:42 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-46d7ec0f-5daa-4334-b8b5-06ea3f36ac77 tempest-GroupsTest-1877539584 None] Create group completed successfully. Aug 31 15:18:42 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-8bdb995f-957c-4f55-b38f-6fce45add01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Acquiring lock "cinder-830d355b-92a2-470e-a2f4-be6bdc10231f-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:18:42 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-8bdb995f-957c-4f55-b38f-6fce45add01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Lock "cinder-830d355b-92a2-470e-a2f4-be6bdc10231f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:18:42 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-8bdb995f-957c-4f55-b38f-6fce45add01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Acquiring lock "cinder-quobyte-830d355b-92a2-470e-a2f4-be6bdc10231f" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:18:42 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-8bdb995f-957c-4f55-b38f-6fce45add01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Lock "cinder-quobyte-830d355b-92a2-470e-a2f4-be6bdc10231f" acquired by "delete_volume" :: waited 0.037s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:18:42 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac4b246-659d-4c37-a748-b12b025fae18]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:18:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8bdb995f-957c-4f55-b38f-6fce45add01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:43 devstack sudo[95320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f Aug 31 15:18:43 devstack sudo[95320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:43 devstack sudo[95320]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8bdb995f-957c-4f55-b38f-6fce45add01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f" returned: 0 in 0.386s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8bdb995f-957c-4f55-b38f-6fce45add01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:43 devstack sudo[95326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f Aug 31 15:18:43 devstack sudo[95326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:43 devstack sudo[95326]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8bdb995f-957c-4f55-b38f-6fce45add01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-830d355b-92a2-470e-a2f4-be6bdc10231f" returned: 0 in 0.272s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:43 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-8bdb995f-957c-4f55-b38f-6fce45add01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Lock "cinder-quobyte-830d355b-92a2-470e-a2f4-be6bdc10231f" released by "delete_volume" :: held 0.720s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:18:43 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-8bdb995f-957c-4f55-b38f-6fce45add01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Created reservations ['7e8e62a0-efb0-4821-addc-cf7adb296e92', '7671f410-1050-4ef0-8ede-1ffc5586859f', '27f4a673-70a7-4795-a220-f61eaa6bdfcb', '8b45cc75-2cd8-4463-a551-4f62fcc1d2c0'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:18:43 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-eb374f6d-2ef9-43c0-b39e-4cd7f39b0825 tempest-GroupsV314Test-1427951327 None] Group tempest-GroupsV314Test-Group-750397022: creating Aug 31 15:18:43 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-eb374f6d-2ef9-43c0-b39e-4cd7f39b0825 tempest-GroupsV314Test-1427951327 None] Group tempest-GroupsV314Test-Group-750397022: created successfully Aug 31 15:18:43 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-eb374f6d-2ef9-43c0-b39e-4cd7f39b0825 tempest-GroupsV314Test-1427951327 None] Create group completed successfully. Aug 31 15:18:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8bdb995f-957c-4f55-b38f-6fce45add01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:18:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8bdb995f-957c-4f55-b38f-6fce45add01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:18:43 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb995f-957c-4f55-b38f-6fce45add01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:18:43 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-8bdb995f-957c-4f55-b38f-6fce45add01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:18:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8bdb995f-957c-4f55-b38f-6fce45add01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:18:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8bdb995f-957c-4f55-b38f-6fce45add01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:43 devstack sudo[95329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:18:43 devstack sudo[95329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:44 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-d7b5ac58-98f0-4060-b92f-e24313939dea tempest-GroupsTest-1877539584 None] Group tempest-Group2-1675923437: creating Aug 31 15:18:44 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-d7b5ac58-98f0-4060-b92f-e24313939dea tempest-GroupsTest-1877539584 None] Group tempest-Group2-1675923437: created successfully Aug 31 15:18:44 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-d7b5ac58-98f0-4060-b92f-e24313939dea tempest-GroupsTest-1877539584 None] Create group completed successfully. Aug 31 15:18:44 devstack sudo[95329]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8bdb995f-957c-4f55-b38f-6fce45add01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.308s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:44 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-8bdb995f-957c-4f55-b38f-6fce45add01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:18:44 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-8bdb995f-957c-4f55-b38f-6fce45add01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Deleted volume successfully. Aug 31 15:18:44 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-8bdb995f-957c-4f55-b38f-6fce45add01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1786979786 None] Lock "cinder-830d355b-92a2-470e-a2f4-be6bdc10231f-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:18:45 devstack cinder-volume[86000]: DEBUG oslo_service.periodic_task [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86000) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:18:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:18:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:18:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:18:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:18:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:18:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:45 devstack sudo[95334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:18:45 devstack sudo[95334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:45 devstack sudo[95334]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.481s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:45 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:18:45 devstack cinder-volume[86000]: DEBUG oslo_service.periodic_task [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running periodic task VolumeManager._thread_info {{(pid=86000) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:18:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] thread count: 28 {{(pid=86000) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 31 15:18:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] thread info: [<_MainThread(MainThread, started 137631281086592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86000) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 31 15:18:45 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-1510ed36-ed89-4a60-9972-795c806bbc4e tempest-GroupsV314Test-1427951327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:18:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1510ed36-ed89-4a60-9972-795c806bbc4e tempest-GroupsV314Test-1427951327 None] Flow 'volume_create_manager' (4ad1126f-fd53-4bd3-b2fe-23c1ffafc51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:18:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1510ed36-ed89-4a60-9972-795c806bbc4e tempest-GroupsV314Test-1427951327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82a133ca-5437-480d-86f2-63a4068a7c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:18:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1510ed36-ed89-4a60-9972-795c806bbc4e tempest-GroupsV314Test-1427951327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82a133ca-5437-480d-86f2-63a4068a7c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1662501494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=84a26ffc-feae-44d2-8db7-6e66b814d312,host='devstack@QuobyteHD#QuobyteHD',id=a19cc623-8d5c-4c78-81ef-1d63ae0ada7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383d537228ef4c37a37ef561e3c6e54a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:18:46Z,use_quota=True,user_id='622b8b658e154e228c769d0264cce077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(190f3efc-6927-46b9-a571-40739e72bdbb),volume_type_id=190f3efc-6927-46b9-a571-40739e72bdbb)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:18:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1510ed36-ed89-4a60-9972-795c806bbc4e tempest-GroupsV314Test-1427951327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22ca2641-e515-4aa4-8dd9-b54b8af29af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:18:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1510ed36-ed89-4a60-9972-795c806bbc4e tempest-GroupsV314Test-1427951327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22ca2641-e515-4aa4-8dd9-b54b8af29af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:18:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1510ed36-ed89-4a60-9972-795c806bbc4e tempest-GroupsV314Test-1427951327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (609e32bf-46e1-4992-a001-84665dba8fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:18:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1510ed36-ed89-4a60-9972-795c806bbc4e tempest-GroupsV314Test-1427951327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (609e32bf-46e1-4992-a001-84665dba8fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a19cc623-8d5c-4c78-81ef-1d63ae0ada7c', 'volume_name': 'volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:18:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1510ed36-ed89-4a60-9972-795c806bbc4e tempest-GroupsV314Test-1427951327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79fcf77e-7bec-44d2-a4dc-9498d05a942d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:18:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1510ed36-ed89-4a60-9972-795c806bbc4e tempest-GroupsV314Test-1427951327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79fcf77e-7bec-44d2-a4dc-9498d05a942d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:18:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1510ed36-ed89-4a60-9972-795c806bbc4e tempest-GroupsV314Test-1427951327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe17b34-abc3-415a-a2c4-531d618aaea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:18:45 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-1510ed36-ed89-4a60-9972-795c806bbc4e tempest-GroupsV314Test-1427951327 None] Volume a19cc623-8d5c-4c78-81ef-1d63ae0ada7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c', 'volume_size': 1} Aug 31 15:18:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1510ed36-ed89-4a60-9972-795c806bbc4e tempest-GroupsV314Test-1427951327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:18:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1510ed36-ed89-4a60-9972-795c806bbc4e tempest-GroupsV314Test-1427951327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:18:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1510ed36-ed89-4a60-9972-795c806bbc4e tempest-GroupsV314Test-1427951327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=84a26ffc-feae-44d2-8db7-6e66b814d312,created_at=2026-08-31T13:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1662501494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=84a26ffc-feae-44d2-8db7-6e66b814d312,host='devstack@QuobyteHD#QuobyteHD',id=a19cc623-8d5c-4c78-81ef-1d63ae0ada7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383d537228ef4c37a37ef561e3c6e54a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:18:46Z,use_quota=True,user_id='622b8b658e154e228c769d0264cce077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(190f3efc-6927-46b9-a571-40739e72bdbb),volume_type_id=190f3efc-6927-46b9-a571-40739e72bdbb)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:18:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-1510ed36-ed89-4a60-9972-795c806bbc4e tempest-GroupsV314Test-1427951327 None] Creating volume a19cc623-8d5c-4c78-81ef-1d63ae0ada7c {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:18:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1510ed36-ed89-4a60-9972-795c806bbc4e tempest-GroupsV314Test-1427951327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:18:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1510ed36-ed89-4a60-9972-795c806bbc4e tempest-GroupsV314Test-1427951327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:18:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1510ed36-ed89-4a60-9972-795c806bbc4e tempest-GroupsV314Test-1427951327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:18:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1510ed36-ed89-4a60-9972-795c806bbc4e tempest-GroupsV314Test-1427951327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:18:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1510ed36-ed89-4a60-9972-795c806bbc4e tempest-GroupsV314Test-1427951327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:18:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1510ed36-ed89-4a60-9972-795c806bbc4e tempest-GroupsV314Test-1427951327 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:18:45 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-1510ed36-ed89-4a60-9972-795c806bbc4e tempest-GroupsV314Test-1427951327 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:18:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1510ed36-ed89-4a60-9972-795c806bbc4e tempest-GroupsV314Test-1427951327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:45 devstack sudo[95340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c 1073741824 Aug 31 15:18:45 devstack sudo[95340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:46 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-f852ef6e-c539-4f27-a4b7-ae18786b07f6 tempest-GroupsTest-1877539584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:18:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f852ef6e-c539-4f27-a4b7-ae18786b07f6 tempest-GroupsTest-1877539584 None] Flow 'volume_create_manager' (0a42df00-5b29-4e5e-92d7-c43308dc8114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:18:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f852ef6e-c539-4f27-a4b7-ae18786b07f6 tempest-GroupsTest-1877539584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (578285e5-162e-47ef-bc10-67062e4ed05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:18:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f852ef6e-c539-4f27-a4b7-ae18786b07f6 tempest-GroupsTest-1877539584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (578285e5-162e-47ef-bc10-67062e4ed05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1383480596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0763b0a6-df82-4748-9c0f-35b493da8eed,host='devstack@QuobyteHD#QuobyteHD',id=61acdadc-5131-4c3b-aa03-3ebe206bdabe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3680a229672f4c4681411c3ad57fe507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:18:46Z,use_quota=True,user_id='e933a385500446abac27c4140272decb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dbbd6c53-944e-44ea-9c3e-40ba5a70a008),volume_type_id=dbbd6c53-944e-44ea-9c3e-40ba5a70a008)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:18:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f852ef6e-c539-4f27-a4b7-ae18786b07f6 tempest-GroupsTest-1877539584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c15c64de-24ea-4966-93bc-36c012e77da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:18:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f852ef6e-c539-4f27-a4b7-ae18786b07f6 tempest-GroupsTest-1877539584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c15c64de-24ea-4966-93bc-36c012e77da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:18:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f852ef6e-c539-4f27-a4b7-ae18786b07f6 tempest-GroupsTest-1877539584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (755fdfc0-851b-4a44-bd06-0a6fa5939b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:18:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f852ef6e-c539-4f27-a4b7-ae18786b07f6 tempest-GroupsTest-1877539584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (755fdfc0-851b-4a44-bd06-0a6fa5939b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61acdadc-5131-4c3b-aa03-3ebe206bdabe', 'volume_name': 'volume-61acdadc-5131-4c3b-aa03-3ebe206bdabe', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:18:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f852ef6e-c539-4f27-a4b7-ae18786b07f6 tempest-GroupsTest-1877539584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8433bdc-b245-4e49-a176-b37b7f9106b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:18:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f852ef6e-c539-4f27-a4b7-ae18786b07f6 tempest-GroupsTest-1877539584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8433bdc-b245-4e49-a176-b37b7f9106b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:18:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f852ef6e-c539-4f27-a4b7-ae18786b07f6 tempest-GroupsTest-1877539584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dca46d4-17d4-48d1-8794-4d558cc9a42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:18:46 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-f852ef6e-c539-4f27-a4b7-ae18786b07f6 tempest-GroupsTest-1877539584 None] Volume 61acdadc-5131-4c3b-aa03-3ebe206bdabe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61acdadc-5131-4c3b-aa03-3ebe206bdabe', 'volume_size': 1} Aug 31 15:18:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f852ef6e-c539-4f27-a4b7-ae18786b07f6 tempest-GroupsTest-1877539584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:18:46 devstack sudo[95340]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1510ed36-ed89-4a60-9972-795c806bbc4e tempest-GroupsV314Test-1427951327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c 1073741824" returned: 0 in 0.634s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1510ed36-ed89-4a60-9972-795c806bbc4e tempest-GroupsV314Test-1427951327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:46 devstack sudo[95372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c Aug 31 15:18:46 devstack sudo[95372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:46 devstack sudo[95372]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1510ed36-ed89-4a60-9972-795c806bbc4e tempest-GroupsV314Test-1427951327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c" returned: 0 in 0.275s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:46 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1510ed36-ed89-4a60-9972-795c806bbc4e tempest-GroupsV314Test-1427951327 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:18:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1510ed36-ed89-4a60-9972-795c806bbc4e tempest-GroupsV314Test-1427951327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:18:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f852ef6e-c539-4f27-a4b7-ae18786b07f6 tempest-GroupsTest-1877539584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.689s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:18:46 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f852ef6e-c539-4f27-a4b7-ae18786b07f6 tempest-GroupsTest-1877539584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0763b0a6-df82-4748-9c0f-35b493da8eed,created_at=2026-08-31T13:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1383480596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0763b0a6-df82-4748-9c0f-35b493da8eed,host='devstack@QuobyteHD#QuobyteHD',id=61acdadc-5131-4c3b-aa03-3ebe206bdabe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3680a229672f4c4681411c3ad57fe507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:18:46Z,use_quota=True,user_id='e933a385500446abac27c4140272decb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dbbd6c53-944e-44ea-9c3e-40ba5a70a008),volume_type_id=dbbd6c53-944e-44ea-9c3e-40ba5a70a008)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:18:46 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-f852ef6e-c539-4f27-a4b7-ae18786b07f6 tempest-GroupsTest-1877539584 None] Creating volume 61acdadc-5131-4c3b-aa03-3ebe206bdabe {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:18:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f852ef6e-c539-4f27-a4b7-ae18786b07f6 tempest-GroupsTest-1877539584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:18:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f852ef6e-c539-4f27-a4b7-ae18786b07f6 tempest-GroupsTest-1877539584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:18:46 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f852ef6e-c539-4f27-a4b7-ae18786b07f6 tempest-GroupsTest-1877539584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:18:46 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f852ef6e-c539-4f27-a4b7-ae18786b07f6 tempest-GroupsTest-1877539584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:18:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f852ef6e-c539-4f27-a4b7-ae18786b07f6 tempest-GroupsTest-1877539584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:18:46 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f852ef6e-c539-4f27-a4b7-ae18786b07f6 tempest-GroupsTest-1877539584 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:18:46 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-f852ef6e-c539-4f27-a4b7-ae18786b07f6 tempest-GroupsTest-1877539584 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:18:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f852ef6e-c539-4f27-a4b7-ae18786b07f6 tempest-GroupsTest-1877539584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-61acdadc-5131-4c3b-aa03-3ebe206bdabe 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1510ed36-ed89-4a60-9972-795c806bbc4e tempest-GroupsV314Test-1427951327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe17b34-abc3-415a-a2c4-531d618aaea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:18:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1510ed36-ed89-4a60-9972-795c806bbc4e tempest-GroupsV314Test-1427951327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4caed00-5cdf-49e4-85cd-87189df8cd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:18:46 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-1510ed36-ed89-4a60-9972-795c806bbc4e tempest-GroupsV314Test-1427951327 None] Volume volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c (a19cc623-8d5c-4c78-81ef-1d63ae0ada7c): created successfully Aug 31 15:18:46 devstack sudo[95379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-61acdadc-5131-4c3b-aa03-3ebe206bdabe 1073741824 Aug 31 15:18:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1510ed36-ed89-4a60-9972-795c806bbc4e tempest-GroupsV314Test-1427951327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4caed00-5cdf-49e4-85cd-87189df8cd8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:18:46 devstack sudo[95379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1510ed36-ed89-4a60-9972-795c806bbc4e tempest-GroupsV314Test-1427951327 None] Flow 'volume_create_manager' (4ad1126f-fd53-4bd3-b2fe-23c1ffafc51e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:18:46 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-1510ed36-ed89-4a60-9972-795c806bbc4e tempest-GroupsV314Test-1427951327 None] Created volume successfully. Aug 31 15:18:47 devstack sudo[95379]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f852ef6e-c539-4f27-a4b7-ae18786b07f6 tempest-GroupsTest-1877539584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-61acdadc-5131-4c3b-aa03-3ebe206bdabe 1073741824" returned: 0 in 0.569s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f852ef6e-c539-4f27-a4b7-ae18786b07f6 tempest-GroupsTest-1877539584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-61acdadc-5131-4c3b-aa03-3ebe206bdabe {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:47 devstack sudo[95385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-61acdadc-5131-4c3b-aa03-3ebe206bdabe Aug 31 15:18:47 devstack sudo[95385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:47 devstack sudo[95385]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f852ef6e-c539-4f27-a4b7-ae18786b07f6 tempest-GroupsTest-1877539584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-61acdadc-5131-4c3b-aa03-3ebe206bdabe" returned: 0 in 0.265s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:47 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f852ef6e-c539-4f27-a4b7-ae18786b07f6 tempest-GroupsTest-1877539584 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:18:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f852ef6e-c539-4f27-a4b7-ae18786b07f6 tempest-GroupsTest-1877539584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:18:47 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f852ef6e-c539-4f27-a4b7-ae18786b07f6 tempest-GroupsTest-1877539584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dca46d4-17d4-48d1-8794-4d558cc9a42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61acdadc-5131-4c3b-aa03-3ebe206bdabe', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:18:47 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f852ef6e-c539-4f27-a4b7-ae18786b07f6 tempest-GroupsTest-1877539584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dad820ea-5449-4165-aa43-c5de1c9c48a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:18:47 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-f852ef6e-c539-4f27-a4b7-ae18786b07f6 tempest-GroupsTest-1877539584 None] Volume volume-61acdadc-5131-4c3b-aa03-3ebe206bdabe (61acdadc-5131-4c3b-aa03-3ebe206bdabe): created successfully Aug 31 15:18:47 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f852ef6e-c539-4f27-a4b7-ae18786b07f6 tempest-GroupsTest-1877539584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dad820ea-5449-4165-aa43-c5de1c9c48a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:18:47 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f852ef6e-c539-4f27-a4b7-ae18786b07f6 tempest-GroupsTest-1877539584 None] Flow 'volume_create_manager' (0a42df00-5b29-4e5e-92d7-c43308dc8114) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:18:47 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-f852ef6e-c539-4f27-a4b7-ae18786b07f6 tempest-GroupsTest-1877539584 None] Created volume successfully. Aug 31 15:18:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:18:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:18:49 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] Cloning volume a19cc623-8d5c-4c78-81ef-1d63ae0ada7c to volume f1871fbe-508e-403b-868c-d2310b1cf7b7 Aug 31 15:18:49 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] Creating offline snapshot d3bd54e3-a5d9-464e-8f84-9085d7206b8a of volume a19cc623-8d5c-4c78-81ef-1d63ae0ada7c {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:18:49 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfc72e1-7392-4f1a-80ab-6cf175f85ba2]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:18:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:49 devstack sudo[95388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c Aug 31 15:18:49 devstack sudo[95388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:49 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7fd1b3fb-28e7-497a-b067-7a6fc5b9993a tempest-GroupsTest-1877539584 None] Acquiring lock "cinder-quobyte-61acdadc-5131-4c3b-aa03-3ebe206bdabe" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:18:49 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7fd1b3fb-28e7-497a-b067-7a6fc5b9993a tempest-GroupsTest-1877539584 None] Lock "cinder-quobyte-61acdadc-5131-4c3b-aa03-3ebe206bdabe" acquired by "delete_volume" :: waited 0.026s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:18:49 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdfd795-14e0-4b91-81c4-82b7a6a32ad0]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:18:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7fd1b3fb-28e7-497a-b067-7a6fc5b9993a tempest-GroupsTest-1877539584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-61acdadc-5131-4c3b-aa03-3ebe206bdabe {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:49 devstack sudo[95391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-61acdadc-5131-4c3b-aa03-3ebe206bdabe Aug 31 15:18:49 devstack sudo[95391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:49 devstack sudo[95388]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c" returned: 0 in 0.474s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c.d3bd54e3-a5d9-464e-8f84-9085d7206b8a 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:49 devstack sudo[95397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c.d3bd54e3-a5d9-464e-8f84-9085d7206b8a 1G Aug 31 15:18:49 devstack sudo[95397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:49 devstack sudo[95391]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7fd1b3fb-28e7-497a-b067-7a6fc5b9993a tempest-GroupsTest-1877539584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-61acdadc-5131-4c3b-aa03-3ebe206bdabe" returned: 0 in 0.405s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7fd1b3fb-28e7-497a-b067-7a6fc5b9993a tempest-GroupsTest-1877539584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-61acdadc-5131-4c3b-aa03-3ebe206bdabe {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:49 devstack sudo[95405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-61acdadc-5131-4c3b-aa03-3ebe206bdabe Aug 31 15:18:49 devstack sudo[95405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:50 devstack sudo[95397]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c.d3bd54e3-a5d9-464e-8f84-9085d7206b8a 1G" returned: 0 in 0.454s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c.d3bd54e3-a5d9-464e-8f84-9085d7206b8a {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:50 devstack sudo[95408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c.d3bd54e3-a5d9-464e-8f84-9085d7206b8a Aug 31 15:18:50 devstack sudo[95408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:50 devstack sudo[95405]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7fd1b3fb-28e7-497a-b067-7a6fc5b9993a tempest-GroupsTest-1877539584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-61acdadc-5131-4c3b-aa03-3ebe206bdabe" returned: 0 in 0.288s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:50 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7fd1b3fb-28e7-497a-b067-7a6fc5b9993a tempest-GroupsTest-1877539584 None] Lock "cinder-quobyte-61acdadc-5131-4c3b-aa03-3ebe206bdabe" released by "delete_volume" :: held 0.736s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:18:50 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-7fd1b3fb-28e7-497a-b067-7a6fc5b9993a tempest-GroupsTest-1877539584 None] Created reservations ['ed6f1414-5adf-4a9a-989d-b1fa4fa71cc3'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:18:50 devstack cinder-volume[86000]: WARNING cinder.quota [None req-7fd1b3fb-28e7-497a-b067-7a6fc5b9993a tempest-GroupsTest-1877539584 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-351485573 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-351485573, it is now deprecated. Please use the default quota class for default quota. Aug 31 15:18:50 devstack cinder-volume[86000]: WARNING cinder.quota [None req-7fd1b3fb-28e7-497a-b067-7a6fc5b9993a tempest-GroupsTest-1877539584 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-351485573 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-351485573, it is now deprecated. Please use the default quota class for default quota. Aug 31 15:18:50 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-7fd1b3fb-28e7-497a-b067-7a6fc5b9993a tempest-GroupsTest-1877539584 None] Created reservations ['624f7015-6057-4214-92d9-5d99ca0cba77', '98559950-8fff-479b-b112-7ad98ac4f61c', '588e3dd2-682c-4e6b-810b-47236d68abe1', '617f1691-4d58-4eb8-af71-a3f9659e6b1c'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:18:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7fd1b3fb-28e7-497a-b067-7a6fc5b9993a tempest-GroupsTest-1877539584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:18:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7fd1b3fb-28e7-497a-b067-7a6fc5b9993a tempest-GroupsTest-1877539584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:18:50 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-7fd1b3fb-28e7-497a-b067-7a6fc5b9993a tempest-GroupsTest-1877539584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:18:50 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-7fd1b3fb-28e7-497a-b067-7a6fc5b9993a tempest-GroupsTest-1877539584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:18:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7fd1b3fb-28e7-497a-b067-7a6fc5b9993a tempest-GroupsTest-1877539584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:18:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7fd1b3fb-28e7-497a-b067-7a6fc5b9993a tempest-GroupsTest-1877539584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:50 devstack sudo[95408]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c.d3bd54e3-a5d9-464e-8f84-9085d7206b8a" returned: 0 in 0.358s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:50 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c.d3bd54e3-a5d9-464e-8f84-9085d7206b8a is being set with open permissions: ugo+rw: NotImplementedError Aug 31 15:18:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c.d3bd54e3-a5d9-464e-8f84-9085d7206b8a {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:50 devstack sudo[95415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:18:50 devstack sudo[95415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:50 devstack sudo[95416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c.d3bd54e3-a5d9-464e-8f84-9085d7206b8a Aug 31 15:18:50 devstack sudo[95416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:50 devstack sudo[95416]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c.d3bd54e3-a5d9-464e-8f84-9085d7206b8a" returned: 0 in 0.299s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:50 devstack sudo[95415]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7fd1b3fb-28e7-497a-b067-7a6fc5b9993a tempest-GroupsTest-1877539584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.320s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:50 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-7fd1b3fb-28e7-497a-b067-7a6fc5b9993a tempest-GroupsTest-1877539584 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:18:50 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-7fd1b3fb-28e7-497a-b067-7a6fc5b9993a tempest-GroupsTest-1877539584 None] Delete group completed successfully. Aug 31 15:18:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:50 devstack sudo[95421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c.info Aug 31 15:18:50 devstack sudo[95421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:50 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-968cb6f5-de3d-40fd-b23e-c0452542c534 tempest-GroupsTest-1877539584 None] Created reservations ['d70330be-cacf-45ca-ba84-70416b5e043c'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:18:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-968cb6f5-de3d-40fd-b23e-c0452542c534 tempest-GroupsTest-1877539584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:18:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-968cb6f5-de3d-40fd-b23e-c0452542c534 tempest-GroupsTest-1877539584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:18:50 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-968cb6f5-de3d-40fd-b23e-c0452542c534 tempest-GroupsTest-1877539584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:18:50 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-968cb6f5-de3d-40fd-b23e-c0452542c534 tempest-GroupsTest-1877539584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:18:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-968cb6f5-de3d-40fd-b23e-c0452542c534 tempest-GroupsTest-1877539584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:18:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-968cb6f5-de3d-40fd-b23e-c0452542c534 tempest-GroupsTest-1877539584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:50 devstack sudo[95423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:18:50 devstack sudo[95423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:51 devstack sudo[95421]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c.info" returned: 0 in 0.279s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:51 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c.info is being set with open permissions: ugo+rw: NotImplementedError Aug 31 15:18:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:51 devstack sudo[95426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c.info Aug 31 15:18:51 devstack sudo[95426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:51 devstack sudo[95423]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-968cb6f5-de3d-40fd-b23e-c0452542c534 tempest-GroupsTest-1877539584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.275s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:51 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-968cb6f5-de3d-40fd-b23e-c0452542c534 tempest-GroupsTest-1877539584 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:18:51 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-968cb6f5-de3d-40fd-b23e-c0452542c534 tempest-GroupsTest-1877539584 None] Delete group completed successfully. Aug 31 15:18:51 devstack sudo[95426]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c.info" returned: 0 in 0.271s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:51 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] Acquiring lock "cinder-quobyte-f1871fbe-508e-403b-868c-d2310b1cf7b7" by "_copy_volume_from_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:18:51 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] Lock "cinder-quobyte-f1871fbe-508e-403b-868c-d2310b1cf7b7" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:18:51 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] snapshot: d3bd54e3-a5d9-464e-8f84-9085d7206b8a, volume: f1871fbe-508e-403b-868c-d2310b1cf7b7, {{(pid=86000) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 31 15:18:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:18:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:18:51 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:18:51 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:18:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:18:51 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1995312f-39d9-46df-8aab-4aff779cb292]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:18:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c.d3bd54e3-a5d9-464e-8f84-9085d7206b8a {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:51 devstack sudo[95430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c.d3bd54e3-a5d9-464e-8f84-9085d7206b8a Aug 31 15:18:51 devstack sudo[95430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:51 devstack sudo[95430]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c.d3bd54e3-a5d9-464e-8f84-9085d7206b8a" returned: 0 in 0.381s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:51 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:18:51 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e4ab98-ef44-4232-b521-88bcb59d5bbb]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:18:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:51 devstack sudo[95436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c Aug 31 15:18:51 devstack sudo[95436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:52 devstack sudo[95436]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c" returned: 0 in 0.429s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:52 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c {{(pid=86000) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 31 15:18:52 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] Creating direct copy from snapshot {{(pid=86000) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 31 15:18:52 devstack cinder-volume[86000]: DEBUG cinder.utils [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] Path /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f1871fbe-508e-403b-868c-d2310b1cf7b7 not found in is_blk_device check {{(pid=86000) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 31 15:18:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f1871fbe-508e-403b-868c-d2310b1cf7b7 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:52 devstack sudo[95442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f1871fbe-508e-403b-868c-d2310b1cf7b7 Aug 31 15:18:52 devstack sudo[95442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:52 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-01d171d5-5002-433a-a2e7-9f31437cf162 tempest-GroupsTest-1877539584 None] Group tempest-GroupsTest-Group-1010012728: creating Aug 31 15:18:52 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-01d171d5-5002-433a-a2e7-9f31437cf162 tempest-GroupsTest-1877539584 None] Group tempest-GroupsTest-Group-1010012728: created successfully Aug 31 15:18:52 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-01d171d5-5002-433a-a2e7-9f31437cf162 tempest-GroupsTest-1877539584 None] Create group completed successfully. Aug 31 15:18:55 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a3fce70-1dbe-44c5-a386-c4888a542efb tempest-GroupsTest-1877539584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:18:55 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8a3fce70-1dbe-44c5-a386-c4888a542efb tempest-GroupsTest-1877539584 None] Flow 'volume_create_manager' (df7be78e-489c-474b-9a8b-f1e6c54d7cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:18:55 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8a3fce70-1dbe-44c5-a386-c4888a542efb tempest-GroupsTest-1877539584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (935da988-ca72-4b14-94df-0d0ccbd29e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:18:55 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8a3fce70-1dbe-44c5-a386-c4888a542efb tempest-GroupsTest-1877539584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (935da988-ca72-4b14-94df-0d0ccbd29e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-522184857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1eb92169-9290-40cb-b8e3-00d6e9df2bc1,host='devstack@QuobyteHD#QuobyteHD',id=5af53f6c-f0ec-45da-b757-d85787780ed7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3680a229672f4c4681411c3ad57fe507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:18:55Z,use_quota=True,user_id='e933a385500446abac27c4140272decb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fcede0d-fd26-4098-8db6-62c41cb2ec1b),volume_type_id=6fcede0d-fd26-4098-8db6-62c41cb2ec1b)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:18:55 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8a3fce70-1dbe-44c5-a386-c4888a542efb tempest-GroupsTest-1877539584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7ea30c6-1951-4fd2-8633-2fc74c43bd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:18:55 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8a3fce70-1dbe-44c5-a386-c4888a542efb tempest-GroupsTest-1877539584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7ea30c6-1951-4fd2-8633-2fc74c43bd5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:18:55 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8a3fce70-1dbe-44c5-a386-c4888a542efb tempest-GroupsTest-1877539584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b065437-9e4f-4e2f-8d07-bc5c5bdb6188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:18:55 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8a3fce70-1dbe-44c5-a386-c4888a542efb tempest-GroupsTest-1877539584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b065437-9e4f-4e2f-8d07-bc5c5bdb6188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5af53f6c-f0ec-45da-b757-d85787780ed7', 'volume_name': 'volume-5af53f6c-f0ec-45da-b757-d85787780ed7', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:18:55 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8a3fce70-1dbe-44c5-a386-c4888a542efb tempest-GroupsTest-1877539584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ea5e033-8f98-4bca-a728-821cbec81ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:18:55 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8a3fce70-1dbe-44c5-a386-c4888a542efb tempest-GroupsTest-1877539584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ea5e033-8f98-4bca-a728-821cbec81ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:18:55 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8a3fce70-1dbe-44c5-a386-c4888a542efb tempest-GroupsTest-1877539584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cc3c816-ae66-4d85-be27-3e65969f5b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:18:55 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-8a3fce70-1dbe-44c5-a386-c4888a542efb tempest-GroupsTest-1877539584 None] Volume 5af53f6c-f0ec-45da-b757-d85787780ed7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5af53f6c-f0ec-45da-b757-d85787780ed7', 'volume_size': 1} Aug 31 15:18:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8a3fce70-1dbe-44c5-a386-c4888a542efb tempest-GroupsTest-1877539584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:18:58 devstack sudo[95442]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f1871fbe-508e-403b-868c-d2310b1cf7b7" returned: 0 in 6.128s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:58 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c, size 1024.00 MB, duration 6.13 sec, destination /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f1871fbe-508e-403b-868c-d2310b1cf7b7 {{(pid=86000) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 31 15:18:58 devstack cinder-volume[86000]: INFO cinder.image.image_utils [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] Converted 1024.00 MB image at 167.06 MB/s Aug 31 15:18:58 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f1871fbe-508e-403b-868c-d2310b1cf7b7 is being set with open permissions: ugo+rw: NotImplementedError Aug 31 15:18:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f1871fbe-508e-403b-868c-d2310b1cf7b7 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:58 devstack sudo[95469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f1871fbe-508e-403b-868c-d2310b1cf7b7 Aug 31 15:18:58 devstack sudo[95469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:58 devstack sudo[95469]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f1871fbe-508e-403b-868c-d2310b1cf7b7" returned: 0 in 0.278s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:58 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] Lock "cinder-quobyte-f1871fbe-508e-403b-868c-d2310b1cf7b7" released by "_copy_volume_from_snapshot" :: held 7.287s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:18:58 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] Acquiring lock "cinder-quobyte-d3bd54e3-a5d9-464e-8f84-9085d7206b8a" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:18:58 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] Lock "cinder-quobyte-d3bd54e3-a5d9-464e-8f84-9085d7206b8a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:18:58 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] Deleting offline snapshot d3bd54e3-a5d9-464e-8f84-9085d7206b8a of volume a19cc623-8d5c-4c78-81ef-1d63ae0ada7c {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:18:58 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] snapshot_file for this snap is: volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c.d3bd54e3-a5d9-464e-8f84-9085d7206b8a {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:18:58 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e987c35-0221-4eda-b902-50b588cb01c0]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:18:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c.d3bd54e3-a5d9-464e-8f84-9085d7206b8a {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:58 devstack sudo[95472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c.d3bd54e3-a5d9-464e-8f84-9085d7206b8a Aug 31 15:18:58 devstack sudo[95472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:59 devstack sudo[95472]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c.d3bd54e3-a5d9-464e-8f84-9085d7206b8a" returned: 0 in 0.397s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:59 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:18:59 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d4419a-82fd-40d9-b74f-da2bc70a4db8]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:18:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:59 devstack sudo[95477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c Aug 31 15:18:59 devstack sudo[95477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:18:59 devstack sudo[95477]: pam_unix(sudo:session): session closed for user root Aug 31 15:18:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c" returned: 0 in 0.591s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:18:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c.d3bd54e3-a5d9-464e-8f84-9085d7206b8a {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:18:59 devstack sudo[95494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c.d3bd54e3-a5d9-464e-8f84-9085d7206b8a Aug 31 15:18:59 devstack sudo[95494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:00 devstack sudo[95494]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c.d3bd54e3-a5d9-464e-8f84-9085d7206b8a" returned: 0 in 0.425s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c.d3bd54e3-a5d9-464e-8f84-9085d7206b8a {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:00 devstack sudo[95499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c.d3bd54e3-a5d9-464e-8f84-9085d7206b8a Aug 31 15:19:00 devstack sudo[95499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:00 devstack sudo[95499]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c.d3bd54e3-a5d9-464e-8f84-9085d7206b8a" returned: 0 in 0.264s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:00 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] Lock "cinder-quobyte-d3bd54e3-a5d9-464e-8f84-9085d7206b8a" released by "_delete_snapshot" :: held 1.765s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:19:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.418s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:19:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8a3fce70-1dbe-44c5-a386-c4888a542efb tempest-GroupsTest-1877539584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.500s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:19:00 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-8a3fce70-1dbe-44c5-a386-c4888a542efb tempest-GroupsTest-1877539584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1eb92169-9290-40cb-b8e3-00d6e9df2bc1,created_at=2026-08-31T13:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-522184857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1eb92169-9290-40cb-b8e3-00d6e9df2bc1,host='devstack@QuobyteHD#QuobyteHD',id=5af53f6c-f0ec-45da-b757-d85787780ed7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3680a229672f4c4681411c3ad57fe507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:18:55Z,use_quota=True,user_id='e933a385500446abac27c4140272decb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fcede0d-fd26-4098-8db6-62c41cb2ec1b),volume_type_id=6fcede0d-fd26-4098-8db6-62c41cb2ec1b)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:19:00 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-8a3fce70-1dbe-44c5-a386-c4888a542efb tempest-GroupsTest-1877539584 None] Creating volume 5af53f6c-f0ec-45da-b757-d85787780ed7 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:19:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8a3fce70-1dbe-44c5-a386-c4888a542efb tempest-GroupsTest-1877539584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:19:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8a3fce70-1dbe-44c5-a386-c4888a542efb tempest-GroupsTest-1877539584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:19:00 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-8a3fce70-1dbe-44c5-a386-c4888a542efb tempest-GroupsTest-1877539584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:19:00 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-8a3fce70-1dbe-44c5-a386-c4888a542efb tempest-GroupsTest-1877539584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:19:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8a3fce70-1dbe-44c5-a386-c4888a542efb tempest-GroupsTest-1877539584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:19:00 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-8a3fce70-1dbe-44c5-a386-c4888a542efb tempest-GroupsTest-1877539584 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:19:00 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-8a3fce70-1dbe-44c5-a386-c4888a542efb tempest-GroupsTest-1877539584 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:19:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8a3fce70-1dbe-44c5-a386-c4888a542efb tempest-GroupsTest-1877539584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-5af53f6c-f0ec-45da-b757-d85787780ed7 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:00 devstack sudo[95502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-5af53f6c-f0ec-45da-b757-d85787780ed7 1073741824 Aug 31 15:19:00 devstack sudo[95502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:00 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-8e5cb9c4-e671-4e41-a149-ff6a394417dc tempest-GroupsV314Test-1427951327 None] Create group from source-group-84a26ffc-feae-44d2-8db7-6e66b814d312 completed successfully. Aug 31 15:19:00 devstack sudo[95502]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8a3fce70-1dbe-44c5-a386-c4888a542efb tempest-GroupsTest-1877539584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-5af53f6c-f0ec-45da-b757-d85787780ed7 1073741824" returned: 0 in 0.501s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8a3fce70-1dbe-44c5-a386-c4888a542efb tempest-GroupsTest-1877539584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-5af53f6c-f0ec-45da-b757-d85787780ed7 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:01 devstack sudo[95508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-5af53f6c-f0ec-45da-b757-d85787780ed7 Aug 31 15:19:01 devstack sudo[95508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:01 devstack sudo[95508]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8a3fce70-1dbe-44c5-a386-c4888a542efb tempest-GroupsTest-1877539584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-5af53f6c-f0ec-45da-b757-d85787780ed7" returned: 0 in 0.275s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:01 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-8a3fce70-1dbe-44c5-a386-c4888a542efb tempest-GroupsTest-1877539584 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:19:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8a3fce70-1dbe-44c5-a386-c4888a542efb tempest-GroupsTest-1877539584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:19:01 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8a3fce70-1dbe-44c5-a386-c4888a542efb tempest-GroupsTest-1877539584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cc3c816-ae66-4d85-be27-3e65969f5b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5af53f6c-f0ec-45da-b757-d85787780ed7', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:01 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8a3fce70-1dbe-44c5-a386-c4888a542efb tempest-GroupsTest-1877539584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f2b8e8b-d06c-4744-8be7-d0e1907df1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:01 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-8a3fce70-1dbe-44c5-a386-c4888a542efb tempest-GroupsTest-1877539584 None] Volume volume-5af53f6c-f0ec-45da-b757-d85787780ed7 (5af53f6c-f0ec-45da-b757-d85787780ed7): created successfully Aug 31 15:19:01 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8a3fce70-1dbe-44c5-a386-c4888a542efb tempest-GroupsTest-1877539584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f2b8e8b-d06c-4744-8be7-d0e1907df1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:01 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8a3fce70-1dbe-44c5-a386-c4888a542efb tempest-GroupsTest-1877539584 None] Flow 'volume_create_manager' (df7be78e-489c-474b-9a8b-f1e6c54d7cfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:19:01 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-8a3fce70-1dbe-44c5-a386-c4888a542efb tempest-GroupsTest-1877539584 None] Created volume successfully. Aug 31 15:19:01 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-00db33b9-4be0-4d61-9be5-6bd3407a5117 tempest-GroupsV314Test-1427951327 None] Acquiring lock "cinder-quobyte-f1871fbe-508e-403b-868c-d2310b1cf7b7" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:19:01 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-00db33b9-4be0-4d61-9be5-6bd3407a5117 tempest-GroupsV314Test-1427951327 None] Lock "cinder-quobyte-f1871fbe-508e-403b-868c-d2310b1cf7b7" acquired by "delete_volume" :: waited 0.021s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:19:01 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef7e8d9-d04b-4374-bab5-2b5a8fa30891]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:19:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-00db33b9-4be0-4d61-9be5-6bd3407a5117 tempest-GroupsV314Test-1427951327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f1871fbe-508e-403b-868c-d2310b1cf7b7 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:02 devstack sudo[95513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f1871fbe-508e-403b-868c-d2310b1cf7b7 Aug 31 15:19:02 devstack sudo[95513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:02 devstack sudo[95513]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-00db33b9-4be0-4d61-9be5-6bd3407a5117 tempest-GroupsV314Test-1427951327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f1871fbe-508e-403b-868c-d2310b1cf7b7" returned: 0 in 0.858s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-00db33b9-4be0-4d61-9be5-6bd3407a5117 tempest-GroupsV314Test-1427951327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f1871fbe-508e-403b-868c-d2310b1cf7b7 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:02 devstack sudo[95537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f1871fbe-508e-403b-868c-d2310b1cf7b7 Aug 31 15:19:02 devstack sudo[95537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:02 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-53f1d2fa-f4a3-448b-9894-7779139cb378 tempest-GroupsTest-1877539584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:19:02 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-53f1d2fa-f4a3-448b-9894-7779139cb378 tempest-GroupsTest-1877539584 None] Flow 'volume_create_manager' (62563f7e-848b-40f6-aac3-0bfd145b5e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:19:03 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-53f1d2fa-f4a3-448b-9894-7779139cb378 tempest-GroupsTest-1877539584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bdbfa84-b860-478c-867e-991d4fd91510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:03 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-53f1d2fa-f4a3-448b-9894-7779139cb378 tempest-GroupsTest-1877539584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bdbfa84-b860-478c-867e-991d4fd91510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1963003397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1eb92169-9290-40cb-b8e3-00d6e9df2bc1,host='devstack@QuobyteHD#QuobyteHD',id=882a9f92-b590-4c52-bc7f-55276c480b2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3680a229672f4c4681411c3ad57fe507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:19:03Z,use_quota=True,user_id='e933a385500446abac27c4140272decb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fcede0d-fd26-4098-8db6-62c41cb2ec1b),volume_type_id=6fcede0d-fd26-4098-8db6-62c41cb2ec1b)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:03 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-53f1d2fa-f4a3-448b-9894-7779139cb378 tempest-GroupsTest-1877539584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e5c883f-80a3-4eac-bc60-a569deca39cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:03 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-53f1d2fa-f4a3-448b-9894-7779139cb378 tempest-GroupsTest-1877539584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e5c883f-80a3-4eac-bc60-a569deca39cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:03 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-53f1d2fa-f4a3-448b-9894-7779139cb378 tempest-GroupsTest-1877539584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c21c1e5f-16eb-40c9-8952-0d5977c3a8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:03 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-53f1d2fa-f4a3-448b-9894-7779139cb378 tempest-GroupsTest-1877539584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c21c1e5f-16eb-40c9-8952-0d5977c3a8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '882a9f92-b590-4c52-bc7f-55276c480b2f', 'volume_name': 'volume-882a9f92-b590-4c52-bc7f-55276c480b2f', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:03 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-53f1d2fa-f4a3-448b-9894-7779139cb378 tempest-GroupsTest-1877539584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebd4e544-dc00-44c8-bcd1-743b01410abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:03 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-53f1d2fa-f4a3-448b-9894-7779139cb378 tempest-GroupsTest-1877539584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebd4e544-dc00-44c8-bcd1-743b01410abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:03 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-53f1d2fa-f4a3-448b-9894-7779139cb378 tempest-GroupsTest-1877539584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f38d73a0-8e9c-4b62-9391-a3832ee197d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:03 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-53f1d2fa-f4a3-448b-9894-7779139cb378 tempest-GroupsTest-1877539584 None] Volume 882a9f92-b590-4c52-bc7f-55276c480b2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-882a9f92-b590-4c52-bc7f-55276c480b2f', 'volume_size': 1} Aug 31 15:19:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-53f1d2fa-f4a3-448b-9894-7779139cb378 tempest-GroupsTest-1877539584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:19:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-53f1d2fa-f4a3-448b-9894-7779139cb378 tempest-GroupsTest-1877539584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:19:03 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-53f1d2fa-f4a3-448b-9894-7779139cb378 tempest-GroupsTest-1877539584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1eb92169-9290-40cb-b8e3-00d6e9df2bc1,created_at=2026-08-31T13:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1963003397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1eb92169-9290-40cb-b8e3-00d6e9df2bc1,host='devstack@QuobyteHD#QuobyteHD',id=882a9f92-b590-4c52-bc7f-55276c480b2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3680a229672f4c4681411c3ad57fe507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:19:03Z,use_quota=True,user_id='e933a385500446abac27c4140272decb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fcede0d-fd26-4098-8db6-62c41cb2ec1b),volume_type_id=6fcede0d-fd26-4098-8db6-62c41cb2ec1b)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:19:03 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-53f1d2fa-f4a3-448b-9894-7779139cb378 tempest-GroupsTest-1877539584 None] Creating volume 882a9f92-b590-4c52-bc7f-55276c480b2f {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:19:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-53f1d2fa-f4a3-448b-9894-7779139cb378 tempest-GroupsTest-1877539584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:19:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-53f1d2fa-f4a3-448b-9894-7779139cb378 tempest-GroupsTest-1877539584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:19:03 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-53f1d2fa-f4a3-448b-9894-7779139cb378 tempest-GroupsTest-1877539584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:19:03 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-53f1d2fa-f4a3-448b-9894-7779139cb378 tempest-GroupsTest-1877539584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:19:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-53f1d2fa-f4a3-448b-9894-7779139cb378 tempest-GroupsTest-1877539584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:19:03 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-53f1d2fa-f4a3-448b-9894-7779139cb378 tempest-GroupsTest-1877539584 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:19:03 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-53f1d2fa-f4a3-448b-9894-7779139cb378 tempest-GroupsTest-1877539584 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:19:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-53f1d2fa-f4a3-448b-9894-7779139cb378 tempest-GroupsTest-1877539584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-882a9f92-b590-4c52-bc7f-55276c480b2f 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:03 devstack sudo[95545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-882a9f92-b590-4c52-bc7f-55276c480b2f 1073741824 Aug 31 15:19:03 devstack sudo[95545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:03 devstack sudo[95537]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-00db33b9-4be0-4d61-9be5-6bd3407a5117 tempest-GroupsV314Test-1427951327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f1871fbe-508e-403b-868c-d2310b1cf7b7" returned: 0 in 0.512s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:03 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-00db33b9-4be0-4d61-9be5-6bd3407a5117 tempest-GroupsV314Test-1427951327 None] Lock "cinder-quobyte-f1871fbe-508e-403b-868c-d2310b1cf7b7" released by "delete_volume" :: held 1.462s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:19:03 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-00db33b9-4be0-4d61-9be5-6bd3407a5117 tempest-GroupsV314Test-1427951327 None] Created reservations ['6a1fc6f5-7e7c-4202-86c6-a8695bd7abc2'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:19:03 devstack cinder-volume[86000]: WARNING cinder.quota [None req-00db33b9-4be0-4d61-9be5-6bd3407a5117 tempest-GroupsV314Test-1427951327 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1274001801 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1274001801, it is now deprecated. Please use the default quota class for default quota. Aug 31 15:19:03 devstack cinder-volume[86000]: WARNING cinder.quota [None req-00db33b9-4be0-4d61-9be5-6bd3407a5117 tempest-GroupsV314Test-1427951327 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1274001801 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1274001801, it is now deprecated. Please use the default quota class for default quota. Aug 31 15:19:03 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-00db33b9-4be0-4d61-9be5-6bd3407a5117 tempest-GroupsV314Test-1427951327 None] Created reservations ['66bd4cba-ed34-4bb4-85c9-77809de5687c', '3d615058-8ea5-45ee-bf76-36386d15a43f', 'be5f8e75-80ac-42ec-8b29-2be8f4d0ea91', '349ab1ad-67f3-4cbf-984a-08b556dfd506'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:19:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-00db33b9-4be0-4d61-9be5-6bd3407a5117 tempest-GroupsV314Test-1427951327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:19:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-00db33b9-4be0-4d61-9be5-6bd3407a5117 tempest-GroupsV314Test-1427951327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:19:03 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-00db33b9-4be0-4d61-9be5-6bd3407a5117 tempest-GroupsV314Test-1427951327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:19:03 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-00db33b9-4be0-4d61-9be5-6bd3407a5117 tempest-GroupsV314Test-1427951327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:19:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-00db33b9-4be0-4d61-9be5-6bd3407a5117 tempest-GroupsV314Test-1427951327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:19:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-00db33b9-4be0-4d61-9be5-6bd3407a5117 tempest-GroupsV314Test-1427951327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:03 devstack sudo[95550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:19:03 devstack sudo[95550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:03 devstack sudo[95545]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-53f1d2fa-f4a3-448b-9894-7779139cb378 tempest-GroupsTest-1877539584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-882a9f92-b590-4c52-bc7f-55276c480b2f 1073741824" returned: 0 in 0.751s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-53f1d2fa-f4a3-448b-9894-7779139cb378 tempest-GroupsTest-1877539584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-882a9f92-b590-4c52-bc7f-55276c480b2f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:03 devstack sudo[95550]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-00db33b9-4be0-4d61-9be5-6bd3407a5117 tempest-GroupsV314Test-1427951327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.359s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:03 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-00db33b9-4be0-4d61-9be5-6bd3407a5117 tempest-GroupsV314Test-1427951327 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:19:03 devstack sudo[95556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-882a9f92-b590-4c52-bc7f-55276c480b2f Aug 31 15:19:03 devstack sudo[95556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:03 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-00db33b9-4be0-4d61-9be5-6bd3407a5117 tempest-GroupsV314Test-1427951327 None] Delete group completed successfully. Aug 31 15:19:04 devstack sudo[95556]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-53f1d2fa-f4a3-448b-9894-7779139cb378 tempest-GroupsTest-1877539584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-882a9f92-b590-4c52-bc7f-55276c480b2f" returned: 0 in 0.250s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:04 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-53f1d2fa-f4a3-448b-9894-7779139cb378 tempest-GroupsTest-1877539584 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:19:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-53f1d2fa-f4a3-448b-9894-7779139cb378 tempest-GroupsTest-1877539584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:19:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-53f1d2fa-f4a3-448b-9894-7779139cb378 tempest-GroupsTest-1877539584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f38d73a0-8e9c-4b62-9391-a3832ee197d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-882a9f92-b590-4c52-bc7f-55276c480b2f', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-53f1d2fa-f4a3-448b-9894-7779139cb378 tempest-GroupsTest-1877539584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b315aed5-05eb-400b-bab2-c1e5bda4cfc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:04 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-53f1d2fa-f4a3-448b-9894-7779139cb378 tempest-GroupsTest-1877539584 None] Volume volume-882a9f92-b590-4c52-bc7f-55276c480b2f (882a9f92-b590-4c52-bc7f-55276c480b2f): created successfully Aug 31 15:19:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-53f1d2fa-f4a3-448b-9894-7779139cb378 tempest-GroupsTest-1877539584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b315aed5-05eb-400b-bab2-c1e5bda4cfc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-53f1d2fa-f4a3-448b-9894-7779139cb378 tempest-GroupsTest-1877539584 None] Flow 'volume_create_manager' (62563f7e-848b-40f6-aac3-0bfd145b5e44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:19:04 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-53f1d2fa-f4a3-448b-9894-7779139cb378 tempest-GroupsTest-1877539584 None] Created volume successfully. Aug 31 15:19:04 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-059622bb-d2f0-4715-9446-8bb83e123190 tempest-GroupsTest-1877539584 None] Update group completed successfully. Aug 31 15:19:04 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-16ae5029-5204-4520-a79a-85a07b732b42 tempest-GroupsV314Test-1427951327 None] Acquiring lock "cinder-quobyte-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:19:04 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-16ae5029-5204-4520-a79a-85a07b732b42 tempest-GroupsV314Test-1427951327 None] Lock "cinder-quobyte-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c" acquired by "delete_volume" :: waited 0.020s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:19:04 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e041d6-7b2c-48ed-94cc-e3fb78200f55]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:19:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-16ae5029-5204-4520-a79a-85a07b732b42 tempest-GroupsV314Test-1427951327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:04 devstack sudo[95559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c Aug 31 15:19:04 devstack sudo[95559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:05 devstack sudo[95559]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-16ae5029-5204-4520-a79a-85a07b732b42 tempest-GroupsV314Test-1427951327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c" returned: 0 in 0.480s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-16ae5029-5204-4520-a79a-85a07b732b42 tempest-GroupsV314Test-1427951327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:05 devstack sudo[95565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c Aug 31 15:19:05 devstack sudo[95565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:05 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-e23d2a59-54a6-41c2-8fa2-4f4b341d430c req-c5d5f59a-effa-420b-aba2-1c901793ec09 tempest-ServerActionsTestOtherA-1383095791 None] Terminate volume connection completed successfully. Aug 31 15:19:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-e23d2a59-54a6-41c2-8fa2-4f4b341d430c req-c5d5f59a-effa-420b-aba2-1c901793ec09 tempest-ServerActionsTestOtherA-1383095791 None] Deleting attachment d306de77-6ba4-4382-b8dc-6010c797b985. {{(pid=86000) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 31 15:19:05 devstack sudo[95565]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-16ae5029-5204-4520-a79a-85a07b732b42 tempest-GroupsV314Test-1427951327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c" returned: 0 in 0.290s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:05 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-16ae5029-5204-4520-a79a-85a07b732b42 tempest-GroupsV314Test-1427951327 None] Lock "cinder-quobyte-a19cc623-8d5c-4c78-81ef-1d63ae0ada7c" released by "delete_volume" :: held 0.851s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:19:05 devstack cinder-volume[86000]: DEBUG cinder.coordination [req-e23d2a59-54a6-41c2-8fa2-4f4b341d430c req-5f2f70b7-9836-4d7b-80fb-8bd6000cd55a tempest-ServerActionsTestOtherA-1383095791 None] Acquiring lock "cinder-2ead9bc3-ff41-4835-9ae5-e094a887962c-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:19:05 devstack cinder-volume[86000]: DEBUG cinder.coordination [req-e23d2a59-54a6-41c2-8fa2-4f4b341d430c req-5f2f70b7-9836-4d7b-80fb-8bd6000cd55a tempest-ServerActionsTestOtherA-1383095791 None] Lock "cinder-2ead9bc3-ff41-4835-9ae5-e094a887962c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:19:05 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-16ae5029-5204-4520-a79a-85a07b732b42 tempest-GroupsV314Test-1427951327 None] Created reservations ['361a4dd5-5cae-4994-a7ff-1d0b5de190f5'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:19:05 devstack cinder-volume[86000]: DEBUG cinder.coordination [req-e23d2a59-54a6-41c2-8fa2-4f4b341d430c req-5f2f70b7-9836-4d7b-80fb-8bd6000cd55a tempest-ServerActionsTestOtherA-1383095791 None] Acquiring lock "cinder-quobyte-2ead9bc3-ff41-4835-9ae5-e094a887962c" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:19:05 devstack cinder-volume[86000]: DEBUG cinder.coordination [req-e23d2a59-54a6-41c2-8fa2-4f4b341d430c req-5f2f70b7-9836-4d7b-80fb-8bd6000cd55a tempest-ServerActionsTestOtherA-1383095791 None] Lock "cinder-quobyte-2ead9bc3-ff41-4835-9ae5-e094a887962c" acquired by "delete_volume" :: waited 0.035s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:19:05 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df7db03-98e3-463e-a1c6-3534d600448d]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:19:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-e23d2a59-54a6-41c2-8fa2-4f4b341d430c req-5f2f70b7-9836-4d7b-80fb-8bd6000cd55a tempest-ServerActionsTestOtherA-1383095791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2ead9bc3-ff41-4835-9ae5-e094a887962c {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:05 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-16ae5029-5204-4520-a79a-85a07b732b42 tempest-GroupsV314Test-1427951327 None] Created reservations ['c452f7f0-090e-40a1-9c83-729c8c7f6ed4', '46ff029c-1222-4d4e-b64a-625b74a4f4eb', '70e1fac3-35a4-4364-a5e0-c7a0174399f9', '0dbed441-e2a8-4a3c-ab9b-d2b845cf8f99'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:19:05 devstack sudo[95568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2ead9bc3-ff41-4835-9ae5-e094a887962c Aug 31 15:19:05 devstack sudo[95568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-16ae5029-5204-4520-a79a-85a07b732b42 tempest-GroupsV314Test-1427951327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-16ae5029-5204-4520-a79a-85a07b732b42 tempest-GroupsV314Test-1427951327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-16ae5029-5204-4520-a79a-85a07b732b42 tempest-GroupsV314Test-1427951327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-16ae5029-5204-4520-a79a-85a07b732b42 tempest-GroupsV314Test-1427951327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-16ae5029-5204-4520-a79a-85a07b732b42 tempest-GroupsV314Test-1427951327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-16ae5029-5204-4520-a79a-85a07b732b42 tempest-GroupsV314Test-1427951327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:06 devstack sudo[95570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:19:06 devstack sudo[95570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:06 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-c61e0a51-4d26-494b-9479-a5ec096d4828 tempest-GroupsTest-1877539584 None] Update group completed successfully. Aug 31 15:19:06 devstack sudo[95568]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-e23d2a59-54a6-41c2-8fa2-4f4b341d430c req-5f2f70b7-9836-4d7b-80fb-8bd6000cd55a tempest-ServerActionsTestOtherA-1383095791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2ead9bc3-ff41-4835-9ae5-e094a887962c" returned: 0 in 0.519s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-e23d2a59-54a6-41c2-8fa2-4f4b341d430c req-5f2f70b7-9836-4d7b-80fb-8bd6000cd55a tempest-ServerActionsTestOtherA-1383095791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2ead9bc3-ff41-4835-9ae5-e094a887962c {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:06 devstack sudo[95575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2ead9bc3-ff41-4835-9ae5-e094a887962c Aug 31 15:19:06 devstack sudo[95575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-00eba32b-e98e-4427-8253-2bff0f2e7ecb tempest-VolumesMetadataTest-1594274071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-00eba32b-e98e-4427-8253-2bff0f2e7ecb tempest-VolumesMetadataTest-1594274071 None] Flow 'volume_create_manager' (b19eeb66-f41f-493f-93e0-95eaaaf0cd9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-00eba32b-e98e-4427-8253-2bff0f2e7ecb tempest-VolumesMetadataTest-1594274071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (658e995e-3f5e-4c6e-8136-6e901610351a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-00eba32b-e98e-4427-8253-2bff0f2e7ecb tempest-VolumesMetadataTest-1594274071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (658e995e-3f5e-4c6e-8136-6e901610351a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1138115227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0abed71-83b9-48e9-bf8b-b495c55a7412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='844fd7457a20468c97a953f144812278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:19:06Z,use_quota=True,user_id='23a44a60147647f58a7549dd576826c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-00eba32b-e98e-4427-8253-2bff0f2e7ecb tempest-VolumesMetadataTest-1594274071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (460bc86d-c688-4400-9d00-879a01666e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-00eba32b-e98e-4427-8253-2bff0f2e7ecb tempest-VolumesMetadataTest-1594274071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (460bc86d-c688-4400-9d00-879a01666e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-00eba32b-e98e-4427-8253-2bff0f2e7ecb tempest-VolumesMetadataTest-1594274071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff5ed8e3-c5f1-4451-9cec-8a25f0a775c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-00eba32b-e98e-4427-8253-2bff0f2e7ecb tempest-VolumesMetadataTest-1594274071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff5ed8e3-c5f1-4451-9cec-8a25f0a775c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0abed71-83b9-48e9-bf8b-b495c55a7412', 'volume_name': 'volume-e0abed71-83b9-48e9-bf8b-b495c55a7412', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-00eba32b-e98e-4427-8253-2bff0f2e7ecb tempest-VolumesMetadataTest-1594274071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efb36377-a323-4da9-a282-a12ac88d28ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-00eba32b-e98e-4427-8253-2bff0f2e7ecb tempest-VolumesMetadataTest-1594274071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efb36377-a323-4da9-a282-a12ac88d28ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-00eba32b-e98e-4427-8253-2bff0f2e7ecb tempest-VolumesMetadataTest-1594274071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6571177-034a-439d-831e-159a84d8904f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:06 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-00eba32b-e98e-4427-8253-2bff0f2e7ecb tempest-VolumesMetadataTest-1594274071 None] Volume e0abed71-83b9-48e9-bf8b-b495c55a7412: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0abed71-83b9-48e9-bf8b-b495c55a7412', 'volume_size': 1} Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-00eba32b-e98e-4427-8253-2bff0f2e7ecb tempest-VolumesMetadataTest-1594274071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-00eba32b-e98e-4427-8253-2bff0f2e7ecb tempest-VolumesMetadataTest-1594274071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-00eba32b-e98e-4427-8253-2bff0f2e7ecb tempest-VolumesMetadataTest-1594274071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1138115227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0abed71-83b9-48e9-bf8b-b495c55a7412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='844fd7457a20468c97a953f144812278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:19:06Z,use_quota=True,user_id='23a44a60147647f58a7549dd576826c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-00eba32b-e98e-4427-8253-2bff0f2e7ecb tempest-VolumesMetadataTest-1594274071 None] Creating volume e0abed71-83b9-48e9-bf8b-b495c55a7412 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-00eba32b-e98e-4427-8253-2bff0f2e7ecb tempest-VolumesMetadataTest-1594274071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-00eba32b-e98e-4427-8253-2bff0f2e7ecb tempest-VolumesMetadataTest-1594274071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-00eba32b-e98e-4427-8253-2bff0f2e7ecb tempest-VolumesMetadataTest-1594274071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:19:06 devstack sudo[95570]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-00eba32b-e98e-4427-8253-2bff0f2e7ecb tempest-VolumesMetadataTest-1594274071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-00eba32b-e98e-4427-8253-2bff0f2e7ecb tempest-VolumesMetadataTest-1594274071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-00eba32b-e98e-4427-8253-2bff0f2e7ecb tempest-VolumesMetadataTest-1594274071 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:19:06 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-00eba32b-e98e-4427-8253-2bff0f2e7ecb tempest-VolumesMetadataTest-1594274071 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-00eba32b-e98e-4427-8253-2bff0f2e7ecb tempest-VolumesMetadataTest-1594274071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e0abed71-83b9-48e9-bf8b-b495c55a7412 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-16ae5029-5204-4520-a79a-85a07b732b42 tempest-GroupsV314Test-1427951327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.308s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-16ae5029-5204-4520-a79a-85a07b732b42 tempest-GroupsV314Test-1427951327 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:19:06 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-16ae5029-5204-4520-a79a-85a07b732b42 tempest-GroupsV314Test-1427951327 None] Delete group completed successfully. Aug 31 15:19:06 devstack sudo[95578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e0abed71-83b9-48e9-bf8b-b495c55a7412 1073741824 Aug 31 15:19:06 devstack sudo[95578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-04a03382-0042-483b-89a1-91807d436a2b tempest-ServerActionsTestOtherA-1383095791 None] Acquiring lock "cinder-7d108717-f218-4bc2-b7ad-28b3f585c248-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:19:06 devstack sudo[95575]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-e23d2a59-54a6-41c2-8fa2-4f4b341d430c req-5f2f70b7-9836-4d7b-80fb-8bd6000cd55a tempest-ServerActionsTestOtherA-1383095791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2ead9bc3-ff41-4835-9ae5-e094a887962c" returned: 0 in 0.347s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-04a03382-0042-483b-89a1-91807d436a2b tempest-ServerActionsTestOtherA-1383095791 None] Lock "cinder-7d108717-f218-4bc2-b7ad-28b3f585c248-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG cinder.coordination [req-e23d2a59-54a6-41c2-8fa2-4f4b341d430c req-5f2f70b7-9836-4d7b-80fb-8bd6000cd55a tempest-ServerActionsTestOtherA-1383095791 None] Lock "cinder-quobyte-2ead9bc3-ff41-4835-9ae5-e094a887962c" released by "delete_volume" :: held 0.935s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-04a03382-0042-483b-89a1-91807d436a2b tempest-ServerActionsTestOtherA-1383095791 None] Acquiring lock "cinder-quobyte-7d108717-f218-4bc2-b7ad-28b3f585c248" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-04a03382-0042-483b-89a1-91807d436a2b tempest-ServerActionsTestOtherA-1383095791 None] Lock "cinder-quobyte-7d108717-f218-4bc2-b7ad-28b3f585c248" acquired by "delete_volume" :: waited 0.019s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[94978681-7e12-49a5-82a5-a038475aeb8a]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-04a03382-0042-483b-89a1-91807d436a2b tempest-ServerActionsTestOtherA-1383095791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7d108717-f218-4bc2-b7ad-28b3f585c248 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG cinder.quota [req-e23d2a59-54a6-41c2-8fa2-4f4b341d430c req-5f2f70b7-9836-4d7b-80fb-8bd6000cd55a tempest-ServerActionsTestOtherA-1383095791 None] Created reservations ['3e0767a6-9aa6-4c76-b114-b74639afbca0', '87f14479-bd18-4bb6-a56e-c17a38bb5cd3', '856fb5ee-65ac-402f-a3fb-35fa34e0bc66', '1e598351-de6c-4ade-b9b6-78b4c977b463'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:19:06 devstack sudo[95584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7d108717-f218-4bc2-b7ad-28b3f585c248 Aug 31 15:19:06 devstack sudo[95584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-e23d2a59-54a6-41c2-8fa2-4f4b341d430c req-5f2f70b7-9836-4d7b-80fb-8bd6000cd55a tempest-ServerActionsTestOtherA-1383095791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-e23d2a59-54a6-41c2-8fa2-4f4b341d430c req-5f2f70b7-9836-4d7b-80fb-8bd6000cd55a tempest-ServerActionsTestOtherA-1383095791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [req-e23d2a59-54a6-41c2-8fa2-4f4b341d430c req-5f2f70b7-9836-4d7b-80fb-8bd6000cd55a tempest-ServerActionsTestOtherA-1383095791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [req-e23d2a59-54a6-41c2-8fa2-4f4b341d430c req-5f2f70b7-9836-4d7b-80fb-8bd6000cd55a tempest-ServerActionsTestOtherA-1383095791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-e23d2a59-54a6-41c2-8fa2-4f4b341d430c req-5f2f70b7-9836-4d7b-80fb-8bd6000cd55a tempest-ServerActionsTestOtherA-1383095791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-e23d2a59-54a6-41c2-8fa2-4f4b341d430c req-5f2f70b7-9836-4d7b-80fb-8bd6000cd55a tempest-ServerActionsTestOtherA-1383095791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:06 devstack sudo[95578]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-00eba32b-e98e-4427-8253-2bff0f2e7ecb tempest-VolumesMetadataTest-1594274071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e0abed71-83b9-48e9-bf8b-b495c55a7412 1073741824" returned: 0 in 0.449s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:06 devstack sudo[95587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:19:06 devstack sudo[95587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-00eba32b-e98e-4427-8253-2bff0f2e7ecb tempest-VolumesMetadataTest-1594274071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e0abed71-83b9-48e9-bf8b-b495c55a7412 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:06 devstack sudo[95589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e0abed71-83b9-48e9-bf8b-b495c55a7412 Aug 31 15:19:06 devstack sudo[95589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:07 devstack sudo[95584]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-04a03382-0042-483b-89a1-91807d436a2b tempest-ServerActionsTestOtherA-1383095791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7d108717-f218-4bc2-b7ad-28b3f585c248" returned: 0 in 0.387s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-04a03382-0042-483b-89a1-91807d436a2b tempest-ServerActionsTestOtherA-1383095791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7d108717-f218-4bc2-b7ad-28b3f585c248 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:07 devstack sudo[95587]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:07 devstack sudo[95595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7d108717-f218-4bc2-b7ad-28b3f585c248 Aug 31 15:19:07 devstack sudo[95595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-e23d2a59-54a6-41c2-8fa2-4f4b341d430c req-5f2f70b7-9836-4d7b-80fb-8bd6000cd55a tempest-ServerActionsTestOtherA-1383095791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.273s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:07 devstack cinder-volume[86000]: DEBUG cinder.manager [req-e23d2a59-54a6-41c2-8fa2-4f4b341d430c req-5f2f70b7-9836-4d7b-80fb-8bd6000cd55a tempest-ServerActionsTestOtherA-1383095791 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:19:07 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-e23d2a59-54a6-41c2-8fa2-4f4b341d430c req-5f2f70b7-9836-4d7b-80fb-8bd6000cd55a tempest-ServerActionsTestOtherA-1383095791 None] Deleted volume successfully. Aug 31 15:19:07 devstack cinder-volume[86000]: DEBUG cinder.coordination [req-e23d2a59-54a6-41c2-8fa2-4f4b341d430c req-5f2f70b7-9836-4d7b-80fb-8bd6000cd55a tempest-ServerActionsTestOtherA-1383095791 None] Lock "cinder-2ead9bc3-ff41-4835-9ae5-e094a887962c-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:19:07 devstack sudo[95589]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-00eba32b-e98e-4427-8253-2bff0f2e7ecb tempest-VolumesMetadataTest-1594274071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e0abed71-83b9-48e9-bf8b-b495c55a7412" returned: 0 in 0.301s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:07 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-00eba32b-e98e-4427-8253-2bff0f2e7ecb tempest-VolumesMetadataTest-1594274071 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:19:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-00eba32b-e98e-4427-8253-2bff0f2e7ecb tempest-VolumesMetadataTest-1594274071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:19:07 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-00eba32b-e98e-4427-8253-2bff0f2e7ecb tempest-VolumesMetadataTest-1594274071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6571177-034a-439d-831e-159a84d8904f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0abed71-83b9-48e9-bf8b-b495c55a7412', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:07 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-00eba32b-e98e-4427-8253-2bff0f2e7ecb tempest-VolumesMetadataTest-1594274071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc3fdbc-e890-475f-b6ec-ba8c4e6143e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:07 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-00eba32b-e98e-4427-8253-2bff0f2e7ecb tempest-VolumesMetadataTest-1594274071 None] Volume volume-e0abed71-83b9-48e9-bf8b-b495c55a7412 (e0abed71-83b9-48e9-bf8b-b495c55a7412): created successfully Aug 31 15:19:07 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-00eba32b-e98e-4427-8253-2bff0f2e7ecb tempest-VolumesMetadataTest-1594274071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc3fdbc-e890-475f-b6ec-ba8c4e6143e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:07 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-00eba32b-e98e-4427-8253-2bff0f2e7ecb tempest-VolumesMetadataTest-1594274071 None] Flow 'volume_create_manager' (b19eeb66-f41f-493f-93e0-95eaaaf0cd9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:19:07 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-00eba32b-e98e-4427-8253-2bff0f2e7ecb tempest-VolumesMetadataTest-1594274071 None] Created volume successfully. Aug 31 15:19:07 devstack sudo[95595]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-04a03382-0042-483b-89a1-91807d436a2b tempest-ServerActionsTestOtherA-1383095791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7d108717-f218-4bc2-b7ad-28b3f585c248" returned: 0 in 0.340s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:07 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-04a03382-0042-483b-89a1-91807d436a2b tempest-ServerActionsTestOtherA-1383095791 None] Lock "cinder-quobyte-7d108717-f218-4bc2-b7ad-28b3f585c248" released by "delete_volume" :: held 0.770s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:19:07 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-04a03382-0042-483b-89a1-91807d436a2b tempest-ServerActionsTestOtherA-1383095791 None] Created reservations ['9105160f-a38e-4499-a9d1-b8ce453d6aae', '66f6e385-7924-460d-9f46-bcdc2fb60351', '3ccb386d-6068-4584-9713-ad60e53bce4b', '581773e7-3c69-4fb3-88b6-0b20338633c6'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:19:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-04a03382-0042-483b-89a1-91807d436a2b tempest-ServerActionsTestOtherA-1383095791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:19:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-04a03382-0042-483b-89a1-91807d436a2b tempest-ServerActionsTestOtherA-1383095791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:19:07 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-04a03382-0042-483b-89a1-91807d436a2b tempest-ServerActionsTestOtherA-1383095791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:19:07 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-04a03382-0042-483b-89a1-91807d436a2b tempest-ServerActionsTestOtherA-1383095791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:19:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-04a03382-0042-483b-89a1-91807d436a2b tempest-ServerActionsTestOtherA-1383095791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:19:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-04a03382-0042-483b-89a1-91807d436a2b tempest-ServerActionsTestOtherA-1383095791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:07 devstack sudo[95599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:19:07 devstack sudo[95599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:07 devstack sudo[95599]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-04a03382-0042-483b-89a1-91807d436a2b tempest-ServerActionsTestOtherA-1383095791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.290s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:07 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-04a03382-0042-483b-89a1-91807d436a2b tempest-ServerActionsTestOtherA-1383095791 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:19:07 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-04a03382-0042-483b-89a1-91807d436a2b tempest-ServerActionsTestOtherA-1383095791 None] Deleted volume successfully. Aug 31 15:19:07 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-04a03382-0042-483b-89a1-91807d436a2b tempest-ServerActionsTestOtherA-1383095791 None] Lock "cinder-7d108717-f218-4bc2-b7ad-28b3f585c248-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:19:08 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-2a3c2154-135a-4d4d-9ca0-cc6df94d6f61 tempest-GroupsTest-1877539584 None] Acquiring lock "cinder-quobyte-5af53f6c-f0ec-45da-b757-d85787780ed7" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:19:08 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-2a3c2154-135a-4d4d-9ca0-cc6df94d6f61 tempest-GroupsTest-1877539584 None] Lock "cinder-quobyte-5af53f6c-f0ec-45da-b757-d85787780ed7" acquired by "delete_volume" :: waited 0.026s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:19:08 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2cb357-31c1-499d-a352-b2fff48f2c17]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:19:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2a3c2154-135a-4d4d-9ca0-cc6df94d6f61 tempest-GroupsTest-1877539584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-5af53f6c-f0ec-45da-b757-d85787780ed7 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:08 devstack sudo[95604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-5af53f6c-f0ec-45da-b757-d85787780ed7 Aug 31 15:19:08 devstack sudo[95604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:08 devstack sudo[95604]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2a3c2154-135a-4d4d-9ca0-cc6df94d6f61 tempest-GroupsTest-1877539584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-5af53f6c-f0ec-45da-b757-d85787780ed7" returned: 0 in 0.740s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2a3c2154-135a-4d4d-9ca0-cc6df94d6f61 tempest-GroupsTest-1877539584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-5af53f6c-f0ec-45da-b757-d85787780ed7 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:08 devstack sudo[95630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-5af53f6c-f0ec-45da-b757-d85787780ed7 Aug 31 15:19:08 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:09 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2a3c2154-135a-4d4d-9ca0-cc6df94d6f61 tempest-GroupsTest-1877539584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-5af53f6c-f0ec-45da-b757-d85787780ed7" returned: 0 in 0.454s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:09 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-2a3c2154-135a-4d4d-9ca0-cc6df94d6f61 tempest-GroupsTest-1877539584 None] Lock "cinder-quobyte-5af53f6c-f0ec-45da-b757-d85787780ed7" released by "delete_volume" :: held 1.251s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:19:09 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-2a3c2154-135a-4d4d-9ca0-cc6df94d6f61 tempest-GroupsTest-1877539584 None] Acquiring lock "cinder-quobyte-882a9f92-b590-4c52-bc7f-55276c480b2f" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:19:09 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-2a3c2154-135a-4d4d-9ca0-cc6df94d6f61 tempest-GroupsTest-1877539584 None] Lock "cinder-quobyte-882a9f92-b590-4c52-bc7f-55276c480b2f" acquired by "delete_volume" :: waited 0.038s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:19:09 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[95adc0e6-387c-4a9f-ab36-9e80fd800574]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:19:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2a3c2154-135a-4d4d-9ca0-cc6df94d6f61 tempest-GroupsTest-1877539584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-882a9f92-b590-4c52-bc7f-55276c480b2f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:09 devstack sudo[95634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-882a9f92-b590-4c52-bc7f-55276c480b2f Aug 31 15:19:09 devstack sudo[95634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:09 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-9996aaca-7d5d-4295-b128-94575a3e619a tempest-VolumesMetadataTest-1594274071 None] Acquiring lock "cinder-e0abed71-83b9-48e9-bf8b-b495c55a7412-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:19:09 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-9996aaca-7d5d-4295-b128-94575a3e619a tempest-VolumesMetadataTest-1594274071 None] Lock "cinder-e0abed71-83b9-48e9-bf8b-b495c55a7412-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:19:09 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-9996aaca-7d5d-4295-b128-94575a3e619a tempest-VolumesMetadataTest-1594274071 None] Acquiring lock "cinder-quobyte-e0abed71-83b9-48e9-bf8b-b495c55a7412" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:19:09 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-9996aaca-7d5d-4295-b128-94575a3e619a tempest-VolumesMetadataTest-1594274071 None] Lock "cinder-quobyte-e0abed71-83b9-48e9-bf8b-b495c55a7412" acquired by "delete_volume" :: waited 0.021s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:19:09 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54c2d1c-a40d-437c-990b-82d311dfe420]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:19:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9996aaca-7d5d-4295-b128-94575a3e619a tempest-VolumesMetadataTest-1594274071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e0abed71-83b9-48e9-bf8b-b495c55a7412 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:10 devstack sudo[95638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e0abed71-83b9-48e9-bf8b-b495c55a7412 Aug 31 15:19:10 devstack sudo[95638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:10 devstack sudo[95634]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2a3c2154-135a-4d4d-9ca0-cc6df94d6f61 tempest-GroupsTest-1877539584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-882a9f92-b590-4c52-bc7f-55276c480b2f" returned: 0 in 0.572s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2a3c2154-135a-4d4d-9ca0-cc6df94d6f61 tempest-GroupsTest-1877539584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-882a9f92-b590-4c52-bc7f-55276c480b2f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:10 devstack sudo[95643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-882a9f92-b590-4c52-bc7f-55276c480b2f Aug 31 15:19:10 devstack sudo[95643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:10 devstack sudo[95638]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9996aaca-7d5d-4295-b128-94575a3e619a tempest-VolumesMetadataTest-1594274071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e0abed71-83b9-48e9-bf8b-b495c55a7412" returned: 0 in 0.496s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9996aaca-7d5d-4295-b128-94575a3e619a tempest-VolumesMetadataTest-1594274071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e0abed71-83b9-48e9-bf8b-b495c55a7412 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:10 devstack sudo[95643]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2a3c2154-135a-4d4d-9ca0-cc6df94d6f61 tempest-GroupsTest-1877539584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-882a9f92-b590-4c52-bc7f-55276c480b2f" returned: 0 in 0.342s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:10 devstack sudo[95649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e0abed71-83b9-48e9-bf8b-b495c55a7412 Aug 31 15:19:10 devstack sudo[95649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:10 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-2a3c2154-135a-4d4d-9ca0-cc6df94d6f61 tempest-GroupsTest-1877539584 None] Lock "cinder-quobyte-882a9f92-b590-4c52-bc7f-55276c480b2f" released by "delete_volume" :: held 1.024s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:19:10 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-2a3c2154-135a-4d4d-9ca0-cc6df94d6f61 tempest-GroupsTest-1877539584 None] Created reservations ['95030adc-5e57-4a4a-989b-ea79d051c27e'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:19:10 devstack cinder-volume[86000]: WARNING cinder.quota [None req-2a3c2154-135a-4d4d-9ca0-cc6df94d6f61 tempest-GroupsTest-1877539584 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1081579960 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1081579960, it is now deprecated. Please use the default quota class for default quota. Aug 31 15:19:10 devstack cinder-volume[86000]: WARNING cinder.quota [None req-2a3c2154-135a-4d4d-9ca0-cc6df94d6f61 tempest-GroupsTest-1877539584 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1081579960 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1081579960, it is now deprecated. Please use the default quota class for default quota. Aug 31 15:19:10 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-2a3c2154-135a-4d4d-9ca0-cc6df94d6f61 tempest-GroupsTest-1877539584 None] Created reservations ['02241703-322f-4074-a201-afa66c2d5d74', 'ba34d1aa-289f-4906-af36-5248a709b267', '83928f66-1795-4966-b991-a736de279be9', '361d1290-be08-4725-b8f9-424b4d2c8319'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:19:10 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-2a3c2154-135a-4d4d-9ca0-cc6df94d6f61 tempest-GroupsTest-1877539584 None] Created reservations ['c9f0d7c9-7534-43a5-bbe7-1de659a7f922', '87c17c37-a9d8-4c74-8e20-e73008e62fd9', 'f3c6df8e-0e42-419f-85b2-123c9727a67f', 'a5a46c7a-8429-4eec-8304-cea9d4d8725c'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:19:10 devstack sudo[95649]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9996aaca-7d5d-4295-b128-94575a3e619a tempest-VolumesMetadataTest-1594274071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e0abed71-83b9-48e9-bf8b-b495c55a7412" returned: 0 in 0.385s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:10 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-9996aaca-7d5d-4295-b128-94575a3e619a tempest-VolumesMetadataTest-1594274071 None] Lock "cinder-quobyte-e0abed71-83b9-48e9-bf8b-b495c55a7412" released by "delete_volume" :: held 0.931s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:19:10 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-9996aaca-7d5d-4295-b128-94575a3e619a tempest-VolumesMetadataTest-1594274071 None] Created reservations ['993f839f-0833-4758-a234-87bf22eb108d', '2efb8743-0351-4177-8978-9119cddad4d1', '3c02f6f0-1b8b-48de-8a1f-f5b5fb82136f', 'ca77eba9-9ed0-4bd8-876b-8acc6eb027a1'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:19:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-2a3c2154-135a-4d4d-9ca0-cc6df94d6f61 tempest-GroupsTest-1877539584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:19:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-2a3c2154-135a-4d4d-9ca0-cc6df94d6f61 tempest-GroupsTest-1877539584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:19:10 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-2a3c2154-135a-4d4d-9ca0-cc6df94d6f61 tempest-GroupsTest-1877539584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:19:10 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-2a3c2154-135a-4d4d-9ca0-cc6df94d6f61 tempest-GroupsTest-1877539584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:19:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-2a3c2154-135a-4d4d-9ca0-cc6df94d6f61 tempest-GroupsTest-1877539584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:19:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2a3c2154-135a-4d4d-9ca0-cc6df94d6f61 tempest-GroupsTest-1877539584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:10 devstack sudo[95652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:19:10 devstack sudo[95652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9996aaca-7d5d-4295-b128-94575a3e619a tempest-VolumesMetadataTest-1594274071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:19:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9996aaca-7d5d-4295-b128-94575a3e619a tempest-VolumesMetadataTest-1594274071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:19:11 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-9996aaca-7d5d-4295-b128-94575a3e619a tempest-VolumesMetadataTest-1594274071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:19:11 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-9996aaca-7d5d-4295-b128-94575a3e619a tempest-VolumesMetadataTest-1594274071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:19:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9996aaca-7d5d-4295-b128-94575a3e619a tempest-VolumesMetadataTest-1594274071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:19:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9996aaca-7d5d-4295-b128-94575a3e619a tempest-VolumesMetadataTest-1594274071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:11 devstack sudo[95654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:19:11 devstack sudo[95654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:11 devstack sudo[95652]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2a3c2154-135a-4d4d-9ca0-cc6df94d6f61 tempest-GroupsTest-1877539584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.301s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:11 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-2a3c2154-135a-4d4d-9ca0-cc6df94d6f61 tempest-GroupsTest-1877539584 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:19:11 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-2a3c2154-135a-4d4d-9ca0-cc6df94d6f61 tempest-GroupsTest-1877539584 None] Delete group completed successfully. Aug 31 15:19:11 devstack sudo[95654]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9996aaca-7d5d-4295-b128-94575a3e619a tempest-VolumesMetadataTest-1594274071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.360s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:11 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-9996aaca-7d5d-4295-b128-94575a3e619a tempest-VolumesMetadataTest-1594274071 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:19:11 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-9996aaca-7d5d-4295-b128-94575a3e619a tempest-VolumesMetadataTest-1594274071 None] Deleted volume successfully. Aug 31 15:19:11 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-9996aaca-7d5d-4295-b128-94575a3e619a tempest-VolumesMetadataTest-1594274071 None] Lock "cinder-e0abed71-83b9-48e9-bf8b-b495c55a7412-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:19:14 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-41fb870a-945f-4f9c-8468-81c8e1ca477e tempest-GroupsV320Test-576715760 None] Group tempest-GroupsV320Test-Group-605610426: creating Aug 31 15:19:14 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-41fb870a-945f-4f9c-8468-81c8e1ca477e tempest-GroupsV320Test-576715760 None] Group tempest-GroupsV320Test-Group-605610426: created successfully Aug 31 15:19:14 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-41fb870a-945f-4f9c-8468-81c8e1ca477e tempest-GroupsV320Test-576715760 None] Create group completed successfully. Aug 31 15:19:16 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:SELECT=154,cinder:INSERT=39,cinder:UPDATE=185,cinder:DELETE=8 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:19:16 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:UPDATE=155,cinder:SELECT=156,cinder:INSERT=36,cinder:DELETE=8 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:19:16 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-99b49694-5b03-4479-bd65-6e3b062537ae tempest-GroupsV320Test-576715760 None] Created reservations ['cacd56f0-b2a6-400d-8c5d-745365ad60f0'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:19:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-99b49694-5b03-4479-bd65-6e3b062537ae tempest-GroupsV320Test-576715760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:19:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-99b49694-5b03-4479-bd65-6e3b062537ae tempest-GroupsV320Test-576715760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:19:16 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-99b49694-5b03-4479-bd65-6e3b062537ae tempest-GroupsV320Test-576715760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:19:16 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-99b49694-5b03-4479-bd65-6e3b062537ae tempest-GroupsV320Test-576715760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:19:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-99b49694-5b03-4479-bd65-6e3b062537ae tempest-GroupsV320Test-576715760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:19:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-99b49694-5b03-4479-bd65-6e3b062537ae tempest-GroupsV320Test-576715760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:16 devstack sudo[95695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:19:16 devstack sudo[95695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:17 devstack sudo[95695]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-99b49694-5b03-4479-bd65-6e3b062537ae tempest-GroupsV320Test-576715760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.409s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:17 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-99b49694-5b03-4479-bd65-6e3b062537ae tempest-GroupsV320Test-576715760 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:19:17 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-99b49694-5b03-4479-bd65-6e3b062537ae tempest-GroupsV320Test-576715760 None] Delete group completed successfully. Aug 31 15:19:22 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8f38ad5-6ba2-42b7-86fd-cca12f7ab206 tempest-VolumesTestJSON-1797541439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:19:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e8f38ad5-6ba2-42b7-86fd-cca12f7ab206 tempest-VolumesTestJSON-1797541439 None] Flow 'volume_create_manager' (37f02a42-e140-4f99-80aa-dd24bd6dfbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:19:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e8f38ad5-6ba2-42b7-86fd-cca12f7ab206 tempest-VolumesTestJSON-1797541439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e44e736f-cc00-4e13-a971-097440eed93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e8f38ad5-6ba2-42b7-86fd-cca12f7ab206 tempest-VolumesTestJSON-1797541439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e44e736f-cc00-4e13-a971-097440eed93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-408218262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ed18023-be0a-47d2-952b-602daf7fc681,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b89474bcb09b45ceac98fe43c7f01a41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:19:22Z,use_quota=True,user_id='8083cd66e4394f838c3f54685b047f31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e8f38ad5-6ba2-42b7-86fd-cca12f7ab206 tempest-VolumesTestJSON-1797541439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c6a44e7-f7e0-4e81-b5e1-448ef1cf9f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e8f38ad5-6ba2-42b7-86fd-cca12f7ab206 tempest-VolumesTestJSON-1797541439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c6a44e7-f7e0-4e81-b5e1-448ef1cf9f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e8f38ad5-6ba2-42b7-86fd-cca12f7ab206 tempest-VolumesTestJSON-1797541439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdf2547f-700f-41ae-947c-5118cb8012db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e8f38ad5-6ba2-42b7-86fd-cca12f7ab206 tempest-VolumesTestJSON-1797541439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdf2547f-700f-41ae-947c-5118cb8012db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ed18023-be0a-47d2-952b-602daf7fc681', 'volume_name': 'volume-6ed18023-be0a-47d2-952b-602daf7fc681', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e8f38ad5-6ba2-42b7-86fd-cca12f7ab206 tempest-VolumesTestJSON-1797541439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f2ee876-eff1-43ad-af71-0cdb226945de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e8f38ad5-6ba2-42b7-86fd-cca12f7ab206 tempest-VolumesTestJSON-1797541439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f2ee876-eff1-43ad-af71-0cdb226945de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e8f38ad5-6ba2-42b7-86fd-cca12f7ab206 tempest-VolumesTestJSON-1797541439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7307999d-cb2b-4224-9369-86b35914674d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:22 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-e8f38ad5-6ba2-42b7-86fd-cca12f7ab206 tempest-VolumesTestJSON-1797541439 None] Volume 6ed18023-be0a-47d2-952b-602daf7fc681: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ed18023-be0a-47d2-952b-602daf7fc681', 'volume_size': 1} Aug 31 15:19:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e8f38ad5-6ba2-42b7-86fd-cca12f7ab206 tempest-VolumesTestJSON-1797541439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:19:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e8f38ad5-6ba2-42b7-86fd-cca12f7ab206 tempest-VolumesTestJSON-1797541439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:19:22 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-e8f38ad5-6ba2-42b7-86fd-cca12f7ab206 tempest-VolumesTestJSON-1797541439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-408218262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ed18023-be0a-47d2-952b-602daf7fc681,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b89474bcb09b45ceac98fe43c7f01a41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:19:22Z,use_quota=True,user_id='8083cd66e4394f838c3f54685b047f31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:19:22 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-e8f38ad5-6ba2-42b7-86fd-cca12f7ab206 tempest-VolumesTestJSON-1797541439 None] Creating volume 6ed18023-be0a-47d2-952b-602daf7fc681 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:19:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e8f38ad5-6ba2-42b7-86fd-cca12f7ab206 tempest-VolumesTestJSON-1797541439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:19:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e8f38ad5-6ba2-42b7-86fd-cca12f7ab206 tempest-VolumesTestJSON-1797541439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:19:22 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-e8f38ad5-6ba2-42b7-86fd-cca12f7ab206 tempest-VolumesTestJSON-1797541439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:19:22 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-e8f38ad5-6ba2-42b7-86fd-cca12f7ab206 tempest-VolumesTestJSON-1797541439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:19:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e8f38ad5-6ba2-42b7-86fd-cca12f7ab206 tempest-VolumesTestJSON-1797541439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:19:22 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-e8f38ad5-6ba2-42b7-86fd-cca12f7ab206 tempest-VolumesTestJSON-1797541439 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:19:22 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-e8f38ad5-6ba2-42b7-86fd-cca12f7ab206 tempest-VolumesTestJSON-1797541439 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:19:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e8f38ad5-6ba2-42b7-86fd-cca12f7ab206 tempest-VolumesTestJSON-1797541439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6ed18023-be0a-47d2-952b-602daf7fc681 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:22 devstack sudo[95705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6ed18023-be0a-47d2-952b-602daf7fc681 1073741824 Aug 31 15:19:22 devstack sudo[95705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:22 devstack sudo[95705]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e8f38ad5-6ba2-42b7-86fd-cca12f7ab206 tempest-VolumesTestJSON-1797541439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6ed18023-be0a-47d2-952b-602daf7fc681 1073741824" returned: 0 in 0.571s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e8f38ad5-6ba2-42b7-86fd-cca12f7ab206 tempest-VolumesTestJSON-1797541439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6ed18023-be0a-47d2-952b-602daf7fc681 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:23 devstack sudo[95711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6ed18023-be0a-47d2-952b-602daf7fc681 Aug 31 15:19:23 devstack sudo[95711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:23 devstack sudo[95711]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e8f38ad5-6ba2-42b7-86fd-cca12f7ab206 tempest-VolumesTestJSON-1797541439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6ed18023-be0a-47d2-952b-602daf7fc681" returned: 0 in 0.393s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:23 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-e8f38ad5-6ba2-42b7-86fd-cca12f7ab206 tempest-VolumesTestJSON-1797541439 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:19:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e8f38ad5-6ba2-42b7-86fd-cca12f7ab206 tempest-VolumesTestJSON-1797541439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:19:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e8f38ad5-6ba2-42b7-86fd-cca12f7ab206 tempest-VolumesTestJSON-1797541439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7307999d-cb2b-4224-9369-86b35914674d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ed18023-be0a-47d2-952b-602daf7fc681', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e8f38ad5-6ba2-42b7-86fd-cca12f7ab206 tempest-VolumesTestJSON-1797541439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e86b5056-4544-497c-ac9c-d197911a923d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:23 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-e8f38ad5-6ba2-42b7-86fd-cca12f7ab206 tempest-VolumesTestJSON-1797541439 None] Volume volume-6ed18023-be0a-47d2-952b-602daf7fc681 (6ed18023-be0a-47d2-952b-602daf7fc681): created successfully Aug 31 15:19:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e8f38ad5-6ba2-42b7-86fd-cca12f7ab206 tempest-VolumesTestJSON-1797541439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e86b5056-4544-497c-ac9c-d197911a923d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e8f38ad5-6ba2-42b7-86fd-cca12f7ab206 tempest-VolumesTestJSON-1797541439 None] Flow 'volume_create_manager' (37f02a42-e140-4f99-80aa-dd24bd6dfbb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:19:23 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-e8f38ad5-6ba2-42b7-86fd-cca12f7ab206 tempest-VolumesTestJSON-1797541439 None] Created volume successfully. Aug 31 15:19:25 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-c084aa64-8850-4a76-ae45-3014cdee051b tempest-VolumesTestJSON-1797541439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:19:25 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c084aa64-8850-4a76-ae45-3014cdee051b tempest-VolumesTestJSON-1797541439 None] Flow 'volume_create_manager' (80668765-55c2-4397-92e4-6fcc98fa789c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:19:25 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c084aa64-8850-4a76-ae45-3014cdee051b tempest-VolumesTestJSON-1797541439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e44d345f-a3c6-49d4-ba34-82debdfcdadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:25 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c084aa64-8850-4a76-ae45-3014cdee051b tempest-VolumesTestJSON-1797541439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e44d345f-a3c6-49d4-ba34-82debdfcdadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1017150290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8284c8da-883a-42b0-950e-22556492f878,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b89474bcb09b45ceac98fe43c7f01a41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:19:25Z,use_quota=True,user_id='8083cd66e4394f838c3f54685b047f31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:25 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c084aa64-8850-4a76-ae45-3014cdee051b tempest-VolumesTestJSON-1797541439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ce11e25-69af-497b-9ce6-acafcb4cf6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:25 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c084aa64-8850-4a76-ae45-3014cdee051b tempest-VolumesTestJSON-1797541439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ce11e25-69af-497b-9ce6-acafcb4cf6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:25 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c084aa64-8850-4a76-ae45-3014cdee051b tempest-VolumesTestJSON-1797541439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac26f192-90d7-4485-95ab-0da269095ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:25 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c084aa64-8850-4a76-ae45-3014cdee051b tempest-VolumesTestJSON-1797541439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac26f192-90d7-4485-95ab-0da269095ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8284c8da-883a-42b0-950e-22556492f878', 'volume_name': 'volume-8284c8da-883a-42b0-950e-22556492f878', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:25 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c084aa64-8850-4a76-ae45-3014cdee051b tempest-VolumesTestJSON-1797541439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ed55576-f704-46db-8ce6-03bc2bc30c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:25 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c084aa64-8850-4a76-ae45-3014cdee051b tempest-VolumesTestJSON-1797541439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ed55576-f704-46db-8ce6-03bc2bc30c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:25 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c084aa64-8850-4a76-ae45-3014cdee051b tempest-VolumesTestJSON-1797541439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80db6dca-1934-41a2-aab8-691572518df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:25 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-c084aa64-8850-4a76-ae45-3014cdee051b tempest-VolumesTestJSON-1797541439 None] Volume 8284c8da-883a-42b0-950e-22556492f878: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8284c8da-883a-42b0-950e-22556492f878', 'volume_size': 1} Aug 31 15:19:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c084aa64-8850-4a76-ae45-3014cdee051b tempest-VolumesTestJSON-1797541439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:19:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c084aa64-8850-4a76-ae45-3014cdee051b tempest-VolumesTestJSON-1797541439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:19:25 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c084aa64-8850-4a76-ae45-3014cdee051b tempest-VolumesTestJSON-1797541439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1017150290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8284c8da-883a-42b0-950e-22556492f878,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b89474bcb09b45ceac98fe43c7f01a41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:19:25Z,use_quota=True,user_id='8083cd66e4394f838c3f54685b047f31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:19:25 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-c084aa64-8850-4a76-ae45-3014cdee051b tempest-VolumesTestJSON-1797541439 None] Creating volume 8284c8da-883a-42b0-950e-22556492f878 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:19:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c084aa64-8850-4a76-ae45-3014cdee051b tempest-VolumesTestJSON-1797541439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:19:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c084aa64-8850-4a76-ae45-3014cdee051b tempest-VolumesTestJSON-1797541439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:19:25 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c084aa64-8850-4a76-ae45-3014cdee051b tempest-VolumesTestJSON-1797541439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:19:25 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c084aa64-8850-4a76-ae45-3014cdee051b tempest-VolumesTestJSON-1797541439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:19:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c084aa64-8850-4a76-ae45-3014cdee051b tempest-VolumesTestJSON-1797541439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:19:25 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c084aa64-8850-4a76-ae45-3014cdee051b tempest-VolumesTestJSON-1797541439 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:19:25 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-c084aa64-8850-4a76-ae45-3014cdee051b tempest-VolumesTestJSON-1797541439 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:19:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c084aa64-8850-4a76-ae45-3014cdee051b tempest-VolumesTestJSON-1797541439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8284c8da-883a-42b0-950e-22556492f878 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:25 devstack sudo[95714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8284c8da-883a-42b0-950e-22556492f878 1073741824 Aug 31 15:19:25 devstack sudo[95714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:26 devstack sudo[95714]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c084aa64-8850-4a76-ae45-3014cdee051b tempest-VolumesTestJSON-1797541439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8284c8da-883a-42b0-950e-22556492f878 1073741824" returned: 0 in 0.615s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c084aa64-8850-4a76-ae45-3014cdee051b tempest-VolumesTestJSON-1797541439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8284c8da-883a-42b0-950e-22556492f878 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:26 devstack sudo[95720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8284c8da-883a-42b0-950e-22556492f878 Aug 31 15:19:26 devstack sudo[95720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:26 devstack sudo[95720]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c084aa64-8850-4a76-ae45-3014cdee051b tempest-VolumesTestJSON-1797541439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8284c8da-883a-42b0-950e-22556492f878" returned: 0 in 0.457s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:26 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c084aa64-8850-4a76-ae45-3014cdee051b tempest-VolumesTestJSON-1797541439 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:19:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c084aa64-8850-4a76-ae45-3014cdee051b tempest-VolumesTestJSON-1797541439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:19:26 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c084aa64-8850-4a76-ae45-3014cdee051b tempest-VolumesTestJSON-1797541439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80db6dca-1934-41a2-aab8-691572518df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8284c8da-883a-42b0-950e-22556492f878', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:26 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c084aa64-8850-4a76-ae45-3014cdee051b tempest-VolumesTestJSON-1797541439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2587c850-f8d1-45c7-930d-e4f275279da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:26 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-c084aa64-8850-4a76-ae45-3014cdee051b tempest-VolumesTestJSON-1797541439 None] Volume volume-8284c8da-883a-42b0-950e-22556492f878 (8284c8da-883a-42b0-950e-22556492f878): created successfully Aug 31 15:19:26 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c084aa64-8850-4a76-ae45-3014cdee051b tempest-VolumesTestJSON-1797541439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2587c850-f8d1-45c7-930d-e4f275279da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:26 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c084aa64-8850-4a76-ae45-3014cdee051b tempest-VolumesTestJSON-1797541439 None] Flow 'volume_create_manager' (80668765-55c2-4397-92e4-6fcc98fa789c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:19:26 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-c084aa64-8850-4a76-ae45-3014cdee051b tempest-VolumesTestJSON-1797541439 None] Created volume successfully. Aug 31 15:19:28 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-456f0f9b-1ae7-4646-80ea-33184f6dcd8d tempest-VolumesTestJSON-1797541439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:19:28 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-456f0f9b-1ae7-4646-80ea-33184f6dcd8d tempest-VolumesTestJSON-1797541439 None] Flow 'volume_create_manager' (a163da0a-15d8-4f44-968c-cfd43d1303d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:19:28 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-456f0f9b-1ae7-4646-80ea-33184f6dcd8d tempest-VolumesTestJSON-1797541439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e065741a-3fc9-4cab-bc7a-5384ca441499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:28 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-456f0f9b-1ae7-4646-80ea-33184f6dcd8d tempest-VolumesTestJSON-1797541439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e065741a-3fc9-4cab-bc7a-5384ca441499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1575412850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4853008b-6c36-4966-81b1-b4523bc4b537,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b89474bcb09b45ceac98fe43c7f01a41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:19:28Z,use_quota=True,user_id='8083cd66e4394f838c3f54685b047f31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:28 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-456f0f9b-1ae7-4646-80ea-33184f6dcd8d tempest-VolumesTestJSON-1797541439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e47e144c-8176-4ee0-8ef5-9ee983de5e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:28 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-456f0f9b-1ae7-4646-80ea-33184f6dcd8d tempest-VolumesTestJSON-1797541439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e47e144c-8176-4ee0-8ef5-9ee983de5e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:28 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-456f0f9b-1ae7-4646-80ea-33184f6dcd8d tempest-VolumesTestJSON-1797541439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a78df1d7-1400-4d62-be80-ccc51ca495ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:28 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-456f0f9b-1ae7-4646-80ea-33184f6dcd8d tempest-VolumesTestJSON-1797541439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a78df1d7-1400-4d62-be80-ccc51ca495ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4853008b-6c36-4966-81b1-b4523bc4b537', 'volume_name': 'volume-4853008b-6c36-4966-81b1-b4523bc4b537', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:28 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-456f0f9b-1ae7-4646-80ea-33184f6dcd8d tempest-VolumesTestJSON-1797541439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fe1e57c-3296-4f2e-bbc9-951830732435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:28 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-456f0f9b-1ae7-4646-80ea-33184f6dcd8d tempest-VolumesTestJSON-1797541439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fe1e57c-3296-4f2e-bbc9-951830732435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:28 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-456f0f9b-1ae7-4646-80ea-33184f6dcd8d tempest-VolumesTestJSON-1797541439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ae6e27-a958-45fd-9871-99f2f0f0e8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:28 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-456f0f9b-1ae7-4646-80ea-33184f6dcd8d tempest-VolumesTestJSON-1797541439 None] Volume 4853008b-6c36-4966-81b1-b4523bc4b537: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4853008b-6c36-4966-81b1-b4523bc4b537', 'volume_size': 1} Aug 31 15:19:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-456f0f9b-1ae7-4646-80ea-33184f6dcd8d tempest-VolumesTestJSON-1797541439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:19:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-456f0f9b-1ae7-4646-80ea-33184f6dcd8d tempest-VolumesTestJSON-1797541439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:19:28 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-456f0f9b-1ae7-4646-80ea-33184f6dcd8d tempest-VolumesTestJSON-1797541439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1575412850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4853008b-6c36-4966-81b1-b4523bc4b537,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b89474bcb09b45ceac98fe43c7f01a41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:19:28Z,use_quota=True,user_id='8083cd66e4394f838c3f54685b047f31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:19:28 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-456f0f9b-1ae7-4646-80ea-33184f6dcd8d tempest-VolumesTestJSON-1797541439 None] Creating volume 4853008b-6c36-4966-81b1-b4523bc4b537 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:19:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-456f0f9b-1ae7-4646-80ea-33184f6dcd8d tempest-VolumesTestJSON-1797541439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:19:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-456f0f9b-1ae7-4646-80ea-33184f6dcd8d tempest-VolumesTestJSON-1797541439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:19:28 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-456f0f9b-1ae7-4646-80ea-33184f6dcd8d tempest-VolumesTestJSON-1797541439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:19:28 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-456f0f9b-1ae7-4646-80ea-33184f6dcd8d tempest-VolumesTestJSON-1797541439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:19:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-456f0f9b-1ae7-4646-80ea-33184f6dcd8d tempest-VolumesTestJSON-1797541439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:19:28 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-456f0f9b-1ae7-4646-80ea-33184f6dcd8d tempest-VolumesTestJSON-1797541439 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:19:28 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-456f0f9b-1ae7-4646-80ea-33184f6dcd8d tempest-VolumesTestJSON-1797541439 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:19:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-456f0f9b-1ae7-4646-80ea-33184f6dcd8d tempest-VolumesTestJSON-1797541439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4853008b-6c36-4966-81b1-b4523bc4b537 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:28 devstack sudo[95723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4853008b-6c36-4966-81b1-b4523bc4b537 1073741824 Aug 31 15:19:28 devstack sudo[95723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:28 devstack sudo[95723]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-456f0f9b-1ae7-4646-80ea-33184f6dcd8d tempest-VolumesTestJSON-1797541439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4853008b-6c36-4966-81b1-b4523bc4b537 1073741824" returned: 0 in 0.623s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-456f0f9b-1ae7-4646-80ea-33184f6dcd8d tempest-VolumesTestJSON-1797541439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4853008b-6c36-4966-81b1-b4523bc4b537 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:28 devstack sudo[95729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4853008b-6c36-4966-81b1-b4523bc4b537 Aug 31 15:19:28 devstack sudo[95729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:29 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-64a03661-b4af-4bde-9d5d-e850baf35954 tempest-VolumesActionsTest-1059975936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:19:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-64a03661-b4af-4bde-9d5d-e850baf35954 tempest-VolumesActionsTest-1059975936 None] Flow 'volume_create_manager' (b1f7320e-f257-4d93-b567-9a4f3310482c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:19:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-64a03661-b4af-4bde-9d5d-e850baf35954 tempest-VolumesActionsTest-1059975936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (418e5cd8-8270-47a2-bb73-4e2020c032f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-64a03661-b4af-4bde-9d5d-e850baf35954 tempest-VolumesActionsTest-1059975936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (418e5cd8-8270-47a2-bb73-4e2020c032f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1557357749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8192cdb3-1d90-4b41-b1ec-dee126808385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122d0519830e4e1fae0f987c085a70f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:19:29Z,use_quota=True,user_id='1c469ac56eda4b2e9683f494f3fe7895',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-64a03661-b4af-4bde-9d5d-e850baf35954 tempest-VolumesActionsTest-1059975936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eeb0c90-78b2-4758-ae80-f62dd6596015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-64a03661-b4af-4bde-9d5d-e850baf35954 tempest-VolumesActionsTest-1059975936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eeb0c90-78b2-4758-ae80-f62dd6596015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-64a03661-b4af-4bde-9d5d-e850baf35954 tempest-VolumesActionsTest-1059975936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69ed9478-6e82-4186-8566-14117b351e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-64a03661-b4af-4bde-9d5d-e850baf35954 tempest-VolumesActionsTest-1059975936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69ed9478-6e82-4186-8566-14117b351e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8192cdb3-1d90-4b41-b1ec-dee126808385', 'volume_name': 'volume-8192cdb3-1d90-4b41-b1ec-dee126808385', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-64a03661-b4af-4bde-9d5d-e850baf35954 tempest-VolumesActionsTest-1059975936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebe80d41-a209-4d87-be96-7f91b3630f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-64a03661-b4af-4bde-9d5d-e850baf35954 tempest-VolumesActionsTest-1059975936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebe80d41-a209-4d87-be96-7f91b3630f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-64a03661-b4af-4bde-9d5d-e850baf35954 tempest-VolumesActionsTest-1059975936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (219d2189-cf10-4b94-81a4-b6bc8ef7a6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:29 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-64a03661-b4af-4bde-9d5d-e850baf35954 tempest-VolumesActionsTest-1059975936 None] Volume 8192cdb3-1d90-4b41-b1ec-dee126808385: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8192cdb3-1d90-4b41-b1ec-dee126808385', 'volume_size': 1} Aug 31 15:19:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-64a03661-b4af-4bde-9d5d-e850baf35954 tempest-VolumesActionsTest-1059975936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:19:29 devstack sudo[95729]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-456f0f9b-1ae7-4646-80ea-33184f6dcd8d tempest-VolumesTestJSON-1797541439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4853008b-6c36-4966-81b1-b4523bc4b537" returned: 0 in 0.318s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:29 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-456f0f9b-1ae7-4646-80ea-33184f6dcd8d tempest-VolumesTestJSON-1797541439 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:19:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-456f0f9b-1ae7-4646-80ea-33184f6dcd8d tempest-VolumesTestJSON-1797541439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:19:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-64a03661-b4af-4bde-9d5d-e850baf35954 tempest-VolumesActionsTest-1059975936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.071s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:19:29 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-64a03661-b4af-4bde-9d5d-e850baf35954 tempest-VolumesActionsTest-1059975936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1557357749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8192cdb3-1d90-4b41-b1ec-dee126808385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122d0519830e4e1fae0f987c085a70f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:19:29Z,use_quota=True,user_id='1c469ac56eda4b2e9683f494f3fe7895',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:19:29 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-64a03661-b4af-4bde-9d5d-e850baf35954 tempest-VolumesActionsTest-1059975936 None] Creating volume 8192cdb3-1d90-4b41-b1ec-dee126808385 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:19:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-64a03661-b4af-4bde-9d5d-e850baf35954 tempest-VolumesActionsTest-1059975936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:19:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-64a03661-b4af-4bde-9d5d-e850baf35954 tempest-VolumesActionsTest-1059975936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:19:29 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-64a03661-b4af-4bde-9d5d-e850baf35954 tempest-VolumesActionsTest-1059975936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:19:29 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-64a03661-b4af-4bde-9d5d-e850baf35954 tempest-VolumesActionsTest-1059975936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:19:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-64a03661-b4af-4bde-9d5d-e850baf35954 tempest-VolumesActionsTest-1059975936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:19:29 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-64a03661-b4af-4bde-9d5d-e850baf35954 tempest-VolumesActionsTest-1059975936 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:19:29 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-64a03661-b4af-4bde-9d5d-e850baf35954 tempest-VolumesActionsTest-1059975936 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:19:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-64a03661-b4af-4bde-9d5d-e850baf35954 tempest-VolumesActionsTest-1059975936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8192cdb3-1d90-4b41-b1ec-dee126808385 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-456f0f9b-1ae7-4646-80ea-33184f6dcd8d tempest-VolumesTestJSON-1797541439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ae6e27-a958-45fd-9871-99f2f0f0e8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4853008b-6c36-4966-81b1-b4523bc4b537', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:29 devstack sudo[95732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8192cdb3-1d90-4b41-b1ec-dee126808385 1073741824 Aug 31 15:19:29 devstack sudo[95732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-456f0f9b-1ae7-4646-80ea-33184f6dcd8d tempest-VolumesTestJSON-1797541439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (602fcbac-86d5-4e92-94a1-6bc8ea5e3890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:29 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-456f0f9b-1ae7-4646-80ea-33184f6dcd8d tempest-VolumesTestJSON-1797541439 None] Volume volume-4853008b-6c36-4966-81b1-b4523bc4b537 (4853008b-6c36-4966-81b1-b4523bc4b537): created successfully Aug 31 15:19:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-456f0f9b-1ae7-4646-80ea-33184f6dcd8d tempest-VolumesTestJSON-1797541439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (602fcbac-86d5-4e92-94a1-6bc8ea5e3890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-456f0f9b-1ae7-4646-80ea-33184f6dcd8d tempest-VolumesTestJSON-1797541439 None] Flow 'volume_create_manager' (a163da0a-15d8-4f44-968c-cfd43d1303d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:19:29 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-456f0f9b-1ae7-4646-80ea-33184f6dcd8d tempest-VolumesTestJSON-1797541439 None] Created volume successfully. Aug 31 15:19:29 devstack sudo[95732]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-64a03661-b4af-4bde-9d5d-e850baf35954 tempest-VolumesActionsTest-1059975936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8192cdb3-1d90-4b41-b1ec-dee126808385 1073741824" returned: 0 in 0.547s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-64a03661-b4af-4bde-9d5d-e850baf35954 tempest-VolumesActionsTest-1059975936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8192cdb3-1d90-4b41-b1ec-dee126808385 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:29 devstack sudo[95739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8192cdb3-1d90-4b41-b1ec-dee126808385 Aug 31 15:19:29 devstack sudo[95739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:30 devstack sudo[95739]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-64a03661-b4af-4bde-9d5d-e850baf35954 tempest-VolumesActionsTest-1059975936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8192cdb3-1d90-4b41-b1ec-dee126808385" returned: 0 in 0.327s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:30 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-64a03661-b4af-4bde-9d5d-e850baf35954 tempest-VolumesActionsTest-1059975936 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:19:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-64a03661-b4af-4bde-9d5d-e850baf35954 tempest-VolumesActionsTest-1059975936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:19:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-64a03661-b4af-4bde-9d5d-e850baf35954 tempest-VolumesActionsTest-1059975936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (219d2189-cf10-4b94-81a4-b6bc8ef7a6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8192cdb3-1d90-4b41-b1ec-dee126808385', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-64a03661-b4af-4bde-9d5d-e850baf35954 tempest-VolumesActionsTest-1059975936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ea8641-27d4-40ec-9551-6e7b62fff42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:30 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-64a03661-b4af-4bde-9d5d-e850baf35954 tempest-VolumesActionsTest-1059975936 None] Volume volume-8192cdb3-1d90-4b41-b1ec-dee126808385 (8192cdb3-1d90-4b41-b1ec-dee126808385): created successfully Aug 31 15:19:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-64a03661-b4af-4bde-9d5d-e850baf35954 tempest-VolumesActionsTest-1059975936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ea8641-27d4-40ec-9551-6e7b62fff42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-64a03661-b4af-4bde-9d5d-e850baf35954 tempest-VolumesActionsTest-1059975936 None] Flow 'volume_create_manager' (b1f7320e-f257-4d93-b567-9a4f3310482c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:19:30 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-64a03661-b4af-4bde-9d5d-e850baf35954 tempest-VolumesActionsTest-1059975936 None] Created volume successfully. Aug 31 15:19:31 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a55ef75e-e692-460f-b2ae-1b02f1def5b0 tempest-VolumesTestJSON-1797541439 None] Acquiring lock "cinder-4853008b-6c36-4966-81b1-b4523bc4b537-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:19:31 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a55ef75e-e692-460f-b2ae-1b02f1def5b0 tempest-VolumesTestJSON-1797541439 None] Lock "cinder-4853008b-6c36-4966-81b1-b4523bc4b537-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:19:31 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a55ef75e-e692-460f-b2ae-1b02f1def5b0 tempest-VolumesTestJSON-1797541439 None] Acquiring lock "cinder-quobyte-4853008b-6c36-4966-81b1-b4523bc4b537" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:19:31 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a55ef75e-e692-460f-b2ae-1b02f1def5b0 tempest-VolumesTestJSON-1797541439 None] Lock "cinder-quobyte-4853008b-6c36-4966-81b1-b4523bc4b537" acquired by "delete_volume" :: waited 0.024s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:19:31 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[90001c57-c134-42ba-9a42-ed9aea97d868]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:19:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a55ef75e-e692-460f-b2ae-1b02f1def5b0 tempest-VolumesTestJSON-1797541439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4853008b-6c36-4966-81b1-b4523bc4b537 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:31 devstack sudo[95742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4853008b-6c36-4966-81b1-b4523bc4b537 Aug 31 15:19:31 devstack sudo[95742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:31 devstack sudo[95742]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a55ef75e-e692-460f-b2ae-1b02f1def5b0 tempest-VolumesTestJSON-1797541439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4853008b-6c36-4966-81b1-b4523bc4b537" returned: 0 in 0.466s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a55ef75e-e692-460f-b2ae-1b02f1def5b0 tempest-VolumesTestJSON-1797541439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4853008b-6c36-4966-81b1-b4523bc4b537 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:32 devstack sudo[95747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4853008b-6c36-4966-81b1-b4523bc4b537 Aug 31 15:19:32 devstack sudo[95747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:32 devstack sudo[95747]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a55ef75e-e692-460f-b2ae-1b02f1def5b0 tempest-VolumesTestJSON-1797541439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4853008b-6c36-4966-81b1-b4523bc4b537" returned: 0 in 0.311s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:32 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a55ef75e-e692-460f-b2ae-1b02f1def5b0 tempest-VolumesTestJSON-1797541439 None] Lock "cinder-quobyte-4853008b-6c36-4966-81b1-b4523bc4b537" released by "delete_volume" :: held 0.845s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:19:32 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-a55ef75e-e692-460f-b2ae-1b02f1def5b0 tempest-VolumesTestJSON-1797541439 None] Created reservations ['4b82b7c6-441d-42f3-a0d7-74946f1e77e4', 'b8466a28-2811-4d8d-a1e8-4d07db940ac7', '9cc63db8-be59-4bc1-be9d-e7a08948e9e5', '4b15d097-12af-483e-8d63-2a189a857d05'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:19:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-a55ef75e-e692-460f-b2ae-1b02f1def5b0 tempest-VolumesTestJSON-1797541439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:19:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-a55ef75e-e692-460f-b2ae-1b02f1def5b0 tempest-VolumesTestJSON-1797541439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:19:32 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-a55ef75e-e692-460f-b2ae-1b02f1def5b0 tempest-VolumesTestJSON-1797541439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:19:32 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-a55ef75e-e692-460f-b2ae-1b02f1def5b0 tempest-VolumesTestJSON-1797541439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:19:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-a55ef75e-e692-460f-b2ae-1b02f1def5b0 tempest-VolumesTestJSON-1797541439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:19:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a55ef75e-e692-460f-b2ae-1b02f1def5b0 tempest-VolumesTestJSON-1797541439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:32 devstack sudo[95753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:19:32 devstack sudo[95753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:32 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6ff1fc58-262a-4c6b-ad33-7aabe219182c tempest-VolumesTestJSON-1797541439 None] Acquiring lock "cinder-8284c8da-883a-42b0-950e-22556492f878-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:19:32 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6ff1fc58-262a-4c6b-ad33-7aabe219182c tempest-VolumesTestJSON-1797541439 None] Lock "cinder-8284c8da-883a-42b0-950e-22556492f878-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:19:32 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6ff1fc58-262a-4c6b-ad33-7aabe219182c tempest-VolumesTestJSON-1797541439 None] Acquiring lock "cinder-quobyte-8284c8da-883a-42b0-950e-22556492f878" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:19:32 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6ff1fc58-262a-4c6b-ad33-7aabe219182c tempest-VolumesTestJSON-1797541439 None] Lock "cinder-quobyte-8284c8da-883a-42b0-950e-22556492f878" acquired by "delete_volume" :: waited 0.029s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:19:32 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b5ce33-4587-4dbd-86c7-25eef7085ca4]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:19:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6ff1fc58-262a-4c6b-ad33-7aabe219182c tempest-VolumesTestJSON-1797541439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8284c8da-883a-42b0-950e-22556492f878 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:32 devstack sudo[95753]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a55ef75e-e692-460f-b2ae-1b02f1def5b0 tempest-VolumesTestJSON-1797541439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.374s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:32 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-a55ef75e-e692-460f-b2ae-1b02f1def5b0 tempest-VolumesTestJSON-1797541439 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:19:32 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-a55ef75e-e692-460f-b2ae-1b02f1def5b0 tempest-VolumesTestJSON-1797541439 None] Deleted volume successfully. Aug 31 15:19:32 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a55ef75e-e692-460f-b2ae-1b02f1def5b0 tempest-VolumesTestJSON-1797541439 None] Lock "cinder-4853008b-6c36-4966-81b1-b4523bc4b537-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:19:32 devstack sudo[95755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8284c8da-883a-42b0-950e-22556492f878 Aug 31 15:19:32 devstack sudo[95755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:33 devstack sudo[95755]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6ff1fc58-262a-4c6b-ad33-7aabe219182c tempest-VolumesTestJSON-1797541439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8284c8da-883a-42b0-950e-22556492f878" returned: 0 in 0.460s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6ff1fc58-262a-4c6b-ad33-7aabe219182c tempest-VolumesTestJSON-1797541439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8284c8da-883a-42b0-950e-22556492f878 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:33 devstack sudo[95761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8284c8da-883a-42b0-950e-22556492f878 Aug 31 15:19:33 devstack sudo[95761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:33 devstack sudo[95761]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6ff1fc58-262a-4c6b-ad33-7aabe219182c tempest-VolumesTestJSON-1797541439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8284c8da-883a-42b0-950e-22556492f878" returned: 0 in 0.373s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:33 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6ff1fc58-262a-4c6b-ad33-7aabe219182c tempest-VolumesTestJSON-1797541439 None] Lock "cinder-quobyte-8284c8da-883a-42b0-950e-22556492f878" released by "delete_volume" :: held 0.888s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:19:33 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-6ff1fc58-262a-4c6b-ad33-7aabe219182c tempest-VolumesTestJSON-1797541439 None] Created reservations ['0b6f3a8e-2713-44d5-bb7c-5d1a90bc9e6b', '173663ce-596d-4de4-b348-47ec9a627df9', '179e0516-431e-4e96-bc5e-70af09ecedba', '994b5a5d-7c15-4b97-9777-38b370a8ba8e'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:19:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6ff1fc58-262a-4c6b-ad33-7aabe219182c tempest-VolumesTestJSON-1797541439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:19:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6ff1fc58-262a-4c6b-ad33-7aabe219182c tempest-VolumesTestJSON-1797541439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:19:33 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6ff1fc58-262a-4c6b-ad33-7aabe219182c tempest-VolumesTestJSON-1797541439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:19:33 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6ff1fc58-262a-4c6b-ad33-7aabe219182c tempest-VolumesTestJSON-1797541439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:19:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6ff1fc58-262a-4c6b-ad33-7aabe219182c tempest-VolumesTestJSON-1797541439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:19:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6ff1fc58-262a-4c6b-ad33-7aabe219182c tempest-VolumesTestJSON-1797541439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:33 devstack sudo[95764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:19:33 devstack sudo[95764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:33 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-c64a6761-acb4-4543-9d0b-add19bfef759 tempest-VolumesTestJSON-1797541439 None] Acquiring lock "cinder-6ed18023-be0a-47d2-952b-602daf7fc681-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:19:34 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-c64a6761-acb4-4543-9d0b-add19bfef759 tempest-VolumesTestJSON-1797541439 None] Lock "cinder-6ed18023-be0a-47d2-952b-602daf7fc681-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:19:34 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-c64a6761-acb4-4543-9d0b-add19bfef759 tempest-VolumesTestJSON-1797541439 None] Acquiring lock "cinder-quobyte-6ed18023-be0a-47d2-952b-602daf7fc681" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:19:34 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-c64a6761-acb4-4543-9d0b-add19bfef759 tempest-VolumesTestJSON-1797541439 None] Lock "cinder-quobyte-6ed18023-be0a-47d2-952b-602daf7fc681" acquired by "delete_volume" :: waited 0.042s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:19:34 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9e678b-4de6-49e6-8c71-b1de608fde2e]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:19:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c64a6761-acb4-4543-9d0b-add19bfef759 tempest-VolumesTestJSON-1797541439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6ed18023-be0a-47d2-952b-602daf7fc681 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:34 devstack sudo[95766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6ed18023-be0a-47d2-952b-602daf7fc681 Aug 31 15:19:34 devstack sudo[95766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:34 devstack sudo[95764]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6ff1fc58-262a-4c6b-ad33-7aabe219182c tempest-VolumesTestJSON-1797541439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.652s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:34 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-6ff1fc58-262a-4c6b-ad33-7aabe219182c tempest-VolumesTestJSON-1797541439 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:19:34 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-6ff1fc58-262a-4c6b-ad33-7aabe219182c tempest-VolumesTestJSON-1797541439 None] Deleted volume successfully. Aug 31 15:19:34 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6ff1fc58-262a-4c6b-ad33-7aabe219182c tempest-VolumesTestJSON-1797541439 None] Lock "cinder-8284c8da-883a-42b0-950e-22556492f878-delete_volume" released by "delete_volume" :: held 1.891s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:19:34 devstack sudo[95766]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c64a6761-acb4-4543-9d0b-add19bfef759 tempest-VolumesTestJSON-1797541439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6ed18023-be0a-47d2-952b-602daf7fc681" returned: 0 in 0.624s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c64a6761-acb4-4543-9d0b-add19bfef759 tempest-VolumesTestJSON-1797541439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6ed18023-be0a-47d2-952b-602daf7fc681 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:34 devstack sudo[95779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6ed18023-be0a-47d2-952b-602daf7fc681 Aug 31 15:19:34 devstack sudo[95779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:35 devstack sudo[95779]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c64a6761-acb4-4543-9d0b-add19bfef759 tempest-VolumesTestJSON-1797541439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6ed18023-be0a-47d2-952b-602daf7fc681" returned: 0 in 0.484s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:35 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-c64a6761-acb4-4543-9d0b-add19bfef759 tempest-VolumesTestJSON-1797541439 None] Lock "cinder-quobyte-6ed18023-be0a-47d2-952b-602daf7fc681" released by "delete_volume" :: held 1.175s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:19:35 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-c64a6761-acb4-4543-9d0b-add19bfef759 tempest-VolumesTestJSON-1797541439 None] Created reservations ['eaba15b2-c38b-42dd-919f-f9dc0608886e', 'c119a9eb-2c7e-4890-9699-88e09e5eb6dc', 'a1c9f334-4923-4f74-a3b6-cf0a487d58c2', '6fcbd14b-25db-43db-acca-2ae16dfb75f6'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:19:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c64a6761-acb4-4543-9d0b-add19bfef759 tempest-VolumesTestJSON-1797541439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:19:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c64a6761-acb4-4543-9d0b-add19bfef759 tempest-VolumesTestJSON-1797541439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:19:35 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c64a6761-acb4-4543-9d0b-add19bfef759 tempest-VolumesTestJSON-1797541439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:19:35 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c64a6761-acb4-4543-9d0b-add19bfef759 tempest-VolumesTestJSON-1797541439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:19:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c64a6761-acb4-4543-9d0b-add19bfef759 tempest-VolumesTestJSON-1797541439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:19:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c64a6761-acb4-4543-9d0b-add19bfef759 tempest-VolumesTestJSON-1797541439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:35 devstack sudo[95795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:19:35 devstack sudo[95795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:35 devstack sudo[95795]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c64a6761-acb4-4543-9d0b-add19bfef759 tempest-VolumesTestJSON-1797541439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.431s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:35 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-c64a6761-acb4-4543-9d0b-add19bfef759 tempest-VolumesTestJSON-1797541439 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:19:35 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-c64a6761-acb4-4543-9d0b-add19bfef759 tempest-VolumesTestJSON-1797541439 None] Deleted volume successfully. Aug 31 15:19:35 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-c64a6761-acb4-4543-9d0b-add19bfef759 tempest-VolumesTestJSON-1797541439 None] Lock "cinder-6ed18023-be0a-47d2-952b-602daf7fc681-delete_volume" released by "delete_volume" :: held 1.976s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:19:41 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e4c133c6-acef-46d9-a265-035e84dae406 tempest-VolumesActionsTest-1059975936 None] Acquiring lock "cinder-8192cdb3-1d90-4b41-b1ec-dee126808385" by "attach_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:19:41 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e4c133c6-acef-46d9-a265-035e84dae406 tempest-VolumesActionsTest-1059975936 None] Lock "cinder-8192cdb3-1d90-4b41-b1ec-dee126808385" acquired by "attach_volume" :: waited 0.026s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:19:41 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-e4c133c6-acef-46d9-a265-035e84dae406 tempest-VolumesActionsTest-1059975936 None] Attaching volume 8192cdb3-1d90-4b41-b1ec-dee126808385 to instance f81f3d70-1eca-40a6-a7a9-e3cf549eb844 at mountpoint /dev/vdb on host None. Aug 31 15:19:41 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-e4c133c6-acef-46d9-a265-035e84dae406 tempest-VolumesActionsTest-1059975936 None] Attach volume completed successfully. Aug 31 15:19:42 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e4c133c6-acef-46d9-a265-035e84dae406 tempest-VolumesActionsTest-1059975936 None] Lock "cinder-8192cdb3-1d90-4b41-b1ec-dee126808385" released by "attach_volume" :: held 0.152s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:19:42 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa95e2a6-6694-4b36-8765-a3113e100b93 tempest-VolumeQuotasAdminTestJSON-869677099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:19:42 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-aa95e2a6-6694-4b36-8765-a3113e100b93 tempest-VolumeQuotasAdminTestJSON-869677099 None] Flow 'volume_create_manager' (4f021ab3-2184-4de8-96fe-1f49cde3abfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:19:42 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-aa95e2a6-6694-4b36-8765-a3113e100b93 tempest-VolumeQuotasAdminTestJSON-869677099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83df1e27-a319-4935-ab86-20cb02dd2290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:42 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-aa95e2a6-6694-4b36-8765-a3113e100b93 tempest-VolumeQuotasAdminTestJSON-869677099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83df1e27-a319-4935-ab86-20cb02dd2290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-174492756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3870726-52d4-46a2-a183-8c956f5b7501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55348d61737c4ed080cc2212ad19141a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:19:42Z,use_quota=True,user_id='3f96320915fe40b6b49b9f4b13858f15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:42 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-aa95e2a6-6694-4b36-8765-a3113e100b93 tempest-VolumeQuotasAdminTestJSON-869677099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a68d0939-5cc7-4b0b-84f8-aea3fe358e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:42 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-aa95e2a6-6694-4b36-8765-a3113e100b93 tempest-VolumeQuotasAdminTestJSON-869677099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a68d0939-5cc7-4b0b-84f8-aea3fe358e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:42 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-aa95e2a6-6694-4b36-8765-a3113e100b93 tempest-VolumeQuotasAdminTestJSON-869677099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a83199e4-d314-4b3f-a57e-1c117dc85843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:42 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-aa95e2a6-6694-4b36-8765-a3113e100b93 tempest-VolumeQuotasAdminTestJSON-869677099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a83199e4-d314-4b3f-a57e-1c117dc85843) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3870726-52d4-46a2-a183-8c956f5b7501', 'volume_name': 'volume-b3870726-52d4-46a2-a183-8c956f5b7501', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:42 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-aa95e2a6-6694-4b36-8765-a3113e100b93 tempest-VolumeQuotasAdminTestJSON-869677099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e55f8db-e2d7-48e2-bf40-8cfe00a657d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:42 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-aa95e2a6-6694-4b36-8765-a3113e100b93 tempest-VolumeQuotasAdminTestJSON-869677099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e55f8db-e2d7-48e2-bf40-8cfe00a657d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:42 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-aa95e2a6-6694-4b36-8765-a3113e100b93 tempest-VolumeQuotasAdminTestJSON-869677099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a86de4a-9bde-41eb-b694-e83f16c3af03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:42 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-aa95e2a6-6694-4b36-8765-a3113e100b93 tempest-VolumeQuotasAdminTestJSON-869677099 None] Volume b3870726-52d4-46a2-a183-8c956f5b7501: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3870726-52d4-46a2-a183-8c956f5b7501', 'volume_size': 1} Aug 31 15:19:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-aa95e2a6-6694-4b36-8765-a3113e100b93 tempest-VolumeQuotasAdminTestJSON-869677099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:19:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-aa95e2a6-6694-4b36-8765-a3113e100b93 tempest-VolumeQuotasAdminTestJSON-869677099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:19:42 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-aa95e2a6-6694-4b36-8765-a3113e100b93 tempest-VolumeQuotasAdminTestJSON-869677099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-174492756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3870726-52d4-46a2-a183-8c956f5b7501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55348d61737c4ed080cc2212ad19141a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:19:42Z,use_quota=True,user_id='3f96320915fe40b6b49b9f4b13858f15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:19:42 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-aa95e2a6-6694-4b36-8765-a3113e100b93 tempest-VolumeQuotasAdminTestJSON-869677099 None] Creating volume b3870726-52d4-46a2-a183-8c956f5b7501 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:19:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-aa95e2a6-6694-4b36-8765-a3113e100b93 tempest-VolumeQuotasAdminTestJSON-869677099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:19:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-aa95e2a6-6694-4b36-8765-a3113e100b93 tempest-VolumeQuotasAdminTestJSON-869677099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:19:42 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-aa95e2a6-6694-4b36-8765-a3113e100b93 tempest-VolumeQuotasAdminTestJSON-869677099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:19:42 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-aa95e2a6-6694-4b36-8765-a3113e100b93 tempest-VolumeQuotasAdminTestJSON-869677099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:19:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-aa95e2a6-6694-4b36-8765-a3113e100b93 tempest-VolumeQuotasAdminTestJSON-869677099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:19:42 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-aa95e2a6-6694-4b36-8765-a3113e100b93 tempest-VolumeQuotasAdminTestJSON-869677099 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:19:42 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-aa95e2a6-6694-4b36-8765-a3113e100b93 tempest-VolumeQuotasAdminTestJSON-869677099 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:19:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-aa95e2a6-6694-4b36-8765-a3113e100b93 tempest-VolumeQuotasAdminTestJSON-869677099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b3870726-52d4-46a2-a183-8c956f5b7501 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:42 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-ce0d1d8b-d640-4975-9f0a-23d2345845bf tempest-VolumesActionsTest-1059975936 None] Acquiring lock "cinder-8192cdb3-1d90-4b41-b1ec-dee126808385-detach_volume" by "detach_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:19:42 devstack sudo[95874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b3870726-52d4-46a2-a183-8c956f5b7501 1073741824 Aug 31 15:19:42 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-ce0d1d8b-d640-4975-9f0a-23d2345845bf tempest-VolumesActionsTest-1059975936 None] Lock "cinder-8192cdb3-1d90-4b41-b1ec-dee126808385-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:19:42 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-ce0d1d8b-d640-4975-9f0a-23d2345845bf tempest-VolumesActionsTest-1059975936 None] Detaching volume 8192cdb3-1d90-4b41-b1ec-dee126808385 from instance f81f3d70-1eca-40a6-a7a9-e3cf549eb844. Aug 31 15:19:42 devstack sudo[95874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:42 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-ce0d1d8b-d640-4975-9f0a-23d2345845bf tempest-VolumesActionsTest-1059975936 None] Detach volume completed successfully. Aug 31 15:19:42 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-ce0d1d8b-d640-4975-9f0a-23d2345845bf tempest-VolumesActionsTest-1059975936 None] Lock "cinder-8192cdb3-1d90-4b41-b1ec-dee126808385-detach_volume" released by "detach_volume" :: held 0.236s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:19:43 devstack sudo[95874]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-aa95e2a6-6694-4b36-8765-a3113e100b93 tempest-VolumeQuotasAdminTestJSON-869677099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b3870726-52d4-46a2-a183-8c956f5b7501 1073741824" returned: 0 in 0.935s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-aa95e2a6-6694-4b36-8765-a3113e100b93 tempest-VolumeQuotasAdminTestJSON-869677099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b3870726-52d4-46a2-a183-8c956f5b7501 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:43 devstack sudo[95890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b3870726-52d4-46a2-a183-8c956f5b7501 Aug 31 15:19:43 devstack sudo[95890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:43 devstack sudo[95890]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-aa95e2a6-6694-4b36-8765-a3113e100b93 tempest-VolumeQuotasAdminTestJSON-869677099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b3870726-52d4-46a2-a183-8c956f5b7501" returned: 0 in 0.498s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:43 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-aa95e2a6-6694-4b36-8765-a3113e100b93 tempest-VolumeQuotasAdminTestJSON-869677099 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:19:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-aa95e2a6-6694-4b36-8765-a3113e100b93 tempest-VolumeQuotasAdminTestJSON-869677099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:19:43 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-aa95e2a6-6694-4b36-8765-a3113e100b93 tempest-VolumeQuotasAdminTestJSON-869677099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a86de4a-9bde-41eb-b694-e83f16c3af03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3870726-52d4-46a2-a183-8c956f5b7501', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:43 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-aa95e2a6-6694-4b36-8765-a3113e100b93 tempest-VolumeQuotasAdminTestJSON-869677099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03710e72-4515-4109-bf35-8d5e789df4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:43 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-aa95e2a6-6694-4b36-8765-a3113e100b93 tempest-VolumeQuotasAdminTestJSON-869677099 None] Volume volume-b3870726-52d4-46a2-a183-8c956f5b7501 (b3870726-52d4-46a2-a183-8c956f5b7501): created successfully Aug 31 15:19:43 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-aa95e2a6-6694-4b36-8765-a3113e100b93 tempest-VolumeQuotasAdminTestJSON-869677099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03710e72-4515-4109-bf35-8d5e789df4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:43 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-aa95e2a6-6694-4b36-8765-a3113e100b93 tempest-VolumeQuotasAdminTestJSON-869677099 None] Flow 'volume_create_manager' (4f021ab3-2184-4de8-96fe-1f49cde3abfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:19:43 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-aa95e2a6-6694-4b36-8765-a3113e100b93 tempest-VolumeQuotasAdminTestJSON-869677099 None] Created volume successfully. Aug 31 15:19:44 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-be351b88-8d88-437f-bada-76858ac95a37 tempest-VolumeQuotasAdminTestJSON-869677099 None] Acquiring lock "cinder-b3870726-52d4-46a2-a183-8c956f5b7501-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:19:44 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-be351b88-8d88-437f-bada-76858ac95a37 tempest-VolumeQuotasAdminTestJSON-869677099 None] Lock "cinder-b3870726-52d4-46a2-a183-8c956f5b7501-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:19:44 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-a0182ff8-1031-4503-a7ce-6f15e5a3c36b tempest-GroupSnapshotsTest-2057849738 None] Group tempest-GroupSnapshotsTest-Group-1243895243: creating Aug 31 15:19:44 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-be351b88-8d88-437f-bada-76858ac95a37 tempest-VolumeQuotasAdminTestJSON-869677099 None] Acquiring lock "cinder-quobyte-b3870726-52d4-46a2-a183-8c956f5b7501" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:19:44 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-be351b88-8d88-437f-bada-76858ac95a37 tempest-VolumeQuotasAdminTestJSON-869677099 None] Lock "cinder-quobyte-b3870726-52d4-46a2-a183-8c956f5b7501" acquired by "delete_volume" :: waited 0.035s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:19:44 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-a0182ff8-1031-4503-a7ce-6f15e5a3c36b tempest-GroupSnapshotsTest-2057849738 None] Group tempest-GroupSnapshotsTest-Group-1243895243: created successfully Aug 31 15:19:44 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[809af2f2-fb39-4a6a-b924-418f48b80ff9]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:19:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-be351b88-8d88-437f-bada-76858ac95a37 tempest-VolumeQuotasAdminTestJSON-869677099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b3870726-52d4-46a2-a183-8c956f5b7501 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:44 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-a0182ff8-1031-4503-a7ce-6f15e5a3c36b tempest-GroupSnapshotsTest-2057849738 None] Create group completed successfully. Aug 31 15:19:44 devstack sudo[95905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b3870726-52d4-46a2-a183-8c956f5b7501 Aug 31 15:19:44 devstack sudo[95905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:45 devstack sudo[95905]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-be351b88-8d88-437f-bada-76858ac95a37 tempest-VolumeQuotasAdminTestJSON-869677099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b3870726-52d4-46a2-a183-8c956f5b7501" returned: 0 in 0.416s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-be351b88-8d88-437f-bada-76858ac95a37 tempest-VolumeQuotasAdminTestJSON-869677099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b3870726-52d4-46a2-a183-8c956f5b7501 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:45 devstack sudo[95911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b3870726-52d4-46a2-a183-8c956f5b7501 Aug 31 15:19:45 devstack sudo[95911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:45 devstack cinder-volume[86000]: DEBUG oslo_service.periodic_task [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86000) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:19:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:19:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:19:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:19:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:19:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:19:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:45 devstack sudo[95913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:19:45 devstack sudo[95913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:45 devstack sudo[95911]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-be351b88-8d88-437f-bada-76858ac95a37 tempest-VolumeQuotasAdminTestJSON-869677099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b3870726-52d4-46a2-a183-8c956f5b7501" returned: 0 in 0.314s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:45 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-be351b88-8d88-437f-bada-76858ac95a37 tempest-VolumeQuotasAdminTestJSON-869677099 None] Lock "cinder-quobyte-b3870726-52d4-46a2-a183-8c956f5b7501" released by "delete_volume" :: held 0.793s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:19:45 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-be351b88-8d88-437f-bada-76858ac95a37 tempest-VolumeQuotasAdminTestJSON-869677099 None] Created reservations ['ff0bd47f-407b-470b-9ec9-eb52fbf14703', 'b09e9a99-0fbc-4621-b913-18b11e4cad70', '3122f8f6-f4c5-4a40-afa3-05aba6a448d3', '5391c181-39ce-488f-838d-1d2a38b3e223'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:19:45 devstack sudo[95913]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.352s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:45 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:19:45 devstack cinder-volume[86000]: DEBUG oslo_service.periodic_task [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running periodic task VolumeManager._thread_info {{(pid=86000) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:19:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] thread count: 28 {{(pid=86000) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 31 15:19:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] thread info: [<_MainThread(MainThread, started 137631281086592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86000) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 31 15:19:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-be351b88-8d88-437f-bada-76858ac95a37 tempest-VolumeQuotasAdminTestJSON-869677099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:19:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-be351b88-8d88-437f-bada-76858ac95a37 tempest-VolumeQuotasAdminTestJSON-869677099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:19:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-be351b88-8d88-437f-bada-76858ac95a37 tempest-VolumeQuotasAdminTestJSON-869677099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:19:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-be351b88-8d88-437f-bada-76858ac95a37 tempest-VolumeQuotasAdminTestJSON-869677099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:19:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-be351b88-8d88-437f-bada-76858ac95a37 tempest-VolumeQuotasAdminTestJSON-869677099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:19:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-be351b88-8d88-437f-bada-76858ac95a37 tempest-VolumeQuotasAdminTestJSON-869677099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:45 devstack sudo[95917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:19:45 devstack sudo[95917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:46 devstack sudo[95917]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-be351b88-8d88-437f-bada-76858ac95a37 tempest-VolumeQuotasAdminTestJSON-869677099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.474s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:46 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-be351b88-8d88-437f-bada-76858ac95a37 tempest-VolumeQuotasAdminTestJSON-869677099 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:19:46 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-be351b88-8d88-437f-bada-76858ac95a37 tempest-VolumeQuotasAdminTestJSON-869677099 None] Deleted volume successfully. Aug 31 15:19:46 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-be351b88-8d88-437f-bada-76858ac95a37 tempest-VolumeQuotasAdminTestJSON-869677099 None] Lock "cinder-b3870726-52d4-46a2-a183-8c956f5b7501-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:19:46 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-be588af5-6b27-453a-ad47-3d64f0d10b0d tempest-GroupSnapshotsTest-2057849738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:19:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-be588af5-6b27-453a-ad47-3d64f0d10b0d tempest-GroupSnapshotsTest-2057849738 None] Flow 'volume_create_manager' (8163f1dd-e9d6-4d79-98c4-0ade92747e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:19:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-be588af5-6b27-453a-ad47-3d64f0d10b0d tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccea76b6-a80f-4982-8c5b-bb66a99cd703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-be588af5-6b27-453a-ad47-3d64f0d10b0d tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccea76b6-a80f-4982-8c5b-bb66a99cd703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1160499060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c9066410-70b5-47ad-8855-5d9c5231cf4c,host='devstack@QuobyteHD#QuobyteHD',id=3da3a93f-757c-4809-94ea-892ca2e8845a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1729177f36914ba782887f84390b3cf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:19:47Z,use_quota=True,user_id='51779a9573da46cbaf455bdf61cbcd84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0a162d4-5638-4f39-98ba-4759d709c6a9),volume_type_id=d0a162d4-5638-4f39-98ba-4759d709c6a9)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-be588af5-6b27-453a-ad47-3d64f0d10b0d tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a284dc93-fad3-40ac-8d13-2051ef9eb99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-be588af5-6b27-453a-ad47-3d64f0d10b0d tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a284dc93-fad3-40ac-8d13-2051ef9eb99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-be588af5-6b27-453a-ad47-3d64f0d10b0d tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47a1195e-0469-44ea-ba41-ba053f6555e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-be588af5-6b27-453a-ad47-3d64f0d10b0d tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47a1195e-0469-44ea-ba41-ba053f6555e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3da3a93f-757c-4809-94ea-892ca2e8845a', 'volume_name': 'volume-3da3a93f-757c-4809-94ea-892ca2e8845a', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-be588af5-6b27-453a-ad47-3d64f0d10b0d tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1c89461-06dd-4b9f-89b5-abb01796b58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-be588af5-6b27-453a-ad47-3d64f0d10b0d tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1c89461-06dd-4b9f-89b5-abb01796b58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-be588af5-6b27-453a-ad47-3d64f0d10b0d tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96568f3e-121b-40b7-99c4-a6a2a8c6f107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:46 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-be588af5-6b27-453a-ad47-3d64f0d10b0d tempest-GroupSnapshotsTest-2057849738 None] Volume 3da3a93f-757c-4809-94ea-892ca2e8845a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3da3a93f-757c-4809-94ea-892ca2e8845a', 'volume_size': 1} Aug 31 15:19:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-be588af5-6b27-453a-ad47-3d64f0d10b0d tempest-GroupSnapshotsTest-2057849738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:19:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-be588af5-6b27-453a-ad47-3d64f0d10b0d tempest-GroupSnapshotsTest-2057849738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:19:46 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-be588af5-6b27-453a-ad47-3d64f0d10b0d tempest-GroupSnapshotsTest-2057849738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c9066410-70b5-47ad-8855-5d9c5231cf4c,created_at=2026-08-31T13:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1160499060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c9066410-70b5-47ad-8855-5d9c5231cf4c,host='devstack@QuobyteHD#QuobyteHD',id=3da3a93f-757c-4809-94ea-892ca2e8845a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1729177f36914ba782887f84390b3cf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:19:47Z,use_quota=True,user_id='51779a9573da46cbaf455bdf61cbcd84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0a162d4-5638-4f39-98ba-4759d709c6a9),volume_type_id=d0a162d4-5638-4f39-98ba-4759d709c6a9)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:19:46 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-be588af5-6b27-453a-ad47-3d64f0d10b0d tempest-GroupSnapshotsTest-2057849738 None] Creating volume 3da3a93f-757c-4809-94ea-892ca2e8845a {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:19:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-be588af5-6b27-453a-ad47-3d64f0d10b0d tempest-GroupSnapshotsTest-2057849738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:19:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-be588af5-6b27-453a-ad47-3d64f0d10b0d tempest-GroupSnapshotsTest-2057849738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:19:46 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-be588af5-6b27-453a-ad47-3d64f0d10b0d tempest-GroupSnapshotsTest-2057849738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:19:46 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-be588af5-6b27-453a-ad47-3d64f0d10b0d tempest-GroupSnapshotsTest-2057849738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:19:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-be588af5-6b27-453a-ad47-3d64f0d10b0d tempest-GroupSnapshotsTest-2057849738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:19:46 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-be588af5-6b27-453a-ad47-3d64f0d10b0d tempest-GroupSnapshotsTest-2057849738 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:19:46 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-be588af5-6b27-453a-ad47-3d64f0d10b0d tempest-GroupSnapshotsTest-2057849738 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:19:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-be588af5-6b27-453a-ad47-3d64f0d10b0d tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:46 devstack sudo[95922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a 1073741824 Aug 31 15:19:46 devstack sudo[95922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:46 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-7685f0b9-9e15-47dc-a00e-96c8187d8633 tempest-VolumeQuotasAdminTestJSON-869677099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:19:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7685f0b9-9e15-47dc-a00e-96c8187d8633 tempest-VolumeQuotasAdminTestJSON-869677099 None] Flow 'volume_create_manager' (3d49fc67-6ca9-4247-9fc8-f5bdc68c24ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:19:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7685f0b9-9e15-47dc-a00e-96c8187d8633 tempest-VolumeQuotasAdminTestJSON-869677099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47c21b6b-5e84-4ded-87e8-a2eb3704758e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7685f0b9-9e15-47dc-a00e-96c8187d8633 tempest-VolumeQuotasAdminTestJSON-869677099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47c21b6b-5e84-4ded-87e8-a2eb3704758e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1941938248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=460c9650-c344-41c0-80c1-cd59cc10e1da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55348d61737c4ed080cc2212ad19141a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:19:47Z,use_quota=True,user_id='3f96320915fe40b6b49b9f4b13858f15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7685f0b9-9e15-47dc-a00e-96c8187d8633 tempest-VolumeQuotasAdminTestJSON-869677099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8390d861-2ae6-4200-af0a-fc30b1f0ce37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7685f0b9-9e15-47dc-a00e-96c8187d8633 tempest-VolumeQuotasAdminTestJSON-869677099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8390d861-2ae6-4200-af0a-fc30b1f0ce37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7685f0b9-9e15-47dc-a00e-96c8187d8633 tempest-VolumeQuotasAdminTestJSON-869677099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (174cba0a-ba91-470a-8586-9f5b1fd0869a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7685f0b9-9e15-47dc-a00e-96c8187d8633 tempest-VolumeQuotasAdminTestJSON-869677099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (174cba0a-ba91-470a-8586-9f5b1fd0869a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '460c9650-c344-41c0-80c1-cd59cc10e1da', 'volume_name': 'volume-460c9650-c344-41c0-80c1-cd59cc10e1da', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7685f0b9-9e15-47dc-a00e-96c8187d8633 tempest-VolumeQuotasAdminTestJSON-869677099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72799e49-6075-4618-b979-eb0f4c0e62cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7685f0b9-9e15-47dc-a00e-96c8187d8633 tempest-VolumeQuotasAdminTestJSON-869677099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72799e49-6075-4618-b979-eb0f4c0e62cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7685f0b9-9e15-47dc-a00e-96c8187d8633 tempest-VolumeQuotasAdminTestJSON-869677099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a4185de-f8d5-4a47-b979-685b47d1daa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:46 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-7685f0b9-9e15-47dc-a00e-96c8187d8633 tempest-VolumeQuotasAdminTestJSON-869677099 None] Volume 460c9650-c344-41c0-80c1-cd59cc10e1da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-460c9650-c344-41c0-80c1-cd59cc10e1da', 'volume_size': 1} Aug 31 15:19:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7685f0b9-9e15-47dc-a00e-96c8187d8633 tempest-VolumeQuotasAdminTestJSON-869677099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:19:47 devstack sudo[95922]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-be588af5-6b27-453a-ad47-3d64f0d10b0d tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a 1073741824" returned: 0 in 0.570s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-be588af5-6b27-453a-ad47-3d64f0d10b0d tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:47 devstack sudo[95931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a Aug 31 15:19:47 devstack sudo[95931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:47 devstack sudo[95931]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-be588af5-6b27-453a-ad47-3d64f0d10b0d tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a" returned: 0 in 0.288s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:47 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-be588af5-6b27-453a-ad47-3d64f0d10b0d tempest-GroupSnapshotsTest-2057849738 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:19:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-be588af5-6b27-453a-ad47-3d64f0d10b0d tempest-GroupSnapshotsTest-2057849738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:19:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7685f0b9-9e15-47dc-a00e-96c8187d8633 tempest-VolumeQuotasAdminTestJSON-869677099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.781s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:19:47 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-7685f0b9-9e15-47dc-a00e-96c8187d8633 tempest-VolumeQuotasAdminTestJSON-869677099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1941938248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=460c9650-c344-41c0-80c1-cd59cc10e1da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55348d61737c4ed080cc2212ad19141a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:19:47Z,use_quota=True,user_id='3f96320915fe40b6b49b9f4b13858f15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:19:47 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-7685f0b9-9e15-47dc-a00e-96c8187d8633 tempest-VolumeQuotasAdminTestJSON-869677099 None] Creating volume 460c9650-c344-41c0-80c1-cd59cc10e1da {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:19:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7685f0b9-9e15-47dc-a00e-96c8187d8633 tempest-VolumeQuotasAdminTestJSON-869677099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:19:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7685f0b9-9e15-47dc-a00e-96c8187d8633 tempest-VolumeQuotasAdminTestJSON-869677099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:19:47 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-7685f0b9-9e15-47dc-a00e-96c8187d8633 tempest-VolumeQuotasAdminTestJSON-869677099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:19:47 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-7685f0b9-9e15-47dc-a00e-96c8187d8633 tempest-VolumeQuotasAdminTestJSON-869677099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:19:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7685f0b9-9e15-47dc-a00e-96c8187d8633 tempest-VolumeQuotasAdminTestJSON-869677099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:19:47 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-7685f0b9-9e15-47dc-a00e-96c8187d8633 tempest-VolumeQuotasAdminTestJSON-869677099 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:19:47 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-7685f0b9-9e15-47dc-a00e-96c8187d8633 tempest-VolumeQuotasAdminTestJSON-869677099 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:19:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7685f0b9-9e15-47dc-a00e-96c8187d8633 tempest-VolumeQuotasAdminTestJSON-869677099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-460c9650-c344-41c0-80c1-cd59cc10e1da 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:47 devstack sudo[95934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-460c9650-c344-41c0-80c1-cd59cc10e1da 1073741824 Aug 31 15:19:47 devstack sudo[95934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:47 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-be588af5-6b27-453a-ad47-3d64f0d10b0d tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96568f3e-121b-40b7-99c4-a6a2a8c6f107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3da3a93f-757c-4809-94ea-892ca2e8845a', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:47 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-be588af5-6b27-453a-ad47-3d64f0d10b0d tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e5042f7-2618-4dfc-aa8f-bb9d53b3ea8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:47 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-be588af5-6b27-453a-ad47-3d64f0d10b0d tempest-GroupSnapshotsTest-2057849738 None] Volume volume-3da3a93f-757c-4809-94ea-892ca2e8845a (3da3a93f-757c-4809-94ea-892ca2e8845a): created successfully Aug 31 15:19:47 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-be588af5-6b27-453a-ad47-3d64f0d10b0d tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e5042f7-2618-4dfc-aa8f-bb9d53b3ea8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:47 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-be588af5-6b27-453a-ad47-3d64f0d10b0d tempest-GroupSnapshotsTest-2057849738 None] Flow 'volume_create_manager' (8163f1dd-e9d6-4d79-98c4-0ade92747e8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:19:47 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-be588af5-6b27-453a-ad47-3d64f0d10b0d tempest-GroupSnapshotsTest-2057849738 None] Created volume successfully. Aug 31 15:19:48 devstack sudo[95934]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7685f0b9-9e15-47dc-a00e-96c8187d8633 tempest-VolumeQuotasAdminTestJSON-869677099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-460c9650-c344-41c0-80c1-cd59cc10e1da 1073741824" returned: 0 in 0.529s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7685f0b9-9e15-47dc-a00e-96c8187d8633 tempest-VolumeQuotasAdminTestJSON-869677099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-460c9650-c344-41c0-80c1-cd59cc10e1da {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:48 devstack sudo[95940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-460c9650-c344-41c0-80c1-cd59cc10e1da Aug 31 15:19:48 devstack sudo[95940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:48 devstack sudo[95940]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7685f0b9-9e15-47dc-a00e-96c8187d8633 tempest-VolumeQuotasAdminTestJSON-869677099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-460c9650-c344-41c0-80c1-cd59cc10e1da" returned: 0 in 0.354s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:48 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-7685f0b9-9e15-47dc-a00e-96c8187d8633 tempest-VolumeQuotasAdminTestJSON-869677099 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:19:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7685f0b9-9e15-47dc-a00e-96c8187d8633 tempest-VolumeQuotasAdminTestJSON-869677099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:19:48 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7685f0b9-9e15-47dc-a00e-96c8187d8633 tempest-VolumeQuotasAdminTestJSON-869677099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a4185de-f8d5-4a47-b979-685b47d1daa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-460c9650-c344-41c0-80c1-cd59cc10e1da', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:48 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7685f0b9-9e15-47dc-a00e-96c8187d8633 tempest-VolumeQuotasAdminTestJSON-869677099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b32a43-c83c-467d-bf82-2ea1fb07a6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:48 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-7685f0b9-9e15-47dc-a00e-96c8187d8633 tempest-VolumeQuotasAdminTestJSON-869677099 None] Volume volume-460c9650-c344-41c0-80c1-cd59cc10e1da (460c9650-c344-41c0-80c1-cd59cc10e1da): created successfully Aug 31 15:19:48 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7685f0b9-9e15-47dc-a00e-96c8187d8633 tempest-VolumeQuotasAdminTestJSON-869677099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b32a43-c83c-467d-bf82-2ea1fb07a6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:48 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7685f0b9-9e15-47dc-a00e-96c8187d8633 tempest-VolumeQuotasAdminTestJSON-869677099 None] Flow 'volume_create_manager' (3d49fc67-6ca9-4247-9fc8-f5bdc68c24ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:19:48 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-7685f0b9-9e15-47dc-a00e-96c8187d8633 tempest-VolumeQuotasAdminTestJSON-869677099 None] Created volume successfully. Aug 31 15:19:49 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-8b1d23d0-d741-407e-8eb4-1b11f2204c3d tempest-GroupSnapshotsTest-2057849738 None] GroupSnapshot 9c981477-3118-4369-91fd-7dbcb1fcf704: creating. Aug 31 15:19:49 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8b1d23d0-d741-407e-8eb4-1b11f2204c3d tempest-GroupSnapshotsTest-2057849738 None] Group snapshot 9c981477-3118-4369-91fd-7dbcb1fcf704: creating. {{(pid=86000) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 31 15:19:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8b1d23d0-d741-407e-8eb4-1b11f2204c3d tempest-GroupSnapshotsTest-2057849738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:19:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8b1d23d0-d741-407e-8eb4-1b11f2204c3d tempest-GroupSnapshotsTest-2057849738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:19:49 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-8b1d23d0-d741-407e-8eb4-1b11f2204c3d tempest-GroupSnapshotsTest-2057849738 None] Creating offline snapshot 95bd5dce-d9d1-4f0c-9033-437af97e82e2 of volume 3da3a93f-757c-4809-94ea-892ca2e8845a {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:19:49 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2060a76b-caf5-4a41-ae3f-2f155c92841b]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:19:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8b1d23d0-d741-407e-8eb4-1b11f2204c3d tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:49 devstack sudo[95963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a Aug 31 15:19:49 devstack sudo[95963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:49 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-86e54e2a-5b0e-47da-8ceb-c0d2fd6a5966 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:19:49 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-86e54e2a-5b0e-47da-8ceb-c0d2fd6a5966 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Flow 'volume_create_manager' (9203f853-f8bb-413b-8eca-47d2c19bd7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:19:49 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-86e54e2a-5b0e-47da-8ceb-c0d2fd6a5966 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a91c45a8-d3f4-4b2a-8c67-ed8665b51b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:50 devstack sudo[95963]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-86e54e2a-5b0e-47da-8ceb-c0d2fd6a5966 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a91c45a8-d3f4-4b2a-8c67-ed8665b51b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2092621743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eee68707-6113-4611-b50b-896cc9cd56b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='964503ab6de14320b7c3b9abec74fbe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:19:50Z,use_quota=True,user_id='551e3a54b21d4195a8fd79579127e2df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-86e54e2a-5b0e-47da-8ceb-c0d2fd6a5966 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ebbebeb-608e-4d1c-b003-0476aad476d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-86e54e2a-5b0e-47da-8ceb-c0d2fd6a5966 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ebbebeb-608e-4d1c-b003-0476aad476d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-86e54e2a-5b0e-47da-8ceb-c0d2fd6a5966 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f52ce40f-d105-401d-9000-6dc5f57ba9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-86e54e2a-5b0e-47da-8ceb-c0d2fd6a5966 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f52ce40f-d105-401d-9000-6dc5f57ba9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eee68707-6113-4611-b50b-896cc9cd56b6', 'volume_name': 'volume-eee68707-6113-4611-b50b-896cc9cd56b6', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-86e54e2a-5b0e-47da-8ceb-c0d2fd6a5966 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1b8af94-4435-43ed-ad63-321e13597d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-86e54e2a-5b0e-47da-8ceb-c0d2fd6a5966 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1b8af94-4435-43ed-ad63-321e13597d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-86e54e2a-5b0e-47da-8ceb-c0d2fd6a5966 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62381498-afbf-4f2f-b3a3-823d3e372c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:50 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-86e54e2a-5b0e-47da-8ceb-c0d2fd6a5966 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Volume eee68707-6113-4611-b50b-896cc9cd56b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eee68707-6113-4611-b50b-896cc9cd56b6', 'volume_size': 1} Aug 31 15:19:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-86e54e2a-5b0e-47da-8ceb-c0d2fd6a5966 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:19:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8b1d23d0-d741-407e-8eb4-1b11f2204c3d tempest-GroupSnapshotsTest-2057849738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a" returned: 0 in 0.613s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8b1d23d0-d741-407e-8eb4-1b11f2204c3d tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a.95bd5dce-d9d1-4f0c-9033-437af97e82e2 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:50 devstack sudo[95968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a.95bd5dce-d9d1-4f0c-9033-437af97e82e2 1G Aug 31 15:19:50 devstack sudo[95968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:50 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-ae0e4bc8-1e08-4162-9ab8-9cb2fe18e631 tempest-VolumeQuotasAdminTestJSON-992732128 None] Transfer volume completed successfully. Aug 31 15:19:50 devstack sudo[95968]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8b1d23d0-d741-407e-8eb4-1b11f2204c3d tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a.95bd5dce-d9d1-4f0c-9033-437af97e82e2 1G" returned: 0 in 0.491s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8b1d23d0-d741-407e-8eb4-1b11f2204c3d tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3da3a93f-757c-4809-94ea-892ca2e8845a -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a.95bd5dce-d9d1-4f0c-9033-437af97e82e2 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:50 devstack sudo[95974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3da3a93f-757c-4809-94ea-892ca2e8845a -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a.95bd5dce-d9d1-4f0c-9033-437af97e82e2 Aug 31 15:19:50 devstack sudo[95974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:50 devstack sudo[95974]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8b1d23d0-d741-407e-8eb4-1b11f2204c3d tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3da3a93f-757c-4809-94ea-892ca2e8845a -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a.95bd5dce-d9d1-4f0c-9033-437af97e82e2" returned: 0 in 0.387s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:50 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-8b1d23d0-d741-407e-8eb4-1b11f2204c3d tempest-GroupSnapshotsTest-2057849738 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a.95bd5dce-d9d1-4f0c-9033-437af97e82e2 is being set with open permissions: ugo+rw: NotImplementedError Aug 31 15:19:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8b1d23d0-d741-407e-8eb4-1b11f2204c3d tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a.95bd5dce-d9d1-4f0c-9033-437af97e82e2 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:50 devstack sudo[95980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a.95bd5dce-d9d1-4f0c-9033-437af97e82e2 Aug 31 15:19:50 devstack sudo[95980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:51 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a39cecfa-e734-4faa-bbb7-aa0944bd8588 tempest-VolumeQuotasAdminTestJSON-1106272954 None] Acquiring lock "cinder-460c9650-c344-41c0-80c1-cd59cc10e1da-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:19:51 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a39cecfa-e734-4faa-bbb7-aa0944bd8588 tempest-VolumeQuotasAdminTestJSON-1106272954 None] Lock "cinder-460c9650-c344-41c0-80c1-cd59cc10e1da-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:19:51 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a39cecfa-e734-4faa-bbb7-aa0944bd8588 tempest-VolumeQuotasAdminTestJSON-1106272954 None] Acquiring lock "cinder-quobyte-460c9650-c344-41c0-80c1-cd59cc10e1da" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:19:51 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a39cecfa-e734-4faa-bbb7-aa0944bd8588 tempest-VolumeQuotasAdminTestJSON-1106272954 None] Lock "cinder-quobyte-460c9650-c344-41c0-80c1-cd59cc10e1da" acquired by "delete_volume" :: waited 0.019s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:19:51 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0a82ab-5a7e-4515-9f05-b4ce32d51bf2]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:19:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a39cecfa-e734-4faa-bbb7-aa0944bd8588 tempest-VolumeQuotasAdminTestJSON-1106272954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-460c9650-c344-41c0-80c1-cd59cc10e1da {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:51 devstack sudo[95980]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8b1d23d0-d741-407e-8eb4-1b11f2204c3d tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a.95bd5dce-d9d1-4f0c-9033-437af97e82e2" returned: 0 in 0.314s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8b1d23d0-d741-407e-8eb4-1b11f2204c3d tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:51 devstack sudo[95982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-460c9650-c344-41c0-80c1-cd59cc10e1da Aug 31 15:19:51 devstack sudo[95982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:51 devstack sudo[95984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a.info Aug 31 15:19:51 devstack sudo[95984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:51 devstack sudo[95984]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8b1d23d0-d741-407e-8eb4-1b11f2204c3d tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a.info" returned: 0 in 0.425s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:51 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-8b1d23d0-d741-407e-8eb4-1b11f2204c3d tempest-GroupSnapshotsTest-2057849738 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a.info is being set with open permissions: ugo+rw: NotImplementedError Aug 31 15:19:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8b1d23d0-d741-407e-8eb4-1b11f2204c3d tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:51 devstack sudo[95982]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a39cecfa-e734-4faa-bbb7-aa0944bd8588 tempest-VolumeQuotasAdminTestJSON-1106272954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-460c9650-c344-41c0-80c1-cd59cc10e1da" returned: 0 in 0.547s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a39cecfa-e734-4faa-bbb7-aa0944bd8588 tempest-VolumeQuotasAdminTestJSON-1106272954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-460c9650-c344-41c0-80c1-cd59cc10e1da {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:51 devstack sudo[96006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a.info Aug 31 15:19:51 devstack sudo[96006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:51 devstack sudo[96008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-460c9650-c344-41c0-80c1-cd59cc10e1da Aug 31 15:19:51 devstack sudo[96008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:52 devstack sudo[96008]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a39cecfa-e734-4faa-bbb7-aa0944bd8588 tempest-VolumeQuotasAdminTestJSON-1106272954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-460c9650-c344-41c0-80c1-cd59cc10e1da" returned: 0 in 0.474s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:52 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a39cecfa-e734-4faa-bbb7-aa0944bd8588 tempest-VolumeQuotasAdminTestJSON-1106272954 None] Lock "cinder-quobyte-460c9650-c344-41c0-80c1-cd59cc10e1da" released by "delete_volume" :: held 1.099s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:19:52 devstack sudo[96006]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8b1d23d0-d741-407e-8eb4-1b11f2204c3d tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a.info" returned: 0 in 0.588s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8b1d23d0-d741-407e-8eb4-1b11f2204c3d tempest-GroupSnapshotsTest-2057849738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.942s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:19:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-86e54e2a-5b0e-47da-8ceb-c0d2fd6a5966 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.310s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:19:52 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-86e54e2a-5b0e-47da-8ceb-c0d2fd6a5966 tempest-VolumeQuotasNegativeTestJSON-807680625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2092621743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eee68707-6113-4611-b50b-896cc9cd56b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='964503ab6de14320b7c3b9abec74fbe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:19:50Z,use_quota=True,user_id='551e3a54b21d4195a8fd79579127e2df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:19:52 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-86e54e2a-5b0e-47da-8ceb-c0d2fd6a5966 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Creating volume eee68707-6113-4611-b50b-896cc9cd56b6 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:19:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-86e54e2a-5b0e-47da-8ceb-c0d2fd6a5966 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:19:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-86e54e2a-5b0e-47da-8ceb-c0d2fd6a5966 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:19:52 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-86e54e2a-5b0e-47da-8ceb-c0d2fd6a5966 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:19:52 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-86e54e2a-5b0e-47da-8ceb-c0d2fd6a5966 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:19:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-86e54e2a-5b0e-47da-8ceb-c0d2fd6a5966 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:19:52 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-86e54e2a-5b0e-47da-8ceb-c0d2fd6a5966 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:19:52 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-86e54e2a-5b0e-47da-8ceb-c0d2fd6a5966 tempest-VolumeQuotasNegativeTestJSON-807680625 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:19:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-86e54e2a-5b0e-47da-8ceb-c0d2fd6a5966 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eee68707-6113-4611-b50b-896cc9cd56b6 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:52 devstack sudo[96058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eee68707-6113-4611-b50b-896cc9cd56b6 1073741824 Aug 31 15:19:52 devstack sudo[96058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:52 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-a39cecfa-e734-4faa-bbb7-aa0944bd8588 tempest-VolumeQuotasAdminTestJSON-1106272954 None] Created reservations ['4ef9d2b6-6543-4604-91e2-7bb71a62ac4e', '16a6e4ac-ccbf-4a55-95d3-838e53ee3210', 'f4d7c0a4-d272-4bdb-b906-b5cba1efba64', '571a13ea-5c38-4f28-bba0-d9f1dbdea765'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:19:52 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-8b1d23d0-d741-407e-8eb4-1b11f2204c3d tempest-GroupSnapshotsTest-2057849738 None] group_snapshot 9c981477-3118-4369-91fd-7dbcb1fcf704: created successfully Aug 31 15:19:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-a39cecfa-e734-4faa-bbb7-aa0944bd8588 tempest-VolumeQuotasAdminTestJSON-1106272954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:19:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-a39cecfa-e734-4faa-bbb7-aa0944bd8588 tempest-VolumeQuotasAdminTestJSON-1106272954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:19:52 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-a39cecfa-e734-4faa-bbb7-aa0944bd8588 tempest-VolumeQuotasAdminTestJSON-1106272954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:19:52 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-a39cecfa-e734-4faa-bbb7-aa0944bd8588 tempest-VolumeQuotasAdminTestJSON-1106272954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:19:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-a39cecfa-e734-4faa-bbb7-aa0944bd8588 tempest-VolumeQuotasAdminTestJSON-1106272954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:19:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a39cecfa-e734-4faa-bbb7-aa0944bd8588 tempest-VolumeQuotasAdminTestJSON-1106272954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:52 devstack sudo[96064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:19:52 devstack sudo[96064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:53 devstack sudo[96064]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a39cecfa-e734-4faa-bbb7-aa0944bd8588 tempest-VolumeQuotasAdminTestJSON-1106272954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.343s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:53 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-a39cecfa-e734-4faa-bbb7-aa0944bd8588 tempest-VolumeQuotasAdminTestJSON-1106272954 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:19:53 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-a39cecfa-e734-4faa-bbb7-aa0944bd8588 tempest-VolumeQuotasAdminTestJSON-1106272954 None] Deleted volume successfully. Aug 31 15:19:53 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a39cecfa-e734-4faa-bbb7-aa0944bd8588 tempest-VolumeQuotasAdminTestJSON-1106272954 None] Lock "cinder-460c9650-c344-41c0-80c1-cd59cc10e1da-delete_volume" released by "delete_volume" :: held 2.045s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:19:53 devstack sudo[96058]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-86e54e2a-5b0e-47da-8ceb-c0d2fd6a5966 tempest-VolumeQuotasNegativeTestJSON-807680625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eee68707-6113-4611-b50b-896cc9cd56b6 1073741824" returned: 0 in 0.753s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-86e54e2a-5b0e-47da-8ceb-c0d2fd6a5966 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eee68707-6113-4611-b50b-896cc9cd56b6 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:53 devstack sudo[96072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eee68707-6113-4611-b50b-896cc9cd56b6 Aug 31 15:19:53 devstack sudo[96072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:53 devstack sudo[96072]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-86e54e2a-5b0e-47da-8ceb-c0d2fd6a5966 tempest-VolumeQuotasNegativeTestJSON-807680625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eee68707-6113-4611-b50b-896cc9cd56b6" returned: 0 in 0.343s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:53 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-86e54e2a-5b0e-47da-8ceb-c0d2fd6a5966 tempest-VolumeQuotasNegativeTestJSON-807680625 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:19:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-86e54e2a-5b0e-47da-8ceb-c0d2fd6a5966 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:19:53 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-86e54e2a-5b0e-47da-8ceb-c0d2fd6a5966 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62381498-afbf-4f2f-b3a3-823d3e372c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eee68707-6113-4611-b50b-896cc9cd56b6', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:53 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-86e54e2a-5b0e-47da-8ceb-c0d2fd6a5966 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a38cdcda-fff9-464a-aa5e-bc0ff3836561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:19:53 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-86e54e2a-5b0e-47da-8ceb-c0d2fd6a5966 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Volume volume-eee68707-6113-4611-b50b-896cc9cd56b6 (eee68707-6113-4611-b50b-896cc9cd56b6): created successfully Aug 31 15:19:53 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-86e54e2a-5b0e-47da-8ceb-c0d2fd6a5966 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a38cdcda-fff9-464a-aa5e-bc0ff3836561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:19:53 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-86e54e2a-5b0e-47da-8ceb-c0d2fd6a5966 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Flow 'volume_create_manager' (9203f853-f8bb-413b-8eca-47d2c19bd7c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:19:53 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-86e54e2a-5b0e-47da-8ceb-c0d2fd6a5966 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Created volume successfully. Aug 31 15:19:54 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-848a80fc-24bb-4f4f-a634-c67bcf1feee3 tempest-VolumesActionsTest-1059975936 None] Acquiring lock "cinder-8192cdb3-1d90-4b41-b1ec-dee126808385" by "attach_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:19:54 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-848a80fc-24bb-4f4f-a634-c67bcf1feee3 tempest-VolumesActionsTest-1059975936 None] Lock "cinder-8192cdb3-1d90-4b41-b1ec-dee126808385" acquired by "attach_volume" :: waited 0.045s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:19:54 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-848a80fc-24bb-4f4f-a634-c67bcf1feee3 tempest-VolumesActionsTest-1059975936 None] Attaching volume 8192cdb3-1d90-4b41-b1ec-dee126808385 to instance ebbfb833-b056-4a7d-a9f3-a33add30da22 at mountpoint /dev/vdb on host None. Aug 31 15:19:54 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-848a80fc-24bb-4f4f-a634-c67bcf1feee3 tempest-VolumesActionsTest-1059975936 None] Attach volume completed successfully. Aug 31 15:19:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-618535c3-462d-438e-929e-f6c74f20cfd2 tempest-GroupSnapshotsTest-2057849738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:19:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-618535c3-462d-438e-929e-f6c74f20cfd2 tempest-GroupSnapshotsTest-2057849738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:19:54 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-618535c3-462d-438e-929e-f6c74f20cfd2 tempest-GroupSnapshotsTest-2057849738 None] Acquiring lock "cinder-quobyte-95bd5dce-d9d1-4f0c-9033-437af97e82e2-608624b4-f3e7-448d-bfd3-cb47922695a9" by "_create_volume_from_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:19:54 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-848a80fc-24bb-4f4f-a634-c67bcf1feee3 tempest-VolumesActionsTest-1059975936 None] Lock "cinder-8192cdb3-1d90-4b41-b1ec-dee126808385" released by "attach_volume" :: held 0.190s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:19:54 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-618535c3-462d-438e-929e-f6c74f20cfd2 tempest-GroupSnapshotsTest-2057849738 None] Lock "cinder-quobyte-95bd5dce-d9d1-4f0c-9033-437af97e82e2-608624b4-f3e7-448d-bfd3-cb47922695a9" acquired by "_create_volume_from_snapshot" :: waited 0.045s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:19:54 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-618535c3-462d-438e-929e-f6c74f20cfd2 tempest-GroupSnapshotsTest-2057849738 None] Creating volume 608624b4-f3e7-448d-bfd3-cb47922695a9 from snapshot 95bd5dce-d9d1-4f0c-9033-437af97e82e2 {{(pid=86000) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 31 15:19:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-618535c3-462d-438e-929e-f6c74f20cfd2 tempest-GroupSnapshotsTest-2057849738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:19:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-618535c3-462d-438e-929e-f6c74f20cfd2 tempest-GroupSnapshotsTest-2057849738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:19:54 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-618535c3-462d-438e-929e-f6c74f20cfd2 tempest-GroupSnapshotsTest-2057849738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:19:54 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-618535c3-462d-438e-929e-f6c74f20cfd2 tempest-GroupSnapshotsTest-2057849738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:19:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-618535c3-462d-438e-929e-f6c74f20cfd2 tempest-GroupSnapshotsTest-2057849738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:19:54 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-618535c3-462d-438e-929e-f6c74f20cfd2 tempest-GroupSnapshotsTest-2057849738 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:19:54 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-618535c3-462d-438e-929e-f6c74f20cfd2 tempest-GroupSnapshotsTest-2057849738 None] Acquiring lock "cinder-quobyte-608624b4-f3e7-448d-bfd3-cb47922695a9" by "_copy_volume_from_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:19:54 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-618535c3-462d-438e-929e-f6c74f20cfd2 tempest-GroupSnapshotsTest-2057849738 None] Lock "cinder-quobyte-608624b4-f3e7-448d-bfd3-cb47922695a9" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:19:54 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-618535c3-462d-438e-929e-f6c74f20cfd2 tempest-GroupSnapshotsTest-2057849738 None] snapshot: 95bd5dce-d9d1-4f0c-9033-437af97e82e2, volume: 608624b4-f3e7-448d-bfd3-cb47922695a9, {{(pid=86000) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 31 15:19:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-618535c3-462d-438e-929e-f6c74f20cfd2 tempest-GroupSnapshotsTest-2057849738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:19:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-618535c3-462d-438e-929e-f6c74f20cfd2 tempest-GroupSnapshotsTest-2057849738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:19:54 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-618535c3-462d-438e-929e-f6c74f20cfd2 tempest-GroupSnapshotsTest-2057849738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:19:54 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-618535c3-462d-438e-929e-f6c74f20cfd2 tempest-GroupSnapshotsTest-2057849738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:19:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-618535c3-462d-438e-929e-f6c74f20cfd2 tempest-GroupSnapshotsTest-2057849738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:19:54 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d77ee58-edea-400b-b00a-90e8fad44749]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:19:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-618535c3-462d-438e-929e-f6c74f20cfd2 tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a.95bd5dce-d9d1-4f0c-9033-437af97e82e2 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:55 devstack sudo[96077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a.95bd5dce-d9d1-4f0c-9033-437af97e82e2 Aug 31 15:19:55 devstack sudo[96077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:55 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4bfc0936-3792-4367-aaa6-caaf5ccfc063 tempest-VolumesActionsTest-1059975936 None] Acquiring lock "cinder-8192cdb3-1d90-4b41-b1ec-dee126808385-detach_volume" by "detach_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:19:55 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4bfc0936-3792-4367-aaa6-caaf5ccfc063 tempest-VolumesActionsTest-1059975936 None] Lock "cinder-8192cdb3-1d90-4b41-b1ec-dee126808385-detach_volume" acquired by "detach_volume" :: waited 0.041s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:19:55 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-4bfc0936-3792-4367-aaa6-caaf5ccfc063 tempest-VolumesActionsTest-1059975936 None] Detaching volume 8192cdb3-1d90-4b41-b1ec-dee126808385 from instance ebbfb833-b056-4a7d-a9f3-a33add30da22. Aug 31 15:19:55 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-4bfc0936-3792-4367-aaa6-caaf5ccfc063 tempest-VolumesActionsTest-1059975936 None] Detach volume completed successfully. Aug 31 15:19:55 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4bfc0936-3792-4367-aaa6-caaf5ccfc063 tempest-VolumesActionsTest-1059975936 None] Lock "cinder-8192cdb3-1d90-4b41-b1ec-dee126808385-detach_volume" released by "detach_volume" :: held 0.109s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:19:55 devstack sudo[96077]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-618535c3-462d-438e-929e-f6c74f20cfd2 tempest-GroupSnapshotsTest-2057849738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a.95bd5dce-d9d1-4f0c-9033-437af97e82e2" returned: 0 in 0.647s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:55 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-618535c3-462d-438e-929e-f6c74f20cfd2 tempest-GroupSnapshotsTest-2057849738 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3da3a93f-757c-4809-94ea-892ca2e8845a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:19:55 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba84afb9-b6b4-4dc2-bdea-18947d316fe2]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:19:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-618535c3-462d-438e-929e-f6c74f20cfd2 tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:55 devstack sudo[96083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a Aug 31 15:19:55 devstack sudo[96083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:56 devstack sudo[96083]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-618535c3-462d-438e-929e-f6c74f20cfd2 tempest-GroupSnapshotsTest-2057849738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a" returned: 0 in 0.586s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-618535c3-462d-438e-929e-f6c74f20cfd2 tempest-GroupSnapshotsTest-2057849738 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a {{(pid=86000) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 31 15:19:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-618535c3-462d-438e-929e-f6c74f20cfd2 tempest-GroupSnapshotsTest-2057849738 None] Creating direct copy from snapshot {{(pid=86000) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 31 15:19:56 devstack cinder-volume[86000]: DEBUG cinder.utils [None req-618535c3-462d-438e-929e-f6c74f20cfd2 tempest-GroupSnapshotsTest-2057849738 None] Path /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-608624b4-f3e7-448d-bfd3-cb47922695a9 not found in is_blk_device check {{(pid=86000) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 31 15:19:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-618535c3-462d-438e-929e-f6c74f20cfd2 tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-608624b4-f3e7-448d-bfd3-cb47922695a9 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:56 devstack sudo[96091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-608624b4-f3e7-448d-bfd3-cb47922695a9 Aug 31 15:19:56 devstack sudo[96091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:56 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5b7559c7-9bb4-4135-9277-e3e9fddb2d59 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Acquiring lock "cinder-eee68707-6113-4611-b50b-896cc9cd56b6-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:19:56 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5b7559c7-9bb4-4135-9277-e3e9fddb2d59 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Lock "cinder-eee68707-6113-4611-b50b-896cc9cd56b6-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:19:56 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5b7559c7-9bb4-4135-9277-e3e9fddb2d59 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Acquiring lock "cinder-quobyte-eee68707-6113-4611-b50b-896cc9cd56b6" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:19:56 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5b7559c7-9bb4-4135-9277-e3e9fddb2d59 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Lock "cinder-quobyte-eee68707-6113-4611-b50b-896cc9cd56b6" acquired by "delete_volume" :: waited 0.019s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:19:56 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[983d3970-0cd5-4d70-9591-f32c6fdf4e96]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:19:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5b7559c7-9bb4-4135-9277-e3e9fddb2d59 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eee68707-6113-4611-b50b-896cc9cd56b6 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:56 devstack sudo[96115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eee68707-6113-4611-b50b-896cc9cd56b6 Aug 31 15:19:56 devstack sudo[96115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:57 devstack sudo[96115]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5b7559c7-9bb4-4135-9277-e3e9fddb2d59 tempest-VolumeQuotasNegativeTestJSON-807680625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eee68707-6113-4611-b50b-896cc9cd56b6" returned: 0 in 0.781s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5b7559c7-9bb4-4135-9277-e3e9fddb2d59 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eee68707-6113-4611-b50b-896cc9cd56b6 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:57 devstack sudo[96128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eee68707-6113-4611-b50b-896cc9cd56b6 Aug 31 15:19:57 devstack sudo[96128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:58 devstack sudo[96128]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5b7559c7-9bb4-4135-9277-e3e9fddb2d59 tempest-VolumeQuotasNegativeTestJSON-807680625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eee68707-6113-4611-b50b-896cc9cd56b6" returned: 0 in 0.722s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:58 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5b7559c7-9bb4-4135-9277-e3e9fddb2d59 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Lock "cinder-quobyte-eee68707-6113-4611-b50b-896cc9cd56b6" released by "delete_volume" :: held 1.614s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:19:58 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-5b7559c7-9bb4-4135-9277-e3e9fddb2d59 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Created reservations ['72915e6c-d45c-44d2-aa60-f48da5af13ef', 'a5affcf8-d022-434c-8e7a-0ee62e2ca8ec', '87f4fd50-f8ca-47cf-9850-1bb0da899cdb', '30831eea-11d7-4c61-811b-b4fa4bf9378f'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:19:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5b7559c7-9bb4-4135-9277-e3e9fddb2d59 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:19:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5b7559c7-9bb4-4135-9277-e3e9fddb2d59 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:19:58 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5b7559c7-9bb4-4135-9277-e3e9fddb2d59 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:19:58 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5b7559c7-9bb4-4135-9277-e3e9fddb2d59 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:19:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5b7559c7-9bb4-4135-9277-e3e9fddb2d59 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:19:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5b7559c7-9bb4-4135-9277-e3e9fddb2d59 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:19:58 devstack sudo[96132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:19:58 devstack sudo[96132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:19:59 devstack sudo[96132]: pam_unix(sudo:session): session closed for user root Aug 31 15:19:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5b7559c7-9bb4-4135-9277-e3e9fddb2d59 tempest-VolumeQuotasNegativeTestJSON-807680625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.971s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:19:59 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-5b7559c7-9bb4-4135-9277-e3e9fddb2d59 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:19:59 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-5b7559c7-9bb4-4135-9277-e3e9fddb2d59 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Deleted volume successfully. Aug 31 15:19:59 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5b7559c7-9bb4-4135-9277-e3e9fddb2d59 tempest-VolumeQuotasNegativeTestJSON-807680625 None] Lock "cinder-eee68707-6113-4611-b50b-896cc9cd56b6-delete_volume" released by "delete_volume" :: held 3.213s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:20:03 devstack sudo[96091]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-618535c3-462d-438e-929e-f6c74f20cfd2 tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-608624b4-f3e7-448d-bfd3-cb47922695a9" returned: 0 in 6.916s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:03 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-618535c3-462d-438e-929e-f6c74f20cfd2 tempest-GroupSnapshotsTest-2057849738 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a, size 1024.00 MB, duration 6.92 sec, destination /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-608624b4-f3e7-448d-bfd3-cb47922695a9 {{(pid=86000) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 31 15:20:03 devstack cinder-volume[86000]: INFO cinder.image.image_utils [None req-618535c3-462d-438e-929e-f6c74f20cfd2 tempest-GroupSnapshotsTest-2057849738 None] Converted 1024.00 MB image at 148.04 MB/s Aug 31 15:20:03 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-618535c3-462d-438e-929e-f6c74f20cfd2 tempest-GroupSnapshotsTest-2057849738 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-608624b4-f3e7-448d-bfd3-cb47922695a9 is being set with open permissions: ugo+rw: NotImplementedError Aug 31 15:20:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-618535c3-462d-438e-929e-f6c74f20cfd2 tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-608624b4-f3e7-448d-bfd3-cb47922695a9 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:03 devstack sudo[96138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-608624b4-f3e7-448d-bfd3-cb47922695a9 Aug 31 15:20:03 devstack sudo[96138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:03 devstack sudo[96138]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-618535c3-462d-438e-929e-f6c74f20cfd2 tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-608624b4-f3e7-448d-bfd3-cb47922695a9" returned: 0 in 0.305s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:03 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-618535c3-462d-438e-929e-f6c74f20cfd2 tempest-GroupSnapshotsTest-2057849738 None] Lock "cinder-quobyte-608624b4-f3e7-448d-bfd3-cb47922695a9" released by "_copy_volume_from_snapshot" :: held 8.642s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:20:03 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-618535c3-462d-438e-929e-f6c74f20cfd2 tempest-GroupSnapshotsTest-2057849738 None] Lock "cinder-quobyte-95bd5dce-d9d1-4f0c-9033-437af97e82e2-608624b4-f3e7-448d-bfd3-cb47922695a9" released by "_create_volume_from_snapshot" :: held 8.764s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:20:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-618535c3-462d-438e-929e-f6c74f20cfd2 tempest-GroupSnapshotsTest-2057849738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.811s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:20:03 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-618535c3-462d-438e-929e-f6c74f20cfd2 tempest-GroupSnapshotsTest-2057849738 None] Create group from source-snapshot-9c981477-3118-4369-91fd-7dbcb1fcf704 completed successfully. Aug 31 15:20:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-2de3d169-a4fb-4c23-af03-16e925566df9 tempest-VolumesActionsTest-1059975936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:20:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-2de3d169-a4fb-4c23-af03-16e925566df9 tempest-VolumesActionsTest-1059975936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:20:04 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da83457-7813-47b8-9ea0-46c20803c846]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:20:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2de3d169-a4fb-4c23-af03-16e925566df9 tempest-VolumesActionsTest-1059975936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8192cdb3-1d90-4b41-b1ec-dee126808385 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:04 devstack sudo[96141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8192cdb3-1d90-4b41-b1ec-dee126808385 Aug 31 15:20:04 devstack sudo[96141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:04 devstack sudo[96141]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2de3d169-a4fb-4c23-af03-16e925566df9 tempest-VolumesActionsTest-1059975936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8192cdb3-1d90-4b41-b1ec-dee126808385" returned: 0 in 0.488s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:04 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd0f813-eef3-4cb2-959d-8b35c8f37336]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:20:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2de3d169-a4fb-4c23-af03-16e925566df9 tempest-VolumesActionsTest-1059975936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8192cdb3-1d90-4b41-b1ec-dee126808385 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:05 devstack sudo[96146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8192cdb3-1d90-4b41-b1ec-dee126808385 Aug 31 15:20:05 devstack sudo[96146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:05 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4ac274c2-7f8b-441c-902e-318ae2c4aabd tempest-GroupSnapshotsTest-2057849738 None] Acquiring lock "cinder-quobyte-608624b4-f3e7-448d-bfd3-cb47922695a9" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:20:05 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4ac274c2-7f8b-441c-902e-318ae2c4aabd tempest-GroupSnapshotsTest-2057849738 None] Lock "cinder-quobyte-608624b4-f3e7-448d-bfd3-cb47922695a9" acquired by "delete_volume" :: waited 0.028s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:20:05 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7edd995e-b3cb-4099-bb44-32a9fc3dada1]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:20:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4ac274c2-7f8b-441c-902e-318ae2c4aabd tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-608624b4-f3e7-448d-bfd3-cb47922695a9 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:05 devstack sudo[96146]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2de3d169-a4fb-4c23-af03-16e925566df9 tempest-VolumesActionsTest-1059975936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8192cdb3-1d90-4b41-b1ec-dee126808385" returned: 0 in 0.534s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2de3d169-a4fb-4c23-af03-16e925566df9 tempest-VolumesActionsTest-1059975936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8192cdb3-1d90-4b41-b1ec-dee126808385 /opt/stack/data/cinder/conversion/8192cdb3-1d90-4b41-b1ec-dee126808385.temp_image.ff3089db-327a-488f-9bf7-f312abfe8f8d5_1xya20.img {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:05 devstack sudo[96152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8192cdb3-1d90-4b41-b1ec-dee126808385 /opt/stack/data/cinder/conversion/8192cdb3-1d90-4b41-b1ec-dee126808385.temp_image.ff3089db-327a-488f-9bf7-f312abfe8f8d5_1xya20.img Aug 31 15:20:05 devstack sudo[96152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:05 devstack sudo[96151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-608624b4-f3e7-448d-bfd3-cb47922695a9 Aug 31 15:20:05 devstack sudo[96151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:06 devstack sudo[96151]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4ac274c2-7f8b-441c-902e-318ae2c4aabd tempest-GroupSnapshotsTest-2057849738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-608624b4-f3e7-448d-bfd3-cb47922695a9" returned: 0 in 0.619s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4ac274c2-7f8b-441c-902e-318ae2c4aabd tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-608624b4-f3e7-448d-bfd3-cb47922695a9 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:06 devstack sudo[96168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-608624b4-f3e7-448d-bfd3-cb47922695a9 Aug 31 15:20:06 devstack sudo[96168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:07 devstack sudo[96168]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4ac274c2-7f8b-441c-902e-318ae2c4aabd tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-608624b4-f3e7-448d-bfd3-cb47922695a9" returned: 0 in 1.085s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:07 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4ac274c2-7f8b-441c-902e-318ae2c4aabd tempest-GroupSnapshotsTest-2057849738 None] Lock "cinder-quobyte-608624b4-f3e7-448d-bfd3-cb47922695a9" released by "delete_volume" :: held 1.804s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:20:07 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-4ac274c2-7f8b-441c-902e-318ae2c4aabd tempest-GroupSnapshotsTest-2057849738 None] Created reservations ['4c6dbef7-6f19-4815-80cf-3aebb6156215'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:20:07 devstack cinder-volume[86000]: WARNING cinder.quota [None req-4ac274c2-7f8b-441c-902e-318ae2c4aabd tempest-GroupSnapshotsTest-2057849738 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1980425733 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1980425733, it is now deprecated. Please use the default quota class for default quota. Aug 31 15:20:07 devstack cinder-volume[86000]: WARNING cinder.quota [None req-4ac274c2-7f8b-441c-902e-318ae2c4aabd tempest-GroupSnapshotsTest-2057849738 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1980425733 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1980425733, it is now deprecated. Please use the default quota class for default quota. Aug 31 15:20:07 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-4ac274c2-7f8b-441c-902e-318ae2c4aabd tempest-GroupSnapshotsTest-2057849738 None] Created reservations ['17d21362-be43-467f-b7f8-519285169291', '29889c8c-e5e1-4cbe-aa84-c048b22b8094', 'cfb9aa72-4985-4228-925a-b9f557a75ae2', 'ec12c563-50c9-417f-9cce-6277c53fb4df'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:20:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4ac274c2-7f8b-441c-902e-318ae2c4aabd tempest-GroupSnapshotsTest-2057849738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:20:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4ac274c2-7f8b-441c-902e-318ae2c4aabd tempest-GroupSnapshotsTest-2057849738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:20:07 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4ac274c2-7f8b-441c-902e-318ae2c4aabd tempest-GroupSnapshotsTest-2057849738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:20:07 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4ac274c2-7f8b-441c-902e-318ae2c4aabd tempest-GroupSnapshotsTest-2057849738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:20:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4ac274c2-7f8b-441c-902e-318ae2c4aabd tempest-GroupSnapshotsTest-2057849738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:20:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4ac274c2-7f8b-441c-902e-318ae2c4aabd tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:07 devstack sudo[96172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:20:08 devstack sudo[96172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:08 devstack sudo[96172]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4ac274c2-7f8b-441c-902e-318ae2c4aabd tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.712s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:08 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-4ac274c2-7f8b-441c-902e-318ae2c4aabd tempest-GroupSnapshotsTest-2057849738 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:20:08 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-4ac274c2-7f8b-441c-902e-318ae2c4aabd tempest-GroupSnapshotsTest-2057849738 None] Delete group completed successfully. Aug 31 15:20:08 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-8b8ade2f-7e57-438f-8468-9e9b2bf519b5 tempest-GroupSnapshotsTest-2057849738 None] group_snapshot 9c981477-3118-4369-91fd-7dbcb1fcf704: deleting Aug 31 15:20:08 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8b8ade2f-7e57-438f-8468-9e9b2bf519b5 tempest-GroupSnapshotsTest-2057849738 None] group_snapshot 9c981477-3118-4369-91fd-7dbcb1fcf704: deleting {{(pid=86000) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 31 15:20:08 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-8b8ade2f-7e57-438f-8468-9e9b2bf519b5 tempest-GroupSnapshotsTest-2057849738 None] Acquiring lock "cinder-quobyte-3da3a93f-757c-4809-94ea-892ca2e8845a" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:20:08 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-8b8ade2f-7e57-438f-8468-9e9b2bf519b5 tempest-GroupSnapshotsTest-2057849738 None] Lock "cinder-quobyte-3da3a93f-757c-4809-94ea-892ca2e8845a" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:20:08 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-8b8ade2f-7e57-438f-8468-9e9b2bf519b5 tempest-GroupSnapshotsTest-2057849738 None] Acquiring lock "cinder-quobyte-95bd5dce-d9d1-4f0c-9033-437af97e82e2" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:20:08 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-8b8ade2f-7e57-438f-8468-9e9b2bf519b5 tempest-GroupSnapshotsTest-2057849738 None] Lock "cinder-quobyte-95bd5dce-d9d1-4f0c-9033-437af97e82e2" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:20:08 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-8b8ade2f-7e57-438f-8468-9e9b2bf519b5 tempest-GroupSnapshotsTest-2057849738 None] Deleting offline snapshot 95bd5dce-d9d1-4f0c-9033-437af97e82e2 of volume 3da3a93f-757c-4809-94ea-892ca2e8845a {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:20:08 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-8b8ade2f-7e57-438f-8468-9e9b2bf519b5 tempest-GroupSnapshotsTest-2057849738 None] snapshot_file for this snap is: volume-3da3a93f-757c-4809-94ea-892ca2e8845a.95bd5dce-d9d1-4f0c-9033-437af97e82e2 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:20:09 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c687b1-6264-4ef0-b024-5220a0bb2cca]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:20:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8b8ade2f-7e57-438f-8468-9e9b2bf519b5 tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a.95bd5dce-d9d1-4f0c-9033-437af97e82e2 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:09 devstack sudo[96175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a.95bd5dce-d9d1-4f0c-9033-437af97e82e2 Aug 31 15:20:09 devstack sudo[96175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:10 devstack sudo[96175]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8b8ade2f-7e57-438f-8468-9e9b2bf519b5 tempest-GroupSnapshotsTest-2057849738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a.95bd5dce-d9d1-4f0c-9033-437af97e82e2" returned: 0 in 1.199s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:10 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-8b8ade2f-7e57-438f-8468-9e9b2bf519b5 tempest-GroupSnapshotsTest-2057849738 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3da3a93f-757c-4809-94ea-892ca2e8845a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:20:10 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[752c8dc9-62ec-4e75-bb7d-5d42921a5cff]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:20:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8b8ade2f-7e57-438f-8468-9e9b2bf519b5 tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:10 devstack sudo[96181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a Aug 31 15:20:10 devstack sudo[96181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:10 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-219c587d-0e8c-4904-b898-39f052f23c67 tempest-VolumesServicesTestJSON-968030087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:20:10 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-219c587d-0e8c-4904-b898-39f052f23c67 tempest-VolumesServicesTestJSON-968030087 None] Flow 'volume_create_manager' (9b68574a-472c-40ce-a660-d3b09b608216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:20:10 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-219c587d-0e8c-4904-b898-39f052f23c67 tempest-VolumesServicesTestJSON-968030087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daf039b8-29bc-488d-ae07-6a3ba0a2ed97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:10 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-219c587d-0e8c-4904-b898-39f052f23c67 tempest-VolumesServicesTestJSON-968030087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daf039b8-29bc-488d-ae07-6a3ba0a2ed97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1446670962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=229016b8-e5d0-474b-bb0f-c9cfa2dc3ab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b12c5bc582784636b32062f6c314e50e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:20:11Z,use_quota=True,user_id='a1e8fa03717d4b2bba54ac067b2433b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:10 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-219c587d-0e8c-4904-b898-39f052f23c67 tempest-VolumesServicesTestJSON-968030087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa4ffb60-61cf-4db0-96f7-8b118c5b24fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:10 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-219c587d-0e8c-4904-b898-39f052f23c67 tempest-VolumesServicesTestJSON-968030087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa4ffb60-61cf-4db0-96f7-8b118c5b24fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:10 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-219c587d-0e8c-4904-b898-39f052f23c67 tempest-VolumesServicesTestJSON-968030087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e27d094d-dfb6-48aa-8838-9ea2bba12852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:10 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-219c587d-0e8c-4904-b898-39f052f23c67 tempest-VolumesServicesTestJSON-968030087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e27d094d-dfb6-48aa-8838-9ea2bba12852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '229016b8-e5d0-474b-bb0f-c9cfa2dc3ab7', 'volume_name': 'volume-229016b8-e5d0-474b-bb0f-c9cfa2dc3ab7', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:10 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-219c587d-0e8c-4904-b898-39f052f23c67 tempest-VolumesServicesTestJSON-968030087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d2beb42-0419-4c44-b65b-7b51320e0690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:10 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-219c587d-0e8c-4904-b898-39f052f23c67 tempest-VolumesServicesTestJSON-968030087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d2beb42-0419-4c44-b65b-7b51320e0690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:10 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-219c587d-0e8c-4904-b898-39f052f23c67 tempest-VolumesServicesTestJSON-968030087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f206181-c54d-410a-93f1-e6d857a25abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:10 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-219c587d-0e8c-4904-b898-39f052f23c67 tempest-VolumesServicesTestJSON-968030087 None] Volume 229016b8-e5d0-474b-bb0f-c9cfa2dc3ab7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-229016b8-e5d0-474b-bb0f-c9cfa2dc3ab7', 'volume_size': 1} Aug 31 15:20:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-219c587d-0e8c-4904-b898-39f052f23c67 tempest-VolumesServicesTestJSON-968030087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:20:11 devstack sudo[96181]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8b8ade2f-7e57-438f-8468-9e9b2bf519b5 tempest-GroupSnapshotsTest-2057849738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a" returned: 0 in 1.064s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8b8ade2f-7e57-438f-8468-9e9b2bf519b5 tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a.95bd5dce-d9d1-4f0c-9033-437af97e82e2 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:11 devstack sudo[96187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a.95bd5dce-d9d1-4f0c-9033-437af97e82e2 Aug 31 15:20:11 devstack sudo[96187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:11 devstack sudo[96152]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2de3d169-a4fb-4c23-af03-16e925566df9 tempest-VolumesActionsTest-1059975936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8192cdb3-1d90-4b41-b1ec-dee126808385 /opt/stack/data/cinder/conversion/8192cdb3-1d90-4b41-b1ec-dee126808385.temp_image.ff3089db-327a-488f-9bf7-f312abfe8f8d5_1xya20.img" returned: 0 in 6.224s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:11 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[681a1688-787d-4dc2-a48d-10bacc16c506]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:20:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2de3d169-a4fb-4c23-af03-16e925566df9 tempest-VolumesActionsTest-1059975936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8192cdb3-1d90-4b41-b1ec-dee126808385 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:11 devstack sudo[96189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8192cdb3-1d90-4b41-b1ec-dee126808385 Aug 31 15:20:11 devstack sudo[96189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:11 devstack sudo[96187]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8b8ade2f-7e57-438f-8468-9e9b2bf519b5 tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a.95bd5dce-d9d1-4f0c-9033-437af97e82e2" returned: 0 in 0.560s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8b8ade2f-7e57-438f-8468-9e9b2bf519b5 tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a.95bd5dce-d9d1-4f0c-9033-437af97e82e2 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:11 devstack sudo[96195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a.95bd5dce-d9d1-4f0c-9033-437af97e82e2 Aug 31 15:20:11 devstack sudo[96195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:12 devstack sudo[96195]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8b8ade2f-7e57-438f-8468-9e9b2bf519b5 tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a.95bd5dce-d9d1-4f0c-9033-437af97e82e2" returned: 0 in 0.303s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:12 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-8b8ade2f-7e57-438f-8468-9e9b2bf519b5 tempest-GroupSnapshotsTest-2057849738 None] Lock "cinder-quobyte-95bd5dce-d9d1-4f0c-9033-437af97e82e2" released by "_delete_snapshot" :: held 3.354s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:20:12 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-8b8ade2f-7e57-438f-8468-9e9b2bf519b5 tempest-GroupSnapshotsTest-2057849738 None] Lock "cinder-quobyte-3da3a93f-757c-4809-94ea-892ca2e8845a" released by "delete_snapshot" :: held 3.405s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:20:12 devstack sudo[96189]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2de3d169-a4fb-4c23-af03-16e925566df9 tempest-VolumesActionsTest-1059975936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8192cdb3-1d90-4b41-b1ec-dee126808385" returned: 0 in 0.590s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:12 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-2de3d169-a4fb-4c23-af03-16e925566df9 tempest-VolumesActionsTest-1059975936 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8192cdb3-1d90-4b41-b1ec-dee126808385, size 1024.00 MB, duration 6.23 sec, destination /opt/stack/data/cinder/conversion/8192cdb3-1d90-4b41-b1ec-dee126808385.temp_image.ff3089db-327a-488f-9bf7-f312abfe8f8d5_1xya20.img {{(pid=86000) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 31 15:20:12 devstack cinder-volume[86000]: INFO cinder.image.image_utils [None req-2de3d169-a4fb-4c23-af03-16e925566df9 tempest-VolumesActionsTest-1059975936 None] Converted 1024.00 MB image at 164.48 MB/s Aug 31 15:20:12 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-2de3d169-a4fb-4c23-af03-16e925566df9 tempest-VolumesActionsTest-1059975936 None] ff3089db-327a-488f-9bf7-f312abfe8f8d was raw, no need to convert to raw {{(pid=86000) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 31 15:20:12 devstack cinder-volume[86000]: WARNING cinder.quota [None req-8b8ade2f-7e57-438f-8468-9e9b2bf519b5 tempest-GroupSnapshotsTest-2057849738 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1980425733 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1980425733, it is now deprecated. Please use the default quota class for default quota. Aug 31 15:20:12 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-8b8ade2f-7e57-438f-8468-9e9b2bf519b5 tempest-GroupSnapshotsTest-2057849738 None] Created reservations ['0128bc64-76b4-45b4-a573-54909eba2437', '87c95267-4538-40e3-9617-fa79cf0eae98', '358c0327-ccec-4193-b07a-c0a4ee356196', '10f200d3-a932-4781-a479-e9893be83723'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:20:12 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-8b8ade2f-7e57-438f-8468-9e9b2bf519b5 tempest-GroupSnapshotsTest-2057849738 None] group_snapshot 9c981477-3118-4369-91fd-7dbcb1fcf704: deleted successfully Aug 31 15:20:13 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6da1f043-fe97-4e20-acce-dd662f782db6 tempest-GroupSnapshotsTest-2057849738 None] Acquiring lock "cinder-quobyte-3da3a93f-757c-4809-94ea-892ca2e8845a" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:20:13 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6da1f043-fe97-4e20-acce-dd662f782db6 tempest-GroupSnapshotsTest-2057849738 None] Lock "cinder-quobyte-3da3a93f-757c-4809-94ea-892ca2e8845a" acquired by "delete_volume" :: waited 0.021s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:20:13 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fec85c-b80e-4bb2-a279-d8bb45e12530]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:20:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6da1f043-fe97-4e20-acce-dd662f782db6 tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:13 devstack sudo[96201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a Aug 31 15:20:13 devstack sudo[96201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:13 devstack sudo[96201]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6da1f043-fe97-4e20-acce-dd662f782db6 tempest-GroupSnapshotsTest-2057849738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a" returned: 0 in 0.490s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6da1f043-fe97-4e20-acce-dd662f782db6 tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:13 devstack sudo[96207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a Aug 31 15:20:13 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:13 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6da1f043-fe97-4e20-acce-dd662f782db6 tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3da3a93f-757c-4809-94ea-892ca2e8845a" returned: 0 in 0.307s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:13 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6da1f043-fe97-4e20-acce-dd662f782db6 tempest-GroupSnapshotsTest-2057849738 None] Lock "cinder-quobyte-3da3a93f-757c-4809-94ea-892ca2e8845a" released by "delete_volume" :: held 0.880s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:20:14 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-6da1f043-fe97-4e20-acce-dd662f782db6 tempest-GroupSnapshotsTest-2057849738 None] Created reservations ['ff143ebf-756d-4fe2-9522-c21553eb9b1b'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:20:14 devstack cinder-volume[86000]: WARNING cinder.db.api [None req-6da1f043-fe97-4e20-acce-dd662f782db6 tempest-GroupSnapshotsTest-2057849738 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1980425733'] Aug 31 15:20:14 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-6da1f043-fe97-4e20-acce-dd662f782db6 tempest-GroupSnapshotsTest-2057849738 None] Created reservations ['c843c566-3273-47fe-9508-3aa3c75eeea4', '1362f2c6-9dfd-4d2d-a6ea-1f8e66f430af', 'e060b9d9-cb78-4b0a-8181-4783352a7bf1', '3d311a4c-0845-459b-9e51-726842f65a84'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:20:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6da1f043-fe97-4e20-acce-dd662f782db6 tempest-GroupSnapshotsTest-2057849738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:20:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6da1f043-fe97-4e20-acce-dd662f782db6 tempest-GroupSnapshotsTest-2057849738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:20:14 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6da1f043-fe97-4e20-acce-dd662f782db6 tempest-GroupSnapshotsTest-2057849738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:20:14 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6da1f043-fe97-4e20-acce-dd662f782db6 tempest-GroupSnapshotsTest-2057849738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:20:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6da1f043-fe97-4e20-acce-dd662f782db6 tempest-GroupSnapshotsTest-2057849738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:20:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6da1f043-fe97-4e20-acce-dd662f782db6 tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:14 devstack sudo[96210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:20:14 devstack sudo[96210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:14 devstack sudo[96210]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6da1f043-fe97-4e20-acce-dd662f782db6 tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.401s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:14 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-6da1f043-fe97-4e20-acce-dd662f782db6 tempest-GroupSnapshotsTest-2057849738 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:20:14 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-6da1f043-fe97-4e20-acce-dd662f782db6 tempest-GroupSnapshotsTest-2057849738 None] Delete group completed successfully. Aug 31 15:20:14 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-36f70e56-8abb-432c-9ac2-98c8c3b100f2 tempest-GroupSnapshotsTest-2057849738 None] Group tempest-GroupSnapshotsTest-Group-1785191849: creating Aug 31 15:20:15 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-36f70e56-8abb-432c-9ac2-98c8c3b100f2 tempest-GroupSnapshotsTest-2057849738 None] Group tempest-GroupSnapshotsTest-Group-1785191849: created successfully Aug 31 15:20:15 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-36f70e56-8abb-432c-9ac2-98c8c3b100f2 tempest-GroupSnapshotsTest-2057849738 None] Create group completed successfully. Aug 31 15:20:16 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:SELECT=100,cinder:INSERT=25,cinder:UPDATE=118,cinder:DELETE=5 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:20:16 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:SELECT=110,cinder:UPDATE=113,cinder:INSERT=28,cinder:DELETE=9 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:20:16 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-47d82f09-e8ef-49df-9cf9-b66de5827a00 tempest-GroupSnapshotsTest-2057849738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:20:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-47d82f09-e8ef-49df-9cf9-b66de5827a00 tempest-GroupSnapshotsTest-2057849738 None] Flow 'volume_create_manager' (415c2857-e7ce-4b9c-b5a9-15382362307a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:20:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-47d82f09-e8ef-49df-9cf9-b66de5827a00 tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac85af58-dd02-4d4b-bd16-f02b4f6c5996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-47d82f09-e8ef-49df-9cf9-b66de5827a00 tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac85af58-dd02-4d4b-bd16-f02b4f6c5996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-220485981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3cf96b29-d403-4280-8715-52b43beb5c99,host='devstack@QuobyteHD#QuobyteHD',id=97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1729177f36914ba782887f84390b3cf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:20:17Z,use_quota=True,user_id='51779a9573da46cbaf455bdf61cbcd84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42901463-feac-4bdc-9556-0edecf2170a9),volume_type_id=42901463-feac-4bdc-9556-0edecf2170a9)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-47d82f09-e8ef-49df-9cf9-b66de5827a00 tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a1971b7-7c7e-4af0-ad8c-0dc1eeac905a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-47d82f09-e8ef-49df-9cf9-b66de5827a00 tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a1971b7-7c7e-4af0-ad8c-0dc1eeac905a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-47d82f09-e8ef-49df-9cf9-b66de5827a00 tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10987b3d-f1e4-4129-854f-d2235555c965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-47d82f09-e8ef-49df-9cf9-b66de5827a00 tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10987b3d-f1e4-4129-854f-d2235555c965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf', 'volume_name': 'volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-47d82f09-e8ef-49df-9cf9-b66de5827a00 tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (891ab145-d6e6-480c-a677-3ef541f17e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-47d82f09-e8ef-49df-9cf9-b66de5827a00 tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (891ab145-d6e6-480c-a677-3ef541f17e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-47d82f09-e8ef-49df-9cf9-b66de5827a00 tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5273da94-6d9f-45d8-a2eb-797c7c4a304f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:16 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-47d82f09-e8ef-49df-9cf9-b66de5827a00 tempest-GroupSnapshotsTest-2057849738 None] Volume 97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf', 'volume_size': 1} Aug 31 15:20:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-47d82f09-e8ef-49df-9cf9-b66de5827a00 tempest-GroupSnapshotsTest-2057849738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:20:17 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-e665d40c-bbe8-4755-9c75-2a3ff702ba5b tempest-SnapshotMetadataTestJSON-1858294261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:20:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e665d40c-bbe8-4755-9c75-2a3ff702ba5b tempest-SnapshotMetadataTestJSON-1858294261 None] Flow 'volume_create_manager' (2aaad282-1801-4371-a635-906542855225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:20:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e665d40c-bbe8-4755-9c75-2a3ff702ba5b tempest-SnapshotMetadataTestJSON-1858294261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f10a6e79-d764-4c62-816a-085bd82fd85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e665d40c-bbe8-4755-9c75-2a3ff702ba5b tempest-SnapshotMetadataTestJSON-1858294261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f10a6e79-d764-4c62-816a-085bd82fd85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1589736992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad8517a1-204e-4301-944c-2218c15a8971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8dec9a49cef43b8ba7cb0ea4d7344e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:20:18Z,use_quota=True,user_id='a71d91f7440441d282242722743a2251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e665d40c-bbe8-4755-9c75-2a3ff702ba5b tempest-SnapshotMetadataTestJSON-1858294261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cab7c384-5ac9-46cc-b98b-3c08b362085a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e665d40c-bbe8-4755-9c75-2a3ff702ba5b tempest-SnapshotMetadataTestJSON-1858294261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cab7c384-5ac9-46cc-b98b-3c08b362085a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e665d40c-bbe8-4755-9c75-2a3ff702ba5b tempest-SnapshotMetadataTestJSON-1858294261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89a270fd-3b20-480b-b168-b3fe927b9417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e665d40c-bbe8-4755-9c75-2a3ff702ba5b tempest-SnapshotMetadataTestJSON-1858294261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89a270fd-3b20-480b-b168-b3fe927b9417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad8517a1-204e-4301-944c-2218c15a8971', 'volume_name': 'volume-ad8517a1-204e-4301-944c-2218c15a8971', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e665d40c-bbe8-4755-9c75-2a3ff702ba5b tempest-SnapshotMetadataTestJSON-1858294261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4704b69-c26d-401d-b28a-253a2f9aa97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e665d40c-bbe8-4755-9c75-2a3ff702ba5b tempest-SnapshotMetadataTestJSON-1858294261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4704b69-c26d-401d-b28a-253a2f9aa97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e665d40c-bbe8-4755-9c75-2a3ff702ba5b tempest-SnapshotMetadataTestJSON-1858294261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13c62ae0-8121-4906-97ad-9c32ae3816fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:17 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-e665d40c-bbe8-4755-9c75-2a3ff702ba5b tempest-SnapshotMetadataTestJSON-1858294261 None] Volume ad8517a1-204e-4301-944c-2218c15a8971: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad8517a1-204e-4301-944c-2218c15a8971', 'volume_size': 1} Aug 31 15:20:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e665d40c-bbe8-4755-9c75-2a3ff702ba5b tempest-SnapshotMetadataTestJSON-1858294261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:20:27 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:SELECT=2 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:20:27 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:20:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-2de3d169-a4fb-4c23-af03-16e925566df9 tempest-VolumesActionsTest-1059975936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.894s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:20:32 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-2de3d169-a4fb-4c23-af03-16e925566df9 tempest-VolumesActionsTest-1059975936 None] Uploaded volume to glance image-id: ff3089db-327a-488f-9bf7-f312abfe8f8d. {{(pid=86000) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 31 15:20:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-219c587d-0e8c-4904-b898-39f052f23c67 tempest-VolumesServicesTestJSON-968030087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.389s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:20:32 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-219c587d-0e8c-4904-b898-39f052f23c67 tempest-VolumesServicesTestJSON-968030087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1446670962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=229016b8-e5d0-474b-bb0f-c9cfa2dc3ab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b12c5bc582784636b32062f6c314e50e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:20:11Z,use_quota=True,user_id='a1e8fa03717d4b2bba54ac067b2433b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:20:32 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-219c587d-0e8c-4904-b898-39f052f23c67 tempest-VolumesServicesTestJSON-968030087 None] Creating volume 229016b8-e5d0-474b-bb0f-c9cfa2dc3ab7 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:20:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-219c587d-0e8c-4904-b898-39f052f23c67 tempest-VolumesServicesTestJSON-968030087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:20:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-219c587d-0e8c-4904-b898-39f052f23c67 tempest-VolumesServicesTestJSON-968030087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:20:32 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-219c587d-0e8c-4904-b898-39f052f23c67 tempest-VolumesServicesTestJSON-968030087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:20:32 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-219c587d-0e8c-4904-b898-39f052f23c67 tempest-VolumesServicesTestJSON-968030087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:20:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-219c587d-0e8c-4904-b898-39f052f23c67 tempest-VolumesServicesTestJSON-968030087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:20:32 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-219c587d-0e8c-4904-b898-39f052f23c67 tempest-VolumesServicesTestJSON-968030087 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:20:32 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-219c587d-0e8c-4904-b898-39f052f23c67 tempest-VolumesServicesTestJSON-968030087 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:20:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-219c587d-0e8c-4904-b898-39f052f23c67 tempest-VolumesServicesTestJSON-968030087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-229016b8-e5d0-474b-bb0f-c9cfa2dc3ab7 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:32 devstack sudo[96258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-229016b8-e5d0-474b-bb0f-c9cfa2dc3ab7 1073741824 Aug 31 15:20:32 devstack sudo[96258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:32 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-2de3d169-a4fb-4c23-af03-16e925566df9 tempest-VolumesActionsTest-1059975936 None] Copy volume to image completed successfully. Aug 31 15:20:32 devstack sudo[96258]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-219c587d-0e8c-4904-b898-39f052f23c67 tempest-VolumesServicesTestJSON-968030087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-229016b8-e5d0-474b-bb0f-c9cfa2dc3ab7 1073741824" returned: 0 in 0.404s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-219c587d-0e8c-4904-b898-39f052f23c67 tempest-VolumesServicesTestJSON-968030087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-229016b8-e5d0-474b-bb0f-c9cfa2dc3ab7 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:32 devstack sudo[96263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-229016b8-e5d0-474b-bb0f-c9cfa2dc3ab7 Aug 31 15:20:32 devstack sudo[96263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:33 devstack sudo[96263]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-219c587d-0e8c-4904-b898-39f052f23c67 tempest-VolumesServicesTestJSON-968030087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-229016b8-e5d0-474b-bb0f-c9cfa2dc3ab7" returned: 0 in 0.252s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:33 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-219c587d-0e8c-4904-b898-39f052f23c67 tempest-VolumesServicesTestJSON-968030087 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:20:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-219c587d-0e8c-4904-b898-39f052f23c67 tempest-VolumesServicesTestJSON-968030087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:20:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-47d82f09-e8ef-49df-9cf9-b66de5827a00 tempest-GroupSnapshotsTest-2057849738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.026s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:20:33 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-47d82f09-e8ef-49df-9cf9-b66de5827a00 tempest-GroupSnapshotsTest-2057849738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3cf96b29-d403-4280-8715-52b43beb5c99,created_at=2026-08-31T13:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-220485981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3cf96b29-d403-4280-8715-52b43beb5c99,host='devstack@QuobyteHD#QuobyteHD',id=97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1729177f36914ba782887f84390b3cf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:20:17Z,use_quota=True,user_id='51779a9573da46cbaf455bdf61cbcd84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42901463-feac-4bdc-9556-0edecf2170a9),volume_type_id=42901463-feac-4bdc-9556-0edecf2170a9)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:20:33 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-47d82f09-e8ef-49df-9cf9-b66de5827a00 tempest-GroupSnapshotsTest-2057849738 None] Creating volume 97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:20:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-47d82f09-e8ef-49df-9cf9-b66de5827a00 tempest-GroupSnapshotsTest-2057849738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:20:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-47d82f09-e8ef-49df-9cf9-b66de5827a00 tempest-GroupSnapshotsTest-2057849738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:20:33 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-47d82f09-e8ef-49df-9cf9-b66de5827a00 tempest-GroupSnapshotsTest-2057849738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:20:33 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-47d82f09-e8ef-49df-9cf9-b66de5827a00 tempest-GroupSnapshotsTest-2057849738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:20:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-47d82f09-e8ef-49df-9cf9-b66de5827a00 tempest-GroupSnapshotsTest-2057849738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:20:33 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-47d82f09-e8ef-49df-9cf9-b66de5827a00 tempest-GroupSnapshotsTest-2057849738 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:20:33 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-47d82f09-e8ef-49df-9cf9-b66de5827a00 tempest-GroupSnapshotsTest-2057849738 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:20:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-47d82f09-e8ef-49df-9cf9-b66de5827a00 tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-219c587d-0e8c-4904-b898-39f052f23c67 tempest-VolumesServicesTestJSON-968030087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f206181-c54d-410a-93f1-e6d857a25abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-229016b8-e5d0-474b-bb0f-c9cfa2dc3ab7', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:33 devstack sudo[96266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf 1073741824 Aug 31 15:20:33 devstack sudo[96266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-219c587d-0e8c-4904-b898-39f052f23c67 tempest-VolumesServicesTestJSON-968030087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88a6e58a-8e67-440d-96c3-56987f234646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:33 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-219c587d-0e8c-4904-b898-39f052f23c67 tempest-VolumesServicesTestJSON-968030087 None] Volume volume-229016b8-e5d0-474b-bb0f-c9cfa2dc3ab7 (229016b8-e5d0-474b-bb0f-c9cfa2dc3ab7): created successfully Aug 31 15:20:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-219c587d-0e8c-4904-b898-39f052f23c67 tempest-VolumesServicesTestJSON-968030087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88a6e58a-8e67-440d-96c3-56987f234646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-219c587d-0e8c-4904-b898-39f052f23c67 tempest-VolumesServicesTestJSON-968030087 None] Flow 'volume_create_manager' (9b68574a-472c-40ce-a660-d3b09b608216) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:20:33 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-219c587d-0e8c-4904-b898-39f052f23c67 tempest-VolumesServicesTestJSON-968030087 None] Created volume successfully. Aug 31 15:20:33 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7ff7b563-8c47-435f-85c0-2c20a1a49be7 tempest-VolumesServicesTestJSON-968030087 None] Acquiring lock "cinder-229016b8-e5d0-474b-bb0f-c9cfa2dc3ab7-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:20:33 devstack sudo[96266]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-47d82f09-e8ef-49df-9cf9-b66de5827a00 tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf 1073741824" returned: 0 in 0.502s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:33 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7ff7b563-8c47-435f-85c0-2c20a1a49be7 tempest-VolumesServicesTestJSON-968030087 None] Lock "cinder-229016b8-e5d0-474b-bb0f-c9cfa2dc3ab7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:20:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-47d82f09-e8ef-49df-9cf9-b66de5827a00 tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:33 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7ff7b563-8c47-435f-85c0-2c20a1a49be7 tempest-VolumesServicesTestJSON-968030087 None] Acquiring lock "cinder-quobyte-229016b8-e5d0-474b-bb0f-c9cfa2dc3ab7" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:20:33 devstack sudo[96272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf Aug 31 15:20:33 devstack sudo[96272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:33 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7ff7b563-8c47-435f-85c0-2c20a1a49be7 tempest-VolumesServicesTestJSON-968030087 None] Lock "cinder-quobyte-229016b8-e5d0-474b-bb0f-c9cfa2dc3ab7" acquired by "delete_volume" :: waited 0.022s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:20:33 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a68cb6-8c83-4d8f-8a64-8da3a95eb61c]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:20:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7ff7b563-8c47-435f-85c0-2c20a1a49be7 tempest-VolumesServicesTestJSON-968030087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-229016b8-e5d0-474b-bb0f-c9cfa2dc3ab7 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:33 devstack sudo[96274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-229016b8-e5d0-474b-bb0f-c9cfa2dc3ab7 Aug 31 15:20:33 devstack sudo[96274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:33 devstack sudo[96272]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-47d82f09-e8ef-49df-9cf9-b66de5827a00 tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf" returned: 0 in 0.272s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:33 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-47d82f09-e8ef-49df-9cf9-b66de5827a00 tempest-GroupSnapshotsTest-2057849738 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:20:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-47d82f09-e8ef-49df-9cf9-b66de5827a00 tempest-GroupSnapshotsTest-2057849738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:20:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e665d40c-bbe8-4755-9c75-2a3ff702ba5b tempest-SnapshotMetadataTestJSON-1858294261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:20:33 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-e665d40c-bbe8-4755-9c75-2a3ff702ba5b tempest-SnapshotMetadataTestJSON-1858294261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1589736992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad8517a1-204e-4301-944c-2218c15a8971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8dec9a49cef43b8ba7cb0ea4d7344e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:20:18Z,use_quota=True,user_id='a71d91f7440441d282242722743a2251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:20:33 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-e665d40c-bbe8-4755-9c75-2a3ff702ba5b tempest-SnapshotMetadataTestJSON-1858294261 None] Creating volume ad8517a1-204e-4301-944c-2218c15a8971 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:20:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e665d40c-bbe8-4755-9c75-2a3ff702ba5b tempest-SnapshotMetadataTestJSON-1858294261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:20:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e665d40c-bbe8-4755-9c75-2a3ff702ba5b tempest-SnapshotMetadataTestJSON-1858294261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:20:33 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-e665d40c-bbe8-4755-9c75-2a3ff702ba5b tempest-SnapshotMetadataTestJSON-1858294261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:20:33 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-e665d40c-bbe8-4755-9c75-2a3ff702ba5b tempest-SnapshotMetadataTestJSON-1858294261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:20:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e665d40c-bbe8-4755-9c75-2a3ff702ba5b tempest-SnapshotMetadataTestJSON-1858294261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:20:33 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-e665d40c-bbe8-4755-9c75-2a3ff702ba5b tempest-SnapshotMetadataTestJSON-1858294261 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:20:33 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-e665d40c-bbe8-4755-9c75-2a3ff702ba5b tempest-SnapshotMetadataTestJSON-1858294261 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:20:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e665d40c-bbe8-4755-9c75-2a3ff702ba5b tempest-SnapshotMetadataTestJSON-1858294261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-47d82f09-e8ef-49df-9cf9-b66de5827a00 tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5273da94-6d9f-45d8-a2eb-797c7c4a304f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-47d82f09-e8ef-49df-9cf9-b66de5827a00 tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3000f803-1e13-4dc2-8935-a9ba06c4364b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:33 devstack sudo[96277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971 1073741824 Aug 31 15:20:33 devstack sudo[96277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:33 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-47d82f09-e8ef-49df-9cf9-b66de5827a00 tempest-GroupSnapshotsTest-2057849738 None] Volume volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf (97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf): created successfully Aug 31 15:20:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-47d82f09-e8ef-49df-9cf9-b66de5827a00 tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3000f803-1e13-4dc2-8935-a9ba06c4364b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-47d82f09-e8ef-49df-9cf9-b66de5827a00 tempest-GroupSnapshotsTest-2057849738 None] Flow 'volume_create_manager' (415c2857-e7ce-4b9c-b5a9-15382362307a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:20:33 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-47d82f09-e8ef-49df-9cf9-b66de5827a00 tempest-GroupSnapshotsTest-2057849738 None] Created volume successfully. Aug 31 15:20:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-df90d065-035e-4d35-9165-b57522f16e4d tempest-VolumesActionsTest-1059975936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:20:34 devstack sudo[96274]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7ff7b563-8c47-435f-85c0-2c20a1a49be7 tempest-VolumesServicesTestJSON-968030087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-229016b8-e5d0-474b-bb0f-c9cfa2dc3ab7" returned: 0 in 0.422s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7ff7b563-8c47-435f-85c0-2c20a1a49be7 tempest-VolumesServicesTestJSON-968030087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-229016b8-e5d0-474b-bb0f-c9cfa2dc3ab7 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:34 devstack sudo[96282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-229016b8-e5d0-474b-bb0f-c9cfa2dc3ab7 Aug 31 15:20:34 devstack sudo[96282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:34 devstack sudo[96282]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7ff7b563-8c47-435f-85c0-2c20a1a49be7 tempest-VolumesServicesTestJSON-968030087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-229016b8-e5d0-474b-bb0f-c9cfa2dc3ab7" returned: 0 in 0.255s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:34 devstack sudo[96277]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e665d40c-bbe8-4755-9c75-2a3ff702ba5b tempest-SnapshotMetadataTestJSON-1858294261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971 1073741824" returned: 0 in 0.479s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:34 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7ff7b563-8c47-435f-85c0-2c20a1a49be7 tempest-VolumesServicesTestJSON-968030087 None] Lock "cinder-quobyte-229016b8-e5d0-474b-bb0f-c9cfa2dc3ab7" released by "delete_volume" :: held 0.735s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:20:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e665d40c-bbe8-4755-9c75-2a3ff702ba5b tempest-SnapshotMetadataTestJSON-1858294261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:34 devstack sudo[96288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971 Aug 31 15:20:34 devstack sudo[96288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:34 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-7ff7b563-8c47-435f-85c0-2c20a1a49be7 tempest-VolumesServicesTestJSON-968030087 None] Created reservations ['1acc7ae7-5d4f-44d0-a0f0-f9a6deacda5e', 'b3b2a277-7acd-4d34-a6c9-1b305f59bca5', '81e960a4-b781-44b7-82aa-23982bfe28f3', 'b0a7504a-5d05-43f3-ac46-1170b266cca9'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:20:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7ff7b563-8c47-435f-85c0-2c20a1a49be7 tempest-VolumesServicesTestJSON-968030087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:20:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7ff7b563-8c47-435f-85c0-2c20a1a49be7 tempest-VolumesServicesTestJSON-968030087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:20:34 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-7ff7b563-8c47-435f-85c0-2c20a1a49be7 tempest-VolumesServicesTestJSON-968030087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:20:34 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-7ff7b563-8c47-435f-85c0-2c20a1a49be7 tempest-VolumesServicesTestJSON-968030087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:20:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7ff7b563-8c47-435f-85c0-2c20a1a49be7 tempest-VolumesServicesTestJSON-968030087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:20:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7ff7b563-8c47-435f-85c0-2c20a1a49be7 tempest-VolumesServicesTestJSON-968030087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:34 devstack sudo[96290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:20:34 devstack sudo[96290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:34 devstack sudo[96288]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e665d40c-bbe8-4755-9c75-2a3ff702ba5b tempest-SnapshotMetadataTestJSON-1858294261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971" returned: 0 in 0.296s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:34 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-e665d40c-bbe8-4755-9c75-2a3ff702ba5b tempest-SnapshotMetadataTestJSON-1858294261 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:20:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e665d40c-bbe8-4755-9c75-2a3ff702ba5b tempest-SnapshotMetadataTestJSON-1858294261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:20:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-df90d065-035e-4d35-9165-b57522f16e4d tempest-VolumesActionsTest-1059975936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.674s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:20:34 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e665d40c-bbe8-4755-9c75-2a3ff702ba5b tempest-SnapshotMetadataTestJSON-1858294261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13c62ae0-8121-4906-97ad-9c32ae3816fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad8517a1-204e-4301-944c-2218c15a8971', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:34 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e665d40c-bbe8-4755-9c75-2a3ff702ba5b tempest-SnapshotMetadataTestJSON-1858294261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23d23062-7508-4839-a376-e94676f3eac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:34 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9ae576-15b1-47ca-bb6a-25db76115071]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:20:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-df90d065-035e-4d35-9165-b57522f16e4d tempest-VolumesActionsTest-1059975936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8192cdb3-1d90-4b41-b1ec-dee126808385 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:34 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-e665d40c-bbe8-4755-9c75-2a3ff702ba5b tempest-SnapshotMetadataTestJSON-1858294261 None] Volume volume-ad8517a1-204e-4301-944c-2218c15a8971 (ad8517a1-204e-4301-944c-2218c15a8971): created successfully Aug 31 15:20:34 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e665d40c-bbe8-4755-9c75-2a3ff702ba5b tempest-SnapshotMetadataTestJSON-1858294261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23d23062-7508-4839-a376-e94676f3eac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:34 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e665d40c-bbe8-4755-9c75-2a3ff702ba5b tempest-SnapshotMetadataTestJSON-1858294261 None] Flow 'volume_create_manager' (2aaad282-1801-4371-a635-906542855225) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:20:34 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-e665d40c-bbe8-4755-9c75-2a3ff702ba5b tempest-SnapshotMetadataTestJSON-1858294261 None] Created volume successfully. Aug 31 15:20:34 devstack sudo[96290]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7ff7b563-8c47-435f-85c0-2c20a1a49be7 tempest-VolumesServicesTestJSON-968030087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.338s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:34 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-7ff7b563-8c47-435f-85c0-2c20a1a49be7 tempest-VolumesServicesTestJSON-968030087 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:20:34 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-7ff7b563-8c47-435f-85c0-2c20a1a49be7 tempest-VolumesServicesTestJSON-968030087 None] Deleted volume successfully. Aug 31 15:20:34 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7ff7b563-8c47-435f-85c0-2c20a1a49be7 tempest-VolumesServicesTestJSON-968030087 None] Lock "cinder-229016b8-e5d0-474b-bb0f-c9cfa2dc3ab7-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:20:34 devstack sudo[96293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8192cdb3-1d90-4b41-b1ec-dee126808385 Aug 31 15:20:34 devstack sudo[96293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:35 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c0c87a0-61d5-4bd3-a57e-3ea5ce652266 tempest-GroupSnapshotsTest-2057849738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:20:35 devstack sudo[96293]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9c0c87a0-61d5-4bd3-a57e-3ea5ce652266 tempest-GroupSnapshotsTest-2057849738 None] Flow 'volume_create_manager' (4b2a2408-5e5f-4531-9355-d17849ad61ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:20:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9c0c87a0-61d5-4bd3-a57e-3ea5ce652266 tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46b5fb36-4737-427f-81bd-9fe695b454d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-df90d065-035e-4d35-9165-b57522f16e4d tempest-VolumesActionsTest-1059975936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8192cdb3-1d90-4b41-b1ec-dee126808385" returned: 0 in 0.492s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9c0c87a0-61d5-4bd3-a57e-3ea5ce652266 tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46b5fb36-4737-427f-81bd-9fe695b454d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:20:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-367094071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3cf96b29-d403-4280-8715-52b43beb5c99,host='devstack@QuobyteHD#QuobyteHD',id=0a1ca112-aae4-4afc-a381-1a32c2f44e3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1729177f36914ba782887f84390b3cf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:20:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:20:35Z,use_quota=True,user_id='51779a9573da46cbaf455bdf61cbcd84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42901463-feac-4bdc-9556-0edecf2170a9),volume_type_id=42901463-feac-4bdc-9556-0edecf2170a9)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9c0c87a0-61d5-4bd3-a57e-3ea5ce652266 tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd602616-8710-4755-929e-82ac5bc6b1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9c0c87a0-61d5-4bd3-a57e-3ea5ce652266 tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd602616-8710-4755-929e-82ac5bc6b1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9c0c87a0-61d5-4bd3-a57e-3ea5ce652266 tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61e58bd0-86b3-4884-b5cb-127d69ccdd57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9c0c87a0-61d5-4bd3-a57e-3ea5ce652266 tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61e58bd0-86b3-4884-b5cb-127d69ccdd57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a1ca112-aae4-4afc-a381-1a32c2f44e3d', 'volume_name': 'volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9c0c87a0-61d5-4bd3-a57e-3ea5ce652266 tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d16f027-be81-4db9-83ef-fd69bfc81f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9c0c87a0-61d5-4bd3-a57e-3ea5ce652266 tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d16f027-be81-4db9-83ef-fd69bfc81f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9c0c87a0-61d5-4bd3-a57e-3ea5ce652266 tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7bd154c-1469-422b-9cc1-33c341839e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:35 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-9c0c87a0-61d5-4bd3-a57e-3ea5ce652266 tempest-GroupSnapshotsTest-2057849738 None] Volume 0a1ca112-aae4-4afc-a381-1a32c2f44e3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d', 'volume_size': 1} Aug 31 15:20:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9c0c87a0-61d5-4bd3-a57e-3ea5ce652266 tempest-GroupSnapshotsTest-2057849738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:20:35 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bbd678-b21f-4328-a6d9-7d5d32fd4358]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:20:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-df90d065-035e-4d35-9165-b57522f16e4d tempest-VolumesActionsTest-1059975936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8192cdb3-1d90-4b41-b1ec-dee126808385 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:35 devstack sudo[96299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8192cdb3-1d90-4b41-b1ec-dee126808385 Aug 31 15:20:35 devstack sudo[96299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:35 devstack sudo[96299]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-df90d065-035e-4d35-9165-b57522f16e4d tempest-VolumesActionsTest-1059975936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8192cdb3-1d90-4b41-b1ec-dee126808385" returned: 0 in 0.382s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-df90d065-035e-4d35-9165-b57522f16e4d tempest-VolumesActionsTest-1059975936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8192cdb3-1d90-4b41-b1ec-dee126808385 /opt/stack/data/cinder/conversion/8192cdb3-1d90-4b41-b1ec-dee126808385.temp_image.8fb34c04-51cb-4422-83e0-625edeced339vqlvpj53.img {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:35 devstack sudo[96304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8192cdb3-1d90-4b41-b1ec-dee126808385 /opt/stack/data/cinder/conversion/8192cdb3-1d90-4b41-b1ec-dee126808385.temp_image.8fb34c04-51cb-4422-83e0-625edeced339vqlvpj53.img Aug 31 15:20:35 devstack sudo[96304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4258855d-c2a0-4be2-9bf7-3de4bd8b0498 tempest-SnapshotMetadataTestJSON-1858294261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:20:40 devstack sudo[96304]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-df90d065-035e-4d35-9165-b57522f16e4d tempest-VolumesActionsTest-1059975936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8192cdb3-1d90-4b41-b1ec-dee126808385 /opt/stack/data/cinder/conversion/8192cdb3-1d90-4b41-b1ec-dee126808385.temp_image.8fb34c04-51cb-4422-83e0-625edeced339vqlvpj53.img" returned: 0 in 5.084s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:40 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ca10ad-032c-404b-a50b-d155e95aa2a8]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:20:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-df90d065-035e-4d35-9165-b57522f16e4d tempest-VolumesActionsTest-1059975936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8192cdb3-1d90-4b41-b1ec-dee126808385 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:40 devstack sudo[96325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8192cdb3-1d90-4b41-b1ec-dee126808385 Aug 31 15:20:40 devstack sudo[96325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:41 devstack sudo[96325]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-df90d065-035e-4d35-9165-b57522f16e4d tempest-VolumesActionsTest-1059975936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8192cdb3-1d90-4b41-b1ec-dee126808385" returned: 0 in 0.540s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:41 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-df90d065-035e-4d35-9165-b57522f16e4d tempest-VolumesActionsTest-1059975936 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8192cdb3-1d90-4b41-b1ec-dee126808385, size 1024.00 MB, duration 5.09 sec, destination /opt/stack/data/cinder/conversion/8192cdb3-1d90-4b41-b1ec-dee126808385.temp_image.8fb34c04-51cb-4422-83e0-625edeced339vqlvpj53.img {{(pid=86000) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 31 15:20:41 devstack cinder-volume[86000]: INFO cinder.image.image_utils [None req-df90d065-035e-4d35-9165-b57522f16e4d tempest-VolumesActionsTest-1059975936 None] Converted 1024.00 MB image at 201.37 MB/s Aug 31 15:20:41 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-df90d065-035e-4d35-9165-b57522f16e4d tempest-VolumesActionsTest-1059975936 None] 8fb34c04-51cb-4422-83e0-625edeced339 was raw, converting to qcow2 {{(pid=86000) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Aug 31 15:20:41 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df2ea4c-1f40-4c01-9f11-4fe225c18b80]: (4, 'raw') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:20:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-df90d065-035e-4d35-9165-b57522f16e4d tempest-VolumesActionsTest-1059975936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8192cdb3-1d90-4b41-b1ec-dee126808385.temp_image.8fb34c04-51cb-4422-83e0-625edeced339vqlvpj53.img {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:41 devstack sudo[96330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8192cdb3-1d90-4b41-b1ec-dee126808385.temp_image.8fb34c04-51cb-4422-83e0-625edeced339vqlvpj53.img Aug 31 15:20:41 devstack sudo[96330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:41 devstack sudo[96330]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-df90d065-035e-4d35-9165-b57522f16e4d tempest-VolumesActionsTest-1059975936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8192cdb3-1d90-4b41-b1ec-dee126808385.temp_image.8fb34c04-51cb-4422-83e0-625edeced339vqlvpj53.img" returned: 0 in 0.348s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-df90d065-035e-4d35-9165-b57522f16e4d tempest-VolumesActionsTest-1059975936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8192cdb3-1d90-4b41-b1ec-dee126808385.temp_image.8fb34c04-51cb-4422-83e0-625edeced339vqlvpj53.img {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:41 devstack sudo[96334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8192cdb3-1d90-4b41-b1ec-dee126808385.temp_image.8fb34c04-51cb-4422-83e0-625edeced339vqlvpj53.img Aug 31 15:20:41 devstack sudo[96334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:42 devstack sudo[96334]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-df90d065-035e-4d35-9165-b57522f16e4d tempest-VolumesActionsTest-1059975936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8192cdb3-1d90-4b41-b1ec-dee126808385.temp_image.8fb34c04-51cb-4422-83e0-625edeced339vqlvpj53.img" returned: 1 in 0.327s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-df90d065-035e-4d35-9165-b57522f16e4d tempest-VolumesActionsTest-1059975936 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8192cdb3-1d90-4b41-b1ec-dee126808385.temp_image.8fb34c04-51cb-4422-83e0-625edeced339vqlvpj53.img' failed. Not Retrying. {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 31 15:20:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-df90d065-035e-4d35-9165-b57522f16e4d tempest-VolumesActionsTest-1059975936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8192cdb3-1d90-4b41-b1ec-dee126808385.temp_image.8fb34c04-51cb-4422-83e0-625edeced339vqlvpj53.img /opt/stack/data/cinder/conversion/vol_upload_r85y1fol {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:42 devstack sudo[96339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8192cdb3-1d90-4b41-b1ec-dee126808385.temp_image.8fb34c04-51cb-4422-83e0-625edeced339vqlvpj53.img /opt/stack/data/cinder/conversion/vol_upload_r85y1fol Aug 31 15:20:42 devstack sudo[96339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:42 devstack sudo[96339]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-df90d065-035e-4d35-9165-b57522f16e4d tempest-VolumesActionsTest-1059975936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8192cdb3-1d90-4b41-b1ec-dee126808385.temp_image.8fb34c04-51cb-4422-83e0-625edeced339vqlvpj53.img /opt/stack/data/cinder/conversion/vol_upload_r85y1fol" returned: 0 in 0.272s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:42 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-df90d065-035e-4d35-9165-b57522f16e4d tempest-VolumesActionsTest-1059975936 None] Image conversion details: src /opt/stack/data/cinder/conversion/8192cdb3-1d90-4b41-b1ec-dee126808385.temp_image.8fb34c04-51cb-4422-83e0-625edeced339vqlvpj53.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_r85y1fol {{(pid=86000) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 31 15:20:42 devstack cinder-volume[86000]: INFO cinder.image.image_utils [None req-df90d065-035e-4d35-9165-b57522f16e4d tempest-VolumesActionsTest-1059975936 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 31 15:20:42 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e206fb-8cf5-424c-9345-8bb0f5751dc6]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:20:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-df90d065-035e-4d35-9165-b57522f16e4d tempest-VolumesActionsTest-1059975936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_r85y1fol {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:42 devstack sudo[96344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_r85y1fol Aug 31 15:20:42 devstack sudo[96344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:42 devstack sudo[96344]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-df90d065-035e-4d35-9165-b57522f16e4d tempest-VolumesActionsTest-1059975936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_r85y1fol" returned: 0 in 0.339s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-df90d065-035e-4d35-9165-b57522f16e4d tempest-VolumesActionsTest-1059975936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.482s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:20:44 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-df90d065-035e-4d35-9165-b57522f16e4d tempest-VolumesActionsTest-1059975936 None] Uploaded volume to glance image-id: 8fb34c04-51cb-4422-83e0-625edeced339. {{(pid=86000) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 31 15:20:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9c0c87a0-61d5-4bd3-a57e-3ea5ce652266 tempest-GroupSnapshotsTest-2057849738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.887s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:20:44 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-9c0c87a0-61d5-4bd3-a57e-3ea5ce652266 tempest-GroupSnapshotsTest-2057849738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3cf96b29-d403-4280-8715-52b43beb5c99,created_at=2026-08-31T13:20:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-367094071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3cf96b29-d403-4280-8715-52b43beb5c99,host='devstack@QuobyteHD#QuobyteHD',id=0a1ca112-aae4-4afc-a381-1a32c2f44e3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1729177f36914ba782887f84390b3cf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:20:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:20:35Z,use_quota=True,user_id='51779a9573da46cbaf455bdf61cbcd84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42901463-feac-4bdc-9556-0edecf2170a9),volume_type_id=42901463-feac-4bdc-9556-0edecf2170a9)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:20:44 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-9c0c87a0-61d5-4bd3-a57e-3ea5ce652266 tempest-GroupSnapshotsTest-2057849738 None] Creating volume 0a1ca112-aae4-4afc-a381-1a32c2f44e3d {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:20:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9c0c87a0-61d5-4bd3-a57e-3ea5ce652266 tempest-GroupSnapshotsTest-2057849738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:20:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9c0c87a0-61d5-4bd3-a57e-3ea5ce652266 tempest-GroupSnapshotsTest-2057849738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:20:44 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-9c0c87a0-61d5-4bd3-a57e-3ea5ce652266 tempest-GroupSnapshotsTest-2057849738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:20:44 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-9c0c87a0-61d5-4bd3-a57e-3ea5ce652266 tempest-GroupSnapshotsTest-2057849738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:20:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9c0c87a0-61d5-4bd3-a57e-3ea5ce652266 tempest-GroupSnapshotsTest-2057849738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:20:44 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-9c0c87a0-61d5-4bd3-a57e-3ea5ce652266 tempest-GroupSnapshotsTest-2057849738 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:20:44 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-9c0c87a0-61d5-4bd3-a57e-3ea5ce652266 tempest-GroupSnapshotsTest-2057849738 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:20:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9c0c87a0-61d5-4bd3-a57e-3ea5ce652266 tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:44 devstack sudo[96351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d 1073741824 Aug 31 15:20:44 devstack sudo[96351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:44 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-df90d065-035e-4d35-9165-b57522f16e4d tempest-VolumesActionsTest-1059975936 None] Copy volume to image completed successfully. Aug 31 15:20:44 devstack sudo[96351]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9c0c87a0-61d5-4bd3-a57e-3ea5ce652266 tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d 1073741824" returned: 0 in 0.507s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9c0c87a0-61d5-4bd3-a57e-3ea5ce652266 tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:44 devstack sudo[96356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d Aug 31 15:20:44 devstack sudo[96356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:45 devstack sudo[96356]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9c0c87a0-61d5-4bd3-a57e-3ea5ce652266 tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d" returned: 0 in 0.260s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-9c0c87a0-61d5-4bd3-a57e-3ea5ce652266 tempest-GroupSnapshotsTest-2057849738 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:20:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9c0c87a0-61d5-4bd3-a57e-3ea5ce652266 tempest-GroupSnapshotsTest-2057849738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:20:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4258855d-c2a0-4be2-9bf7-3de4bd8b0498 tempest-SnapshotMetadataTestJSON-1858294261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.774s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:20:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-4258855d-c2a0-4be2-9bf7-3de4bd8b0498 tempest-SnapshotMetadataTestJSON-1858294261 None] Creating offline snapshot e18c154f-e736-45ac-b544-ca73dd093aff of volume ad8517a1-204e-4301-944c-2218c15a8971 {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:20:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9c0c87a0-61d5-4bd3-a57e-3ea5ce652266 tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7bd154c-1469-422b-9cc1-33c341839e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9c0c87a0-61d5-4bd3-a57e-3ea5ce652266 tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c641ebee-fd76-4f1d-9d44-105b7a7b3477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:45 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32f7077-bd5e-4e56-82ff-c28fd6f37347]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:20:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4258855d-c2a0-4be2-9bf7-3de4bd8b0498 tempest-SnapshotMetadataTestJSON-1858294261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:45 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-9c0c87a0-61d5-4bd3-a57e-3ea5ce652266 tempest-GroupSnapshotsTest-2057849738 None] Volume volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d (0a1ca112-aae4-4afc-a381-1a32c2f44e3d): created successfully Aug 31 15:20:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9c0c87a0-61d5-4bd3-a57e-3ea5ce652266 tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c641ebee-fd76-4f1d-9d44-105b7a7b3477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9c0c87a0-61d5-4bd3-a57e-3ea5ce652266 tempest-GroupSnapshotsTest-2057849738 None] Flow 'volume_create_manager' (4b2a2408-5e5f-4531-9355-d17849ad61ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:20:45 devstack cinder-volume[86000]: DEBUG oslo_service.periodic_task [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86000) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:20:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:20:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:20:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:20:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:20:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:20:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:45 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-9c0c87a0-61d5-4bd3-a57e-3ea5ce652266 tempest-GroupSnapshotsTest-2057849738 None] Created volume successfully. Aug 31 15:20:45 devstack sudo[96360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:20:45 devstack sudo[96360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:45 devstack sudo[96359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971 Aug 31 15:20:45 devstack sudo[96359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:45 devstack sudo[96360]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.322s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:45 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:20:45 devstack cinder-volume[86000]: DEBUG oslo_service.periodic_task [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running periodic task VolumeManager._thread_info {{(pid=86000) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:20:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] thread count: 28 {{(pid=86000) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 31 15:20:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] thread info: [<_MainThread(MainThread, started 137631281086592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86000) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 31 15:20:45 devstack sudo[96359]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4258855d-c2a0-4be2-9bf7-3de4bd8b0498 tempest-SnapshotMetadataTestJSON-1858294261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971" returned: 0 in 0.456s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4258855d-c2a0-4be2-9bf7-3de4bd8b0498 tempest-SnapshotMetadataTestJSON-1858294261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971.e18c154f-e736-45ac-b544-ca73dd093aff 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:45 devstack sudo[96367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971.e18c154f-e736-45ac-b544-ca73dd093aff 1G Aug 31 15:20:45 devstack sudo[96367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:45 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5519e059-dab8-40cc-8535-4c5b2fe11c77 tempest-VolumesActionsTest-1059975936 None] Acquiring lock "cinder-8192cdb3-1d90-4b41-b1ec-dee126808385-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:20:45 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5519e059-dab8-40cc-8535-4c5b2fe11c77 tempest-VolumesActionsTest-1059975936 None] Lock "cinder-8192cdb3-1d90-4b41-b1ec-dee126808385-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:20:45 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5519e059-dab8-40cc-8535-4c5b2fe11c77 tempest-VolumesActionsTest-1059975936 None] Acquiring lock "cinder-quobyte-8192cdb3-1d90-4b41-b1ec-dee126808385" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:20:45 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5519e059-dab8-40cc-8535-4c5b2fe11c77 tempest-VolumesActionsTest-1059975936 None] Lock "cinder-quobyte-8192cdb3-1d90-4b41-b1ec-dee126808385" acquired by "delete_volume" :: waited 0.028s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:20:45 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-482b98d8-df50-4cd9-b3c8-319919a531dd tempest-GroupSnapshotsTest-2057849738 None] Update group completed successfully. Aug 31 15:20:45 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b50a35-64de-463f-90c5-d093506011aa]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:20:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5519e059-dab8-40cc-8535-4c5b2fe11c77 tempest-VolumesActionsTest-1059975936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8192cdb3-1d90-4b41-b1ec-dee126808385 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:45 devstack sudo[96369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8192cdb3-1d90-4b41-b1ec-dee126808385 Aug 31 15:20:45 devstack sudo[96369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:46 devstack sudo[96367]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4258855d-c2a0-4be2-9bf7-3de4bd8b0498 tempest-SnapshotMetadataTestJSON-1858294261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971.e18c154f-e736-45ac-b544-ca73dd093aff 1G" returned: 0 in 0.520s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4258855d-c2a0-4be2-9bf7-3de4bd8b0498 tempest-SnapshotMetadataTestJSON-1858294261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad8517a1-204e-4301-944c-2218c15a8971 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971.e18c154f-e736-45ac-b544-ca73dd093aff {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:46 devstack sudo[96375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad8517a1-204e-4301-944c-2218c15a8971 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971.e18c154f-e736-45ac-b544-ca73dd093aff Aug 31 15:20:46 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:46 devstack sudo[96369]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5519e059-dab8-40cc-8535-4c5b2fe11c77 tempest-VolumesActionsTest-1059975936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8192cdb3-1d90-4b41-b1ec-dee126808385" returned: 0 in 0.420s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5519e059-dab8-40cc-8535-4c5b2fe11c77 tempest-VolumesActionsTest-1059975936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8192cdb3-1d90-4b41-b1ec-dee126808385 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:46 devstack sudo[96380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8192cdb3-1d90-4b41-b1ec-dee126808385 Aug 31 15:20:46 devstack sudo[96380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:46 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4258855d-c2a0-4be2-9bf7-3de4bd8b0498 tempest-SnapshotMetadataTestJSON-1858294261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad8517a1-204e-4301-944c-2218c15a8971 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971.e18c154f-e736-45ac-b544-ca73dd093aff" returned: 0 in 0.325s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:46 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-4258855d-c2a0-4be2-9bf7-3de4bd8b0498 tempest-SnapshotMetadataTestJSON-1858294261 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971.e18c154f-e736-45ac-b544-ca73dd093aff is being set with open permissions: ugo+rw Aug 31 15:20:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4258855d-c2a0-4be2-9bf7-3de4bd8b0498 tempest-SnapshotMetadataTestJSON-1858294261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971.e18c154f-e736-45ac-b544-ca73dd093aff {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:46 devstack sudo[96385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971.e18c154f-e736-45ac-b544-ca73dd093aff Aug 31 15:20:46 devstack sudo[96385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:46 devstack sudo[96380]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5519e059-dab8-40cc-8535-4c5b2fe11c77 tempest-VolumesActionsTest-1059975936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8192cdb3-1d90-4b41-b1ec-dee126808385" returned: 0 in 0.264s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:46 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5519e059-dab8-40cc-8535-4c5b2fe11c77 tempest-VolumesActionsTest-1059975936 None] Lock "cinder-quobyte-8192cdb3-1d90-4b41-b1ec-dee126808385" released by "delete_volume" :: held 0.739s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:20:46 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-5519e059-dab8-40cc-8535-4c5b2fe11c77 tempest-VolumesActionsTest-1059975936 None] Created reservations ['6284be0b-3c56-4c49-81a2-3f9864d18a15', '4a5020a9-5124-455f-9c00-687a1feedc8e', '9230cbee-1980-4956-8435-56ba26d3688c', '112e5057-539d-4bc1-8125-ab59be8ecdeb'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:20:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5519e059-dab8-40cc-8535-4c5b2fe11c77 tempest-VolumesActionsTest-1059975936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:20:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5519e059-dab8-40cc-8535-4c5b2fe11c77 tempest-VolumesActionsTest-1059975936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:20:46 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5519e059-dab8-40cc-8535-4c5b2fe11c77 tempest-VolumesActionsTest-1059975936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:20:46 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5519e059-dab8-40cc-8535-4c5b2fe11c77 tempest-VolumesActionsTest-1059975936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:20:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5519e059-dab8-40cc-8535-4c5b2fe11c77 tempest-VolumesActionsTest-1059975936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:20:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5519e059-dab8-40cc-8535-4c5b2fe11c77 tempest-VolumesActionsTest-1059975936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:46 devstack sudo[96385]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4258855d-c2a0-4be2-9bf7-3de4bd8b0498 tempest-SnapshotMetadataTestJSON-1858294261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971.e18c154f-e736-45ac-b544-ca73dd093aff" returned: 0 in 0.278s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:46 devstack sudo[96389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:20:46 devstack sudo[96389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4258855d-c2a0-4be2-9bf7-3de4bd8b0498 tempest-SnapshotMetadataTestJSON-1858294261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:46 devstack sudo[96391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971.info Aug 31 15:20:46 devstack sudo[96391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:46 devstack sudo[96389]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5519e059-dab8-40cc-8535-4c5b2fe11c77 tempest-VolumesActionsTest-1059975936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.333s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:46 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-5519e059-dab8-40cc-8535-4c5b2fe11c77 tempest-VolumesActionsTest-1059975936 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:20:46 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-5519e059-dab8-40cc-8535-4c5b2fe11c77 tempest-VolumesActionsTest-1059975936 None] Deleted volume successfully. Aug 31 15:20:47 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5519e059-dab8-40cc-8535-4c5b2fe11c77 tempest-VolumesActionsTest-1059975936 None] Lock "cinder-8192cdb3-1d90-4b41-b1ec-dee126808385-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:20:47 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-e2b06ecc-16a2-44ba-ac07-ef6ee2c45095 tempest-GroupSnapshotsTest-2057849738 None] Update group completed successfully. Aug 31 15:20:47 devstack sudo[96391]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4258855d-c2a0-4be2-9bf7-3de4bd8b0498 tempest-SnapshotMetadataTestJSON-1858294261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971.info" returned: 0 in 0.409s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:47 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-4258855d-c2a0-4be2-9bf7-3de4bd8b0498 tempest-SnapshotMetadataTestJSON-1858294261 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971.info is being set with open permissions: ugo+rw Aug 31 15:20:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4258855d-c2a0-4be2-9bf7-3de4bd8b0498 tempest-SnapshotMetadataTestJSON-1858294261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:47 devstack sudo[96395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971.info Aug 31 15:20:47 devstack sudo[96395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:47 devstack sudo[96395]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4258855d-c2a0-4be2-9bf7-3de4bd8b0498 tempest-SnapshotMetadataTestJSON-1858294261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971.info" returned: 0 in 0.264s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4258855d-c2a0-4be2-9bf7-3de4bd8b0498 tempest-SnapshotMetadataTestJSON-1858294261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.356s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:20:47 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-4258855d-c2a0-4be2-9bf7-3de4bd8b0498 tempest-SnapshotMetadataTestJSON-1858294261 None] Create snapshot completed successfully Aug 31 15:20:48 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-87a39591-67cc-416b-b144-2c5b0a843ab1 tempest-GroupSnapshotsTest-2057849738 None] Update group completed successfully. Aug 31 15:20:48 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-49375804-ddf1-4419-a97f-e066d1ed8767 tempest-SnapshotMetadataTestJSON-1858294261 None] Acquiring lock "cinder-e18c154f-e736-45ac-b544-ca73dd093aff-delete_snapshot" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:20:48 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-49375804-ddf1-4419-a97f-e066d1ed8767 tempest-SnapshotMetadataTestJSON-1858294261 None] Lock "cinder-e18c154f-e736-45ac-b544-ca73dd093aff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:20:48 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-49375804-ddf1-4419-a97f-e066d1ed8767 tempest-SnapshotMetadataTestJSON-1858294261 None] Acquiring lock "cinder-quobyte-ad8517a1-204e-4301-944c-2218c15a8971" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:20:48 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-49375804-ddf1-4419-a97f-e066d1ed8767 tempest-SnapshotMetadataTestJSON-1858294261 None] Lock "cinder-quobyte-ad8517a1-204e-4301-944c-2218c15a8971" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:20:48 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-49375804-ddf1-4419-a97f-e066d1ed8767 tempest-SnapshotMetadataTestJSON-1858294261 None] Acquiring lock "cinder-quobyte-e18c154f-e736-45ac-b544-ca73dd093aff" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:20:48 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-49375804-ddf1-4419-a97f-e066d1ed8767 tempest-SnapshotMetadataTestJSON-1858294261 None] Lock "cinder-quobyte-e18c154f-e736-45ac-b544-ca73dd093aff" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:20:48 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-49375804-ddf1-4419-a97f-e066d1ed8767 tempest-SnapshotMetadataTestJSON-1858294261 None] Deleting offline snapshot e18c154f-e736-45ac-b544-ca73dd093aff of volume ad8517a1-204e-4301-944c-2218c15a8971 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:20:48 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-49375804-ddf1-4419-a97f-e066d1ed8767 tempest-SnapshotMetadataTestJSON-1858294261 None] snapshot_file for this snap is: volume-ad8517a1-204e-4301-944c-2218c15a8971.e18c154f-e736-45ac-b544-ca73dd093aff {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:20:48 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6eaaa6-3e90-41dc-a2c3-b6fa51d3c2a9]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:20:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-49375804-ddf1-4419-a97f-e066d1ed8767 tempest-SnapshotMetadataTestJSON-1858294261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971.e18c154f-e736-45ac-b544-ca73dd093aff {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:49 devstack sudo[96399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971.e18c154f-e736-45ac-b544-ca73dd093aff Aug 31 15:20:49 devstack sudo[96399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:49 devstack sudo[96399]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:49 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-2fc6ec28-c243-4350-bbb1-8a564b2ce9af tempest-GroupSnapshotsTest-2057849738 None] Update group completed successfully. Aug 31 15:20:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-49375804-ddf1-4419-a97f-e066d1ed8767 tempest-SnapshotMetadataTestJSON-1858294261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971.e18c154f-e736-45ac-b544-ca73dd093aff" returned: 0 in 0.503s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:49 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-49375804-ddf1-4419-a97f-e066d1ed8767 tempest-SnapshotMetadataTestJSON-1858294261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad8517a1-204e-4301-944c-2218c15a8971(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:20:49 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da6436b-fb88-43e4-a029-d5b8d43aead3]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:20:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-49375804-ddf1-4419-a97f-e066d1ed8767 tempest-SnapshotMetadataTestJSON-1858294261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:49 devstack sudo[96406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971 Aug 31 15:20:49 devstack sudo[96406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:49 devstack sudo[96406]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-49375804-ddf1-4419-a97f-e066d1ed8767 tempest-SnapshotMetadataTestJSON-1858294261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971" returned: 0 in 0.411s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-49375804-ddf1-4419-a97f-e066d1ed8767 tempest-SnapshotMetadataTestJSON-1858294261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971.e18c154f-e736-45ac-b544-ca73dd093aff {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:49 devstack sudo[96411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971.e18c154f-e736-45ac-b544-ca73dd093aff Aug 31 15:20:49 devstack sudo[96411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:50 devstack sudo[96411]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-49375804-ddf1-4419-a97f-e066d1ed8767 tempest-SnapshotMetadataTestJSON-1858294261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971.e18c154f-e736-45ac-b544-ca73dd093aff" returned: 0 in 0.343s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-49375804-ddf1-4419-a97f-e066d1ed8767 tempest-SnapshotMetadataTestJSON-1858294261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971.e18c154f-e736-45ac-b544-ca73dd093aff {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:50 devstack sudo[96417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971.e18c154f-e736-45ac-b544-ca73dd093aff Aug 31 15:20:50 devstack sudo[96417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:50 devstack sudo[96417]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-49375804-ddf1-4419-a97f-e066d1ed8767 tempest-SnapshotMetadataTestJSON-1858294261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971.e18c154f-e736-45ac-b544-ca73dd093aff" returned: 0 in 0.316s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:50 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-49375804-ddf1-4419-a97f-e066d1ed8767 tempest-SnapshotMetadataTestJSON-1858294261 None] Lock "cinder-quobyte-e18c154f-e736-45ac-b544-ca73dd093aff" released by "_delete_snapshot" :: held 1.715s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:20:50 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-49375804-ddf1-4419-a97f-e066d1ed8767 tempest-SnapshotMetadataTestJSON-1858294261 None] Lock "cinder-quobyte-ad8517a1-204e-4301-944c-2218c15a8971" released by "delete_snapshot" :: held 1.747s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:20:50 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-49375804-ddf1-4419-a97f-e066d1ed8767 tempest-SnapshotMetadataTestJSON-1858294261 None] Created reservations ['cbb2e484-910e-4286-a7c4-078b9d9db8c9', '5b01e0b3-1f84-4532-baa3-4ad7fb6d32b3', '1375b07d-7c8c-4617-9540-db6254726509', '06b4a363-d3d2-4145-96b2-f4a2a8bd8b7f'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:20:50 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-49375804-ddf1-4419-a97f-e066d1ed8767 tempest-SnapshotMetadataTestJSON-1858294261 None] Delete snapshot completed successfully. Aug 31 15:20:50 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-49375804-ddf1-4419-a97f-e066d1ed8767 tempest-SnapshotMetadataTestJSON-1858294261 None] Lock "cinder-e18c154f-e736-45ac-b544-ca73dd093aff-delete_snapshot" released by "delete_snapshot" :: held 1.969s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:20:51 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-88229997-0f51-41c5-9827-9c068ab8469d tempest-SnapshotMetadataTestJSON-1858294261 None] Acquiring lock "cinder-ad8517a1-204e-4301-944c-2218c15a8971-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:20:51 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-88229997-0f51-41c5-9827-9c068ab8469d tempest-SnapshotMetadataTestJSON-1858294261 None] Lock "cinder-ad8517a1-204e-4301-944c-2218c15a8971-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:20:51 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-88229997-0f51-41c5-9827-9c068ab8469d tempest-SnapshotMetadataTestJSON-1858294261 None] Acquiring lock "cinder-quobyte-ad8517a1-204e-4301-944c-2218c15a8971" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:20:51 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-88229997-0f51-41c5-9827-9c068ab8469d tempest-SnapshotMetadataTestJSON-1858294261 None] Lock "cinder-quobyte-ad8517a1-204e-4301-944c-2218c15a8971" acquired by "delete_volume" :: waited 0.026s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:20:51 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-64981b52-f00e-4c8e-84d0-5cd4431a44d8 tempest-GroupSnapshotsTest-2057849738 None] GroupSnapshot 97be3c00-db53-4276-ad1f-4edadee2809c: creating. Aug 31 15:20:51 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd90dfe-ade5-42da-9916-c85a2b0282c0]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:20:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-88229997-0f51-41c5-9827-9c068ab8469d tempest-SnapshotMetadataTestJSON-1858294261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:51 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-64981b52-f00e-4c8e-84d0-5cd4431a44d8 tempest-GroupSnapshotsTest-2057849738 None] Group snapshot 97be3c00-db53-4276-ad1f-4edadee2809c: creating. {{(pid=86000) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 31 15:20:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-64981b52-f00e-4c8e-84d0-5cd4431a44d8 tempest-GroupSnapshotsTest-2057849738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:20:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-64981b52-f00e-4c8e-84d0-5cd4431a44d8 tempest-GroupSnapshotsTest-2057849738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:20:51 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-64981b52-f00e-4c8e-84d0-5cd4431a44d8 tempest-GroupSnapshotsTest-2057849738 None] Creating offline snapshot 3206c48f-d5cd-497d-b27d-fdd0b50f0b94 of volume 0a1ca112-aae4-4afc-a381-1a32c2f44e3d {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:20:51 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a47e79a-ab6c-447e-960a-2bad34ec8d3b]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:20:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-64981b52-f00e-4c8e-84d0-5cd4431a44d8 tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:51 devstack sudo[96420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971 Aug 31 15:20:51 devstack sudo[96420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:51 devstack sudo[96421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d Aug 31 15:20:51 devstack sudo[96421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:51 devstack sudo[96420]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-88229997-0f51-41c5-9827-9c068ab8469d tempest-SnapshotMetadataTestJSON-1858294261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971" returned: 0 in 0.457s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-88229997-0f51-41c5-9827-9c068ab8469d tempest-SnapshotMetadataTestJSON-1858294261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:51 devstack sudo[96427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971 Aug 31 15:20:51 devstack sudo[96427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:51 devstack sudo[96421]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-64981b52-f00e-4c8e-84d0-5cd4431a44d8 tempest-GroupSnapshotsTest-2057849738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d" returned: 0 in 0.501s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-64981b52-f00e-4c8e-84d0-5cd4431a44d8 tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d.3206c48f-d5cd-497d-b27d-fdd0b50f0b94 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:51 devstack sudo[96433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d.3206c48f-d5cd-497d-b27d-fdd0b50f0b94 1G Aug 31 15:20:51 devstack sudo[96433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:52 devstack sudo[96427]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-88229997-0f51-41c5-9827-9c068ab8469d tempest-SnapshotMetadataTestJSON-1858294261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ad8517a1-204e-4301-944c-2218c15a8971" returned: 0 in 0.319s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:52 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-88229997-0f51-41c5-9827-9c068ab8469d tempest-SnapshotMetadataTestJSON-1858294261 None] Lock "cinder-quobyte-ad8517a1-204e-4301-944c-2218c15a8971" released by "delete_volume" :: held 0.867s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:20:52 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-88229997-0f51-41c5-9827-9c068ab8469d tempest-SnapshotMetadataTestJSON-1858294261 None] Created reservations ['91b4de1d-91ad-4250-a476-f6d36b2c8073', '14e2068c-ddf0-489f-a31d-5069241b5fc9', '4720c653-58a4-438c-9ad8-de18183d0a2b', 'b2754e75-d819-4a01-a7f9-491d7499645c'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:20:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-88229997-0f51-41c5-9827-9c068ab8469d tempest-SnapshotMetadataTestJSON-1858294261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:20:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-88229997-0f51-41c5-9827-9c068ab8469d tempest-SnapshotMetadataTestJSON-1858294261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:20:52 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-88229997-0f51-41c5-9827-9c068ab8469d tempest-SnapshotMetadataTestJSON-1858294261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:20:52 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-88229997-0f51-41c5-9827-9c068ab8469d tempest-SnapshotMetadataTestJSON-1858294261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:20:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-88229997-0f51-41c5-9827-9c068ab8469d tempest-SnapshotMetadataTestJSON-1858294261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:20:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-88229997-0f51-41c5-9827-9c068ab8469d tempest-SnapshotMetadataTestJSON-1858294261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:52 devstack sudo[96440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:20:52 devstack sudo[96440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:52 devstack sudo[96433]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-64981b52-f00e-4c8e-84d0-5cd4431a44d8 tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d.3206c48f-d5cd-497d-b27d-fdd0b50f0b94 1G" returned: 0 in 0.578s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-64981b52-f00e-4c8e-84d0-5cd4431a44d8 tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d.3206c48f-d5cd-497d-b27d-fdd0b50f0b94 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:52 devstack sudo[96442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d.3206c48f-d5cd-497d-b27d-fdd0b50f0b94 Aug 31 15:20:52 devstack sudo[96442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:52 devstack sudo[96440]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-88229997-0f51-41c5-9827-9c068ab8469d tempest-SnapshotMetadataTestJSON-1858294261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.357s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:52 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-88229997-0f51-41c5-9827-9c068ab8469d tempest-SnapshotMetadataTestJSON-1858294261 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:20:52 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-88229997-0f51-41c5-9827-9c068ab8469d tempest-SnapshotMetadataTestJSON-1858294261 None] Deleted volume successfully. Aug 31 15:20:52 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-88229997-0f51-41c5-9827-9c068ab8469d tempest-SnapshotMetadataTestJSON-1858294261 None] Lock "cinder-ad8517a1-204e-4301-944c-2218c15a8971-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:20:52 devstack sudo[96442]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-64981b52-f00e-4c8e-84d0-5cd4431a44d8 tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d.3206c48f-d5cd-497d-b27d-fdd0b50f0b94" returned: 0 in 0.416s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:52 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-64981b52-f00e-4c8e-84d0-5cd4431a44d8 tempest-GroupSnapshotsTest-2057849738 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d.3206c48f-d5cd-497d-b27d-fdd0b50f0b94 is being set with open permissions: ugo+rw: NotImplementedError Aug 31 15:20:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-64981b52-f00e-4c8e-84d0-5cd4431a44d8 tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d.3206c48f-d5cd-497d-b27d-fdd0b50f0b94 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:52 devstack sudo[96448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d.3206c48f-d5cd-497d-b27d-fdd0b50f0b94 Aug 31 15:20:52 devstack sudo[96448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:53 devstack sudo[96448]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-64981b52-f00e-4c8e-84d0-5cd4431a44d8 tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d.3206c48f-d5cd-497d-b27d-fdd0b50f0b94" returned: 0 in 0.258s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-64981b52-f00e-4c8e-84d0-5cd4431a44d8 tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:53 devstack sudo[96451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d.info Aug 31 15:20:53 devstack sudo[96451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:53 devstack sudo[96451]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-64981b52-f00e-4c8e-84d0-5cd4431a44d8 tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d.info" returned: 0 in 0.325s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:53 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-64981b52-f00e-4c8e-84d0-5cd4431a44d8 tempest-GroupSnapshotsTest-2057849738 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d.info is being set with open permissions: ugo+rw: NotImplementedError Aug 31 15:20:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-64981b52-f00e-4c8e-84d0-5cd4431a44d8 tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:53 devstack sudo[96454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d.info Aug 31 15:20:53 devstack sudo[96454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:53 devstack sudo[96454]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-64981b52-f00e-4c8e-84d0-5cd4431a44d8 tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d.info" returned: 0 in 0.298s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-64981b52-f00e-4c8e-84d0-5cd4431a44d8 tempest-GroupSnapshotsTest-2057849738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.477s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:20:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-64981b52-f00e-4c8e-84d0-5cd4431a44d8 tempest-GroupSnapshotsTest-2057849738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:20:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-64981b52-f00e-4c8e-84d0-5cd4431a44d8 tempest-GroupSnapshotsTest-2057849738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:20:53 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-64981b52-f00e-4c8e-84d0-5cd4431a44d8 tempest-GroupSnapshotsTest-2057849738 None] Creating offline snapshot aa567b35-b841-4a0c-8b33-0f531e8fa583 of volume 97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:20:53 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[389fbf60-b318-4469-89f5-2c08cc390303]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:20:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-64981b52-f00e-4c8e-84d0-5cd4431a44d8 tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:53 devstack sudo[96457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf Aug 31 15:20:53 devstack sudo[96457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:54 devstack sudo[96457]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-64981b52-f00e-4c8e-84d0-5cd4431a44d8 tempest-GroupSnapshotsTest-2057849738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf" returned: 0 in 0.448s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-64981b52-f00e-4c8e-84d0-5cd4431a44d8 tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf.aa567b35-b841-4a0c-8b33-0f531e8fa583 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:54 devstack sudo[96462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf.aa567b35-b841-4a0c-8b33-0f531e8fa583 1G Aug 31 15:20:54 devstack sudo[96462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:54 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-e26c1850-3b7c-4be4-90e9-a1d16550eabe tempest-VolumesListAdminTestJSON-1775751277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:20:54 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e26c1850-3b7c-4be4-90e9-a1d16550eabe tempest-VolumesListAdminTestJSON-1775751277 None] Flow 'volume_create_manager' (4ac7b2d8-6fd6-4494-a101-f42a641114b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:20:54 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e26c1850-3b7c-4be4-90e9-a1d16550eabe tempest-VolumesListAdminTestJSON-1775751277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92c3576a-3351-4a5f-868c-8e842eba1d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:54 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e26c1850-3b7c-4be4-90e9-a1d16550eabe tempest-VolumesListAdminTestJSON-1775751277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92c3576a-3351-4a5f-868c-8e842eba1d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1883527654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a969216-4d1c-41e9-b15f-3e6048453ecb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c060b65a8fcd4de8b38b5a16cbfeb5cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:20:55Z,use_quota=True,user_id='75445243a54d412a947b0b1d3c42a5c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:54 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e26c1850-3b7c-4be4-90e9-a1d16550eabe tempest-VolumesListAdminTestJSON-1775751277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d99b0ec-4b42-47e3-b5ad-4a8d8f5991f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:54 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e26c1850-3b7c-4be4-90e9-a1d16550eabe tempest-VolumesListAdminTestJSON-1775751277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d99b0ec-4b42-47e3-b5ad-4a8d8f5991f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:54 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e26c1850-3b7c-4be4-90e9-a1d16550eabe tempest-VolumesListAdminTestJSON-1775751277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c92dbcd6-106b-4019-8e25-fd9874b9fbdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:54 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e26c1850-3b7c-4be4-90e9-a1d16550eabe tempest-VolumesListAdminTestJSON-1775751277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c92dbcd6-106b-4019-8e25-fd9874b9fbdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a969216-4d1c-41e9-b15f-3e6048453ecb', 'volume_name': 'volume-4a969216-4d1c-41e9-b15f-3e6048453ecb', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:54 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e26c1850-3b7c-4be4-90e9-a1d16550eabe tempest-VolumesListAdminTestJSON-1775751277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac671d57-0877-4762-b342-9cf0159215ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:54 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e26c1850-3b7c-4be4-90e9-a1d16550eabe tempest-VolumesListAdminTestJSON-1775751277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac671d57-0877-4762-b342-9cf0159215ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:54 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e26c1850-3b7c-4be4-90e9-a1d16550eabe tempest-VolumesListAdminTestJSON-1775751277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1399af8-2cac-43f8-b299-c080ac16d535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:54 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-e26c1850-3b7c-4be4-90e9-a1d16550eabe tempest-VolumesListAdminTestJSON-1775751277 None] Volume 4a969216-4d1c-41e9-b15f-3e6048453ecb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a969216-4d1c-41e9-b15f-3e6048453ecb', 'volume_size': 1} Aug 31 15:20:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e26c1850-3b7c-4be4-90e9-a1d16550eabe tempest-VolumesListAdminTestJSON-1775751277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:20:54 devstack sudo[96462]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-64981b52-f00e-4c8e-84d0-5cd4431a44d8 tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf.aa567b35-b841-4a0c-8b33-0f531e8fa583 1G" returned: 0 in 0.541s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-64981b52-f00e-4c8e-84d0-5cd4431a44d8 tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf.aa567b35-b841-4a0c-8b33-0f531e8fa583 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:54 devstack sudo[96468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf.aa567b35-b841-4a0c-8b33-0f531e8fa583 Aug 31 15:20:54 devstack sudo[96468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:54 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-de0b65fe-7ac3-45de-892b-6da7fa8af13d tempest-VolumesCloneNegativeTest-1231359595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:20:54 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-de0b65fe-7ac3-45de-892b-6da7fa8af13d tempest-VolumesCloneNegativeTest-1231359595 None] Flow 'volume_create_manager' (aa053286-a914-463d-b870-cc595b2929c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:20:54 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-de0b65fe-7ac3-45de-892b-6da7fa8af13d tempest-VolumesCloneNegativeTest-1231359595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adabd201-6b29-4443-aefa-37c953913306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:54 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-de0b65fe-7ac3-45de-892b-6da7fa8af13d tempest-VolumesCloneNegativeTest-1231359595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adabd201-6b29-4443-aefa-37c953913306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:20:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1570325651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62a155e6-6e48-4f9d-9d95-3541a172b9da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34adf3c246424f3bb29c15c9b4662a2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:20:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:20:55Z,use_quota=True,user_id='de335ea6c798413fbf3fc03ebae7d403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:54 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-de0b65fe-7ac3-45de-892b-6da7fa8af13d tempest-VolumesCloneNegativeTest-1231359595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7336acf5-1ab2-4774-b510-84709432b8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:55 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-de0b65fe-7ac3-45de-892b-6da7fa8af13d tempest-VolumesCloneNegativeTest-1231359595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7336acf5-1ab2-4774-b510-84709432b8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:55 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-de0b65fe-7ac3-45de-892b-6da7fa8af13d tempest-VolumesCloneNegativeTest-1231359595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21ee084b-a521-4a65-a8e8-5d9b2b418f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:55 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-de0b65fe-7ac3-45de-892b-6da7fa8af13d tempest-VolumesCloneNegativeTest-1231359595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21ee084b-a521-4a65-a8e8-5d9b2b418f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62a155e6-6e48-4f9d-9d95-3541a172b9da', 'volume_name': 'volume-62a155e6-6e48-4f9d-9d95-3541a172b9da', 'volume_size': 2}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:55 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-de0b65fe-7ac3-45de-892b-6da7fa8af13d tempest-VolumesCloneNegativeTest-1231359595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3133d6fb-c9ef-47ad-b7fe-cefa494f778d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:55 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-de0b65fe-7ac3-45de-892b-6da7fa8af13d tempest-VolumesCloneNegativeTest-1231359595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3133d6fb-c9ef-47ad-b7fe-cefa494f778d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:55 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-de0b65fe-7ac3-45de-892b-6da7fa8af13d tempest-VolumesCloneNegativeTest-1231359595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a355ea7d-d181-4aee-89f2-ada1f0606bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:55 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-de0b65fe-7ac3-45de-892b-6da7fa8af13d tempest-VolumesCloneNegativeTest-1231359595 None] Volume 62a155e6-6e48-4f9d-9d95-3541a172b9da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62a155e6-6e48-4f9d-9d95-3541a172b9da', 'volume_size': 2} Aug 31 15:20:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-de0b65fe-7ac3-45de-892b-6da7fa8af13d tempest-VolumesCloneNegativeTest-1231359595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:20:55 devstack sudo[96468]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-64981b52-f00e-4c8e-84d0-5cd4431a44d8 tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf.aa567b35-b841-4a0c-8b33-0f531e8fa583" returned: 0 in 0.320s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:55 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-64981b52-f00e-4c8e-84d0-5cd4431a44d8 tempest-GroupSnapshotsTest-2057849738 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf.aa567b35-b841-4a0c-8b33-0f531e8fa583 is being set with open permissions: ugo+rw: NotImplementedError Aug 31 15:20:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-64981b52-f00e-4c8e-84d0-5cd4431a44d8 tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf.aa567b35-b841-4a0c-8b33-0f531e8fa583 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:55 devstack sudo[96473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf.aa567b35-b841-4a0c-8b33-0f531e8fa583 Aug 31 15:20:55 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:55 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-64981b52-f00e-4c8e-84d0-5cd4431a44d8 tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf.aa567b35-b841-4a0c-8b33-0f531e8fa583" returned: 0 in 0.250s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-64981b52-f00e-4c8e-84d0-5cd4431a44d8 tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:55 devstack sudo[96476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf.info Aug 31 15:20:55 devstack sudo[96476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:55 devstack sudo[96476]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-64981b52-f00e-4c8e-84d0-5cd4431a44d8 tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf.info" returned: 0 in 0.249s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:55 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-64981b52-f00e-4c8e-84d0-5cd4431a44d8 tempest-GroupSnapshotsTest-2057849738 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf.info is being set with open permissions: ugo+rw: NotImplementedError Aug 31 15:20:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-64981b52-f00e-4c8e-84d0-5cd4431a44d8 tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:55 devstack sudo[96479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf.info Aug 31 15:20:55 devstack sudo[96479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:55 devstack sudo[96479]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-64981b52-f00e-4c8e-84d0-5cd4431a44d8 tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf.info" returned: 0 in 0.255s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-64981b52-f00e-4c8e-84d0-5cd4431a44d8 tempest-GroupSnapshotsTest-2057849738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.183s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:20:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e26c1850-3b7c-4be4-90e9-a1d16550eabe tempest-VolumesListAdminTestJSON-1775751277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.312s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:20:55 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-e26c1850-3b7c-4be4-90e9-a1d16550eabe tempest-VolumesListAdminTestJSON-1775751277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1883527654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a969216-4d1c-41e9-b15f-3e6048453ecb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c060b65a8fcd4de8b38b5a16cbfeb5cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:20:55Z,use_quota=True,user_id='75445243a54d412a947b0b1d3c42a5c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:20:55 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-e26c1850-3b7c-4be4-90e9-a1d16550eabe tempest-VolumesListAdminTestJSON-1775751277 None] Creating volume 4a969216-4d1c-41e9-b15f-3e6048453ecb {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:20:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e26c1850-3b7c-4be4-90e9-a1d16550eabe tempest-VolumesListAdminTestJSON-1775751277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:20:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e26c1850-3b7c-4be4-90e9-a1d16550eabe tempest-VolumesListAdminTestJSON-1775751277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:20:55 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-e26c1850-3b7c-4be4-90e9-a1d16550eabe tempest-VolumesListAdminTestJSON-1775751277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:20:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-e26c1850-3b7c-4be4-90e9-a1d16550eabe tempest-VolumesListAdminTestJSON-1775751277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:20:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e26c1850-3b7c-4be4-90e9-a1d16550eabe tempest-VolumesListAdminTestJSON-1775751277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:20:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-e26c1850-3b7c-4be4-90e9-a1d16550eabe tempest-VolumesListAdminTestJSON-1775751277 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:20:56 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-e26c1850-3b7c-4be4-90e9-a1d16550eabe tempest-VolumesListAdminTestJSON-1775751277 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:20:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e26c1850-3b7c-4be4-90e9-a1d16550eabe tempest-VolumesListAdminTestJSON-1775751277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4a969216-4d1c-41e9-b15f-3e6048453ecb 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:56 devstack sudo[96482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4a969216-4d1c-41e9-b15f-3e6048453ecb 1073741824 Aug 31 15:20:56 devstack sudo[96482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:56 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-64981b52-f00e-4c8e-84d0-5cd4431a44d8 tempest-GroupSnapshotsTest-2057849738 None] group_snapshot 97be3c00-db53-4276-ad1f-4edadee2809c: created successfully Aug 31 15:20:56 devstack sudo[96482]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e26c1850-3b7c-4be4-90e9-a1d16550eabe tempest-VolumesListAdminTestJSON-1775751277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4a969216-4d1c-41e9-b15f-3e6048453ecb 1073741824" returned: 0 in 0.426s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e26c1850-3b7c-4be4-90e9-a1d16550eabe tempest-VolumesListAdminTestJSON-1775751277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4a969216-4d1c-41e9-b15f-3e6048453ecb {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:56 devstack sudo[96488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4a969216-4d1c-41e9-b15f-3e6048453ecb Aug 31 15:20:56 devstack sudo[96488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:56 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-04c54d28-f93e-4153-90fd-48ddbaf366f0 tempest-GroupSnapshotsTest-2057849738 None] group_snapshot 97be3c00-db53-4276-ad1f-4edadee2809c: deleting Aug 31 15:20:56 devstack sudo[96488]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e26c1850-3b7c-4be4-90e9-a1d16550eabe tempest-VolumesListAdminTestJSON-1775751277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4a969216-4d1c-41e9-b15f-3e6048453ecb" returned: 0 in 0.304s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-e26c1850-3b7c-4be4-90e9-a1d16550eabe tempest-VolumesListAdminTestJSON-1775751277 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:20:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e26c1850-3b7c-4be4-90e9-a1d16550eabe tempest-VolumesListAdminTestJSON-1775751277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:20:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-de0b65fe-7ac3-45de-892b-6da7fa8af13d tempest-VolumesCloneNegativeTest-1231359595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.774s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:20:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-de0b65fe-7ac3-45de-892b-6da7fa8af13d tempest-VolumesCloneNegativeTest-1231359595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:20:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1570325651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62a155e6-6e48-4f9d-9d95-3541a172b9da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34adf3c246424f3bb29c15c9b4662a2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:20:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:20:55Z,use_quota=True,user_id='de335ea6c798413fbf3fc03ebae7d403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:20:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-de0b65fe-7ac3-45de-892b-6da7fa8af13d tempest-VolumesCloneNegativeTest-1231359595 None] Creating volume 62a155e6-6e48-4f9d-9d95-3541a172b9da {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:20:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-de0b65fe-7ac3-45de-892b-6da7fa8af13d tempest-VolumesCloneNegativeTest-1231359595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:20:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-de0b65fe-7ac3-45de-892b-6da7fa8af13d tempest-VolumesCloneNegativeTest-1231359595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:20:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-de0b65fe-7ac3-45de-892b-6da7fa8af13d tempest-VolumesCloneNegativeTest-1231359595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:20:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-de0b65fe-7ac3-45de-892b-6da7fa8af13d tempest-VolumesCloneNegativeTest-1231359595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:20:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-de0b65fe-7ac3-45de-892b-6da7fa8af13d tempest-VolumesCloneNegativeTest-1231359595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:20:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-de0b65fe-7ac3-45de-892b-6da7fa8af13d tempest-VolumesCloneNegativeTest-1231359595 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:20:56 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-de0b65fe-7ac3-45de-892b-6da7fa8af13d tempest-VolumesCloneNegativeTest-1231359595 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:20:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-de0b65fe-7ac3-45de-892b-6da7fa8af13d tempest-VolumesCloneNegativeTest-1231359595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-62a155e6-6e48-4f9d-9d95-3541a172b9da 2147483648 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:56 devstack sudo[96491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-62a155e6-6e48-4f9d-9d95-3541a172b9da 2147483648 Aug 31 15:20:56 devstack sudo[96491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e26c1850-3b7c-4be4-90e9-a1d16550eabe tempest-VolumesListAdminTestJSON-1775751277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1399af8-2cac-43f8-b299-c080ac16d535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a969216-4d1c-41e9-b15f-3e6048453ecb', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e26c1850-3b7c-4be4-90e9-a1d16550eabe tempest-VolumesListAdminTestJSON-1775751277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a339d327-5fff-4253-ac6f-86bd8f1f25e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-04c54d28-f93e-4153-90fd-48ddbaf366f0 tempest-GroupSnapshotsTest-2057849738 None] group_snapshot 97be3c00-db53-4276-ad1f-4edadee2809c: deleting {{(pid=86000) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 31 15:20:56 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-e26c1850-3b7c-4be4-90e9-a1d16550eabe tempest-VolumesListAdminTestJSON-1775751277 None] Volume volume-4a969216-4d1c-41e9-b15f-3e6048453ecb (4a969216-4d1c-41e9-b15f-3e6048453ecb): created successfully Aug 31 15:20:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e26c1850-3b7c-4be4-90e9-a1d16550eabe tempest-VolumesListAdminTestJSON-1775751277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a339d327-5fff-4253-ac6f-86bd8f1f25e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e26c1850-3b7c-4be4-90e9-a1d16550eabe tempest-VolumesListAdminTestJSON-1775751277 None] Flow 'volume_create_manager' (4ac7b2d8-6fd6-4494-a101-f42a641114b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:20:56 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-e26c1850-3b7c-4be4-90e9-a1d16550eabe tempest-VolumesListAdminTestJSON-1775751277 None] Created volume successfully. Aug 31 15:20:56 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-04c54d28-f93e-4153-90fd-48ddbaf366f0 tempest-GroupSnapshotsTest-2057849738 None] Acquiring lock "cinder-quobyte-0a1ca112-aae4-4afc-a381-1a32c2f44e3d" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:20:56 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-04c54d28-f93e-4153-90fd-48ddbaf366f0 tempest-GroupSnapshotsTest-2057849738 None] Lock "cinder-quobyte-0a1ca112-aae4-4afc-a381-1a32c2f44e3d" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:20:56 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-04c54d28-f93e-4153-90fd-48ddbaf366f0 tempest-GroupSnapshotsTest-2057849738 None] Acquiring lock "cinder-quobyte-3206c48f-d5cd-497d-b27d-fdd0b50f0b94" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:20:56 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-04c54d28-f93e-4153-90fd-48ddbaf366f0 tempest-GroupSnapshotsTest-2057849738 None] Lock "cinder-quobyte-3206c48f-d5cd-497d-b27d-fdd0b50f0b94" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:20:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-04c54d28-f93e-4153-90fd-48ddbaf366f0 tempest-GroupSnapshotsTest-2057849738 None] Deleting offline snapshot 3206c48f-d5cd-497d-b27d-fdd0b50f0b94 of volume 0a1ca112-aae4-4afc-a381-1a32c2f44e3d {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:20:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-04c54d28-f93e-4153-90fd-48ddbaf366f0 tempest-GroupSnapshotsTest-2057849738 None] snapshot_file for this snap is: volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d.3206c48f-d5cd-497d-b27d-fdd0b50f0b94 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:20:56 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-93bfdb07-3e5e-49c5-ae96-40779ad51330 tempest-AbsoluteLimitsTests-611793088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:20:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-93bfdb07-3e5e-49c5-ae96-40779ad51330 tempest-AbsoluteLimitsTests-611793088 None] Flow 'volume_create_manager' (88627e50-8dd0-4ca8-865d-f784b3b24d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:20:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-93bfdb07-3e5e-49c5-ae96-40779ad51330 tempest-AbsoluteLimitsTests-611793088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa00ddd6-e9da-4e95-85a1-8917f1e030c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:57 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[347d8d4a-5a21-4493-ab48-011eab94cd1b]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:20:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-04c54d28-f93e-4153-90fd-48ddbaf366f0 tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d.3206c48f-d5cd-497d-b27d-fdd0b50f0b94 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-93bfdb07-3e5e-49c5-ae96-40779ad51330 tempest-AbsoluteLimitsTests-611793088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa00ddd6-e9da-4e95-85a1-8917f1e030c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1827342972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19738cfe-7363-439a-ba81-5942f3b3a73c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e69ad4ab481147eb82fae056c7a9e215',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:20:57Z,use_quota=True,user_id='f140fae2c5f8411ab7bc112c79e77b82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-93bfdb07-3e5e-49c5-ae96-40779ad51330 tempest-AbsoluteLimitsTests-611793088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2608dd0-2209-4958-a72e-17245354924a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-93bfdb07-3e5e-49c5-ae96-40779ad51330 tempest-AbsoluteLimitsTests-611793088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2608dd0-2209-4958-a72e-17245354924a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-93bfdb07-3e5e-49c5-ae96-40779ad51330 tempest-AbsoluteLimitsTests-611793088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8090c937-f620-4fe1-b551-48f551b77f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-93bfdb07-3e5e-49c5-ae96-40779ad51330 tempest-AbsoluteLimitsTests-611793088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8090c937-f620-4fe1-b551-48f551b77f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19738cfe-7363-439a-ba81-5942f3b3a73c', 'volume_name': 'volume-19738cfe-7363-439a-ba81-5942f3b3a73c', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-93bfdb07-3e5e-49c5-ae96-40779ad51330 tempest-AbsoluteLimitsTests-611793088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9578c614-b356-4906-9eb5-90df40fcbc05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-93bfdb07-3e5e-49c5-ae96-40779ad51330 tempest-AbsoluteLimitsTests-611793088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9578c614-b356-4906-9eb5-90df40fcbc05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-93bfdb07-3e5e-49c5-ae96-40779ad51330 tempest-AbsoluteLimitsTests-611793088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea9e48c-1db9-4a86-bfe8-ce8966c642f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:57 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-93bfdb07-3e5e-49c5-ae96-40779ad51330 tempest-AbsoluteLimitsTests-611793088 None] Volume 19738cfe-7363-439a-ba81-5942f3b3a73c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19738cfe-7363-439a-ba81-5942f3b3a73c', 'volume_size': 1} Aug 31 15:20:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-93bfdb07-3e5e-49c5-ae96-40779ad51330 tempest-AbsoluteLimitsTests-611793088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:20:57 devstack sudo[96493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d.3206c48f-d5cd-497d-b27d-fdd0b50f0b94 Aug 31 15:20:57 devstack sudo[96493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:57 devstack sudo[96491]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-de0b65fe-7ac3-45de-892b-6da7fa8af13d tempest-VolumesCloneNegativeTest-1231359595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-62a155e6-6e48-4f9d-9d95-3541a172b9da 2147483648" returned: 0 in 0.564s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-de0b65fe-7ac3-45de-892b-6da7fa8af13d tempest-VolumesCloneNegativeTest-1231359595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-62a155e6-6e48-4f9d-9d95-3541a172b9da {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:57 devstack sudo[96493]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-04c54d28-f93e-4153-90fd-48ddbaf366f0 tempest-GroupSnapshotsTest-2057849738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d.3206c48f-d5cd-497d-b27d-fdd0b50f0b94" returned: 0 in 0.396s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:57 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-04c54d28-f93e-4153-90fd-48ddbaf366f0 tempest-GroupSnapshotsTest-2057849738 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:20:57 devstack sudo[96501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-62a155e6-6e48-4f9d-9d95-3541a172b9da Aug 31 15:20:57 devstack sudo[96501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:57 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa564eea-9e6b-4871-a74d-6d5a261d14ff]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:20:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-04c54d28-f93e-4153-90fd-48ddbaf366f0 tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:57 devstack sudo[96503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d Aug 31 15:20:57 devstack sudo[96503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:57 devstack sudo[96501]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-de0b65fe-7ac3-45de-892b-6da7fa8af13d tempest-VolumesCloneNegativeTest-1231359595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-62a155e6-6e48-4f9d-9d95-3541a172b9da" returned: 0 in 0.259s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:57 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-de0b65fe-7ac3-45de-892b-6da7fa8af13d tempest-VolumesCloneNegativeTest-1231359595 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:20:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-de0b65fe-7ac3-45de-892b-6da7fa8af13d tempest-VolumesCloneNegativeTest-1231359595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:20:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-93bfdb07-3e5e-49c5-ae96-40779ad51330 tempest-AbsoluteLimitsTests-611793088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.581s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:20:57 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-93bfdb07-3e5e-49c5-ae96-40779ad51330 tempest-AbsoluteLimitsTests-611793088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1827342972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19738cfe-7363-439a-ba81-5942f3b3a73c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e69ad4ab481147eb82fae056c7a9e215',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:20:57Z,use_quota=True,user_id='f140fae2c5f8411ab7bc112c79e77b82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:20:57 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-93bfdb07-3e5e-49c5-ae96-40779ad51330 tempest-AbsoluteLimitsTests-611793088 None] Creating volume 19738cfe-7363-439a-ba81-5942f3b3a73c {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:20:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-93bfdb07-3e5e-49c5-ae96-40779ad51330 tempest-AbsoluteLimitsTests-611793088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:20:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-93bfdb07-3e5e-49c5-ae96-40779ad51330 tempest-AbsoluteLimitsTests-611793088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:20:57 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-93bfdb07-3e5e-49c5-ae96-40779ad51330 tempest-AbsoluteLimitsTests-611793088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:20:57 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-93bfdb07-3e5e-49c5-ae96-40779ad51330 tempest-AbsoluteLimitsTests-611793088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:20:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-93bfdb07-3e5e-49c5-ae96-40779ad51330 tempest-AbsoluteLimitsTests-611793088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:20:57 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-93bfdb07-3e5e-49c5-ae96-40779ad51330 tempest-AbsoluteLimitsTests-611793088 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:20:57 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-93bfdb07-3e5e-49c5-ae96-40779ad51330 tempest-AbsoluteLimitsTests-611793088 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:20:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-93bfdb07-3e5e-49c5-ae96-40779ad51330 tempest-AbsoluteLimitsTests-611793088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-19738cfe-7363-439a-ba81-5942f3b3a73c 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:57 devstack sudo[96506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-19738cfe-7363-439a-ba81-5942f3b3a73c 1073741824 Aug 31 15:20:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-de0b65fe-7ac3-45de-892b-6da7fa8af13d tempest-VolumesCloneNegativeTest-1231359595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a355ea7d-d181-4aee-89f2-ada1f0606bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62a155e6-6e48-4f9d-9d95-3541a172b9da', 'volume_size': 2}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:57 devstack sudo[96506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-de0b65fe-7ac3-45de-892b-6da7fa8af13d tempest-VolumesCloneNegativeTest-1231359595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6cbaeb7-794b-40eb-ac1d-81a74914ae60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:57 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-de0b65fe-7ac3-45de-892b-6da7fa8af13d tempest-VolumesCloneNegativeTest-1231359595 None] Volume volume-62a155e6-6e48-4f9d-9d95-3541a172b9da (62a155e6-6e48-4f9d-9d95-3541a172b9da): created successfully Aug 31 15:20:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-de0b65fe-7ac3-45de-892b-6da7fa8af13d tempest-VolumesCloneNegativeTest-1231359595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6cbaeb7-794b-40eb-ac1d-81a74914ae60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-de0b65fe-7ac3-45de-892b-6da7fa8af13d tempest-VolumesCloneNegativeTest-1231359595 None] Flow 'volume_create_manager' (aa053286-a914-463d-b870-cc595b2929c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:20:57 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-de0b65fe-7ac3-45de-892b-6da7fa8af13d tempest-VolumesCloneNegativeTest-1231359595 None] Created volume successfully. Aug 31 15:20:57 devstack sudo[96503]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-04c54d28-f93e-4153-90fd-48ddbaf366f0 tempest-GroupSnapshotsTest-2057849738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d" returned: 0 in 0.400s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-04c54d28-f93e-4153-90fd-48ddbaf366f0 tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d.3206c48f-d5cd-497d-b27d-fdd0b50f0b94 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:57 devstack sudo[96511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d.3206c48f-d5cd-497d-b27d-fdd0b50f0b94 Aug 31 15:20:57 devstack sudo[96511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:58 devstack sudo[96506]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-93bfdb07-3e5e-49c5-ae96-40779ad51330 tempest-AbsoluteLimitsTests-611793088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-19738cfe-7363-439a-ba81-5942f3b3a73c 1073741824" returned: 0 in 0.545s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-11ad8bf5-4446-4750-bede-72b89462f539 tempest-VolumesListAdminTestJSON-1775751277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-11ad8bf5-4446-4750-bede-72b89462f539 tempest-VolumesListAdminTestJSON-1775751277 None] Flow 'volume_create_manager' (6b31cfea-2928-4060-89c7-a08ef758746b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-11ad8bf5-4446-4750-bede-72b89462f539 tempest-VolumesListAdminTestJSON-1775751277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd2b24cb-7332-4029-9e40-08c115342a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:58 devstack sudo[96511]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-04c54d28-f93e-4153-90fd-48ddbaf366f0 tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d.3206c48f-d5cd-497d-b27d-fdd0b50f0b94" returned: 0 in 0.438s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-04c54d28-f93e-4153-90fd-48ddbaf366f0 tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d.3206c48f-d5cd-497d-b27d-fdd0b50f0b94 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-93bfdb07-3e5e-49c5-ae96-40779ad51330 tempest-AbsoluteLimitsTests-611793088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-19738cfe-7363-439a-ba81-5942f3b3a73c {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:58 devstack sudo[96520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d.3206c48f-d5cd-497d-b27d-fdd0b50f0b94 Aug 31 15:20:58 devstack sudo[96520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-11ad8bf5-4446-4750-bede-72b89462f539 tempest-VolumesListAdminTestJSON-1775751277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd2b24cb-7332-4029-9e40-08c115342a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-516718289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddd4284a-c3ba-4d03-b9da-12840f27902f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c060b65a8fcd4de8b38b5a16cbfeb5cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:20:58Z,use_quota=True,user_id='75445243a54d412a947b0b1d3c42a5c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-11ad8bf5-4446-4750-bede-72b89462f539 tempest-VolumesListAdminTestJSON-1775751277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01e1c615-5b35-4967-a886-bd8eee64f8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-11ad8bf5-4446-4750-bede-72b89462f539 tempest-VolumesListAdminTestJSON-1775751277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01e1c615-5b35-4967-a886-bd8eee64f8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-11ad8bf5-4446-4750-bede-72b89462f539 tempest-VolumesListAdminTestJSON-1775751277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f00fff48-30fb-49f1-b496-14c02d8f9270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:58 devstack sudo[96521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-19738cfe-7363-439a-ba81-5942f3b3a73c Aug 31 15:20:58 devstack sudo[96521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-11ad8bf5-4446-4750-bede-72b89462f539 tempest-VolumesListAdminTestJSON-1775751277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f00fff48-30fb-49f1-b496-14c02d8f9270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddd4284a-c3ba-4d03-b9da-12840f27902f', 'volume_name': 'volume-ddd4284a-c3ba-4d03-b9da-12840f27902f', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-11ad8bf5-4446-4750-bede-72b89462f539 tempest-VolumesListAdminTestJSON-1775751277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f311ed99-3328-4161-8aae-7c0a3fc1e803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-11ad8bf5-4446-4750-bede-72b89462f539 tempest-VolumesListAdminTestJSON-1775751277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f311ed99-3328-4161-8aae-7c0a3fc1e803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-11ad8bf5-4446-4750-bede-72b89462f539 tempest-VolumesListAdminTestJSON-1775751277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7f6c808-4d1e-4b95-b44f-050444b67511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:58 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-11ad8bf5-4446-4750-bede-72b89462f539 tempest-VolumesListAdminTestJSON-1775751277 None] Volume ddd4284a-c3ba-4d03-b9da-12840f27902f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddd4284a-c3ba-4d03-b9da-12840f27902f', 'volume_size': 1} Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-11ad8bf5-4446-4750-bede-72b89462f539 tempest-VolumesListAdminTestJSON-1775751277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7aec8657-1665-4396-9e68-ce3c0323d65a tempest-VolumesCloneNegativeTest-1231359595 None] Acquiring lock "cinder-62a155e6-6e48-4f9d-9d95-3541a172b9da-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7aec8657-1665-4396-9e68-ce3c0323d65a tempest-VolumesCloneNegativeTest-1231359595 None] Lock "cinder-62a155e6-6e48-4f9d-9d95-3541a172b9da-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7aec8657-1665-4396-9e68-ce3c0323d65a tempest-VolumesCloneNegativeTest-1231359595 None] Acquiring lock "cinder-quobyte-62a155e6-6e48-4f9d-9d95-3541a172b9da" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7aec8657-1665-4396-9e68-ce3c0323d65a tempest-VolumesCloneNegativeTest-1231359595 None] Lock "cinder-quobyte-62a155e6-6e48-4f9d-9d95-3541a172b9da" acquired by "delete_volume" :: waited 0.015s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b324989-16fa-4c9d-bb51-746ca4950e3b]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7aec8657-1665-4396-9e68-ce3c0323d65a tempest-VolumesCloneNegativeTest-1231359595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-62a155e6-6e48-4f9d-9d95-3541a172b9da {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:58 devstack sudo[96521]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:58 devstack sudo[96520]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-93bfdb07-3e5e-49c5-ae96-40779ad51330 tempest-AbsoluteLimitsTests-611793088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-19738cfe-7363-439a-ba81-5942f3b3a73c" returned: 0 in 0.284s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-93bfdb07-3e5e-49c5-ae96-40779ad51330 tempest-AbsoluteLimitsTests-611793088 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-93bfdb07-3e5e-49c5-ae96-40779ad51330 tempest-AbsoluteLimitsTests-611793088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-11ad8bf5-4446-4750-bede-72b89462f539 tempest-VolumesListAdminTestJSON-1775751277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.222s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-11ad8bf5-4446-4750-bede-72b89462f539 tempest-VolumesListAdminTestJSON-1775751277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-516718289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddd4284a-c3ba-4d03-b9da-12840f27902f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c060b65a8fcd4de8b38b5a16cbfeb5cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:20:58Z,use_quota=True,user_id='75445243a54d412a947b0b1d3c42a5c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-11ad8bf5-4446-4750-bede-72b89462f539 tempest-VolumesListAdminTestJSON-1775751277 None] Creating volume ddd4284a-c3ba-4d03-b9da-12840f27902f {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-11ad8bf5-4446-4750-bede-72b89462f539 tempest-VolumesListAdminTestJSON-1775751277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-11ad8bf5-4446-4750-bede-72b89462f539 tempest-VolumesListAdminTestJSON-1775751277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-11ad8bf5-4446-4750-bede-72b89462f539 tempest-VolumesListAdminTestJSON-1775751277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-11ad8bf5-4446-4750-bede-72b89462f539 tempest-VolumesListAdminTestJSON-1775751277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-11ad8bf5-4446-4750-bede-72b89462f539 tempest-VolumesListAdminTestJSON-1775751277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-11ad8bf5-4446-4750-bede-72b89462f539 tempest-VolumesListAdminTestJSON-1775751277 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:20:58 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-11ad8bf5-4446-4750-bede-72b89462f539 tempest-VolumesListAdminTestJSON-1775751277 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-11ad8bf5-4446-4750-bede-72b89462f539 tempest-VolumesListAdminTestJSON-1775751277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ddd4284a-c3ba-4d03-b9da-12840f27902f 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:58 devstack sudo[96524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-62a155e6-6e48-4f9d-9d95-3541a172b9da Aug 31 15:20:58 devstack sudo[96524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-04c54d28-f93e-4153-90fd-48ddbaf366f0 tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d.3206c48f-d5cd-497d-b27d-fdd0b50f0b94" returned: 0 in 0.342s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:58 devstack sudo[96527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ddd4284a-c3ba-4d03-b9da-12840f27902f 1073741824 Aug 31 15:20:58 devstack sudo[96527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-93bfdb07-3e5e-49c5-ae96-40779ad51330 tempest-AbsoluteLimitsTests-611793088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea9e48c-1db9-4a86-bfe8-ce8966c642f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19738cfe-7363-439a-ba81-5942f3b3a73c', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-93bfdb07-3e5e-49c5-ae96-40779ad51330 tempest-AbsoluteLimitsTests-611793088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eaee579-b3ff-4485-9043-121a7f4405be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-04c54d28-f93e-4153-90fd-48ddbaf366f0 tempest-GroupSnapshotsTest-2057849738 None] Lock "cinder-quobyte-3206c48f-d5cd-497d-b27d-fdd0b50f0b94" released by "_delete_snapshot" :: held 1.718s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-04c54d28-f93e-4153-90fd-48ddbaf366f0 tempest-GroupSnapshotsTest-2057849738 None] Lock "cinder-quobyte-0a1ca112-aae4-4afc-a381-1a32c2f44e3d" released by "delete_snapshot" :: held 1.756s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:20:58 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-93bfdb07-3e5e-49c5-ae96-40779ad51330 tempest-AbsoluteLimitsTests-611793088 None] Volume volume-19738cfe-7363-439a-ba81-5942f3b3a73c (19738cfe-7363-439a-ba81-5942f3b3a73c): created successfully Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-93bfdb07-3e5e-49c5-ae96-40779ad51330 tempest-AbsoluteLimitsTests-611793088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eaee579-b3ff-4485-9043-121a7f4405be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-93bfdb07-3e5e-49c5-ae96-40779ad51330 tempest-AbsoluteLimitsTests-611793088 None] Flow 'volume_create_manager' (88627e50-8dd0-4ca8-865d-f784b3b24d20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-04c54d28-f93e-4153-90fd-48ddbaf366f0 tempest-GroupSnapshotsTest-2057849738 None] Acquiring lock "cinder-quobyte-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:20:58 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-93bfdb07-3e5e-49c5-ae96-40779ad51330 tempest-AbsoluteLimitsTests-611793088 None] Created volume successfully. Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-04c54d28-f93e-4153-90fd-48ddbaf366f0 tempest-GroupSnapshotsTest-2057849738 None] Lock "cinder-quobyte-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-04c54d28-f93e-4153-90fd-48ddbaf366f0 tempest-GroupSnapshotsTest-2057849738 None] Acquiring lock "cinder-quobyte-aa567b35-b841-4a0c-8b33-0f531e8fa583" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-04c54d28-f93e-4153-90fd-48ddbaf366f0 tempest-GroupSnapshotsTest-2057849738 None] Lock "cinder-quobyte-aa567b35-b841-4a0c-8b33-0f531e8fa583" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-04c54d28-f93e-4153-90fd-48ddbaf366f0 tempest-GroupSnapshotsTest-2057849738 None] Deleting offline snapshot aa567b35-b841-4a0c-8b33-0f531e8fa583 of volume 97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-04c54d28-f93e-4153-90fd-48ddbaf366f0 tempest-GroupSnapshotsTest-2057849738 None] snapshot_file for this snap is: volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf.aa567b35-b841-4a0c-8b33-0f531e8fa583 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0fb3a3-9a2c-40fc-8ec7-f2d9fe73e52f]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-04c54d28-f93e-4153-90fd-48ddbaf366f0 tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf.aa567b35-b841-4a0c-8b33-0f531e8fa583 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:58 devstack sudo[96524]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7aec8657-1665-4396-9e68-ce3c0323d65a tempest-VolumesCloneNegativeTest-1231359595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-62a155e6-6e48-4f9d-9d95-3541a172b9da" returned: 0 in 0.383s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7aec8657-1665-4396-9e68-ce3c0323d65a tempest-VolumesCloneNegativeTest-1231359595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-62a155e6-6e48-4f9d-9d95-3541a172b9da {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:58 devstack sudo[96530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf.aa567b35-b841-4a0c-8b33-0f531e8fa583 Aug 31 15:20:58 devstack sudo[96530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:58 devstack sudo[96537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-62a155e6-6e48-4f9d-9d95-3541a172b9da Aug 31 15:20:58 devstack sudo[96537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:59 devstack sudo[96537]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7aec8657-1665-4396-9e68-ce3c0323d65a tempest-VolumesCloneNegativeTest-1231359595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-62a155e6-6e48-4f9d-9d95-3541a172b9da" returned: 0 in 0.283s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:59 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7aec8657-1665-4396-9e68-ce3c0323d65a tempest-VolumesCloneNegativeTest-1231359595 None] Lock "cinder-quobyte-62a155e6-6e48-4f9d-9d95-3541a172b9da" released by "delete_volume" :: held 0.710s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:20:59 devstack sudo[96527]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:59 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-f2356176-703b-4aeb-849d-4b872f5ed00b tempest-AbsoluteLimitsTests-611793088 None] Acquiring lock "cinder-19738cfe-7363-439a-ba81-5942f3b3a73c-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:20:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-11ad8bf5-4446-4750-bede-72b89462f539 tempest-VolumesListAdminTestJSON-1775751277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ddd4284a-c3ba-4d03-b9da-12840f27902f 1073741824" returned: 0 in 0.599s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:59 devstack sudo[96530]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:59 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-f2356176-703b-4aeb-849d-4b872f5ed00b tempest-AbsoluteLimitsTests-611793088 None] Lock "cinder-19738cfe-7363-439a-ba81-5942f3b3a73c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:20:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-04c54d28-f93e-4153-90fd-48ddbaf366f0 tempest-GroupSnapshotsTest-2057849738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf.aa567b35-b841-4a0c-8b33-0f531e8fa583" returned: 0 in 0.528s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:59 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-04c54d28-f93e-4153-90fd-48ddbaf366f0 tempest-GroupSnapshotsTest-2057849738 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:20:59 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb43f89e-57f9-445e-afb6-b5ac3fc79280]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:20:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-04c54d28-f93e-4153-90fd-48ddbaf366f0 tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-11ad8bf5-4446-4750-bede-72b89462f539 tempest-VolumesListAdminTestJSON-1775751277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ddd4284a-c3ba-4d03-b9da-12840f27902f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:59 devstack sudo[96546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ddd4284a-c3ba-4d03-b9da-12840f27902f Aug 31 15:20:59 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:59 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-7aec8657-1665-4396-9e68-ce3c0323d65a tempest-VolumesCloneNegativeTest-1231359595 None] Created reservations ['f09bc0f1-b8c2-4b3a-b521-373927479024', 'a76da4e2-1c70-44e2-b53c-96f30b7d492c', 'a389252f-9fee-4c8b-8c5b-11a2d636ea2f', 'afa09335-8d05-46e2-9e42-8ee398229b9a'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:20:59 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-f2356176-703b-4aeb-849d-4b872f5ed00b tempest-AbsoluteLimitsTests-611793088 None] Acquiring lock "cinder-quobyte-19738cfe-7363-439a-ba81-5942f3b3a73c" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:20:59 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-f2356176-703b-4aeb-849d-4b872f5ed00b tempest-AbsoluteLimitsTests-611793088 None] Lock "cinder-quobyte-19738cfe-7363-439a-ba81-5942f3b3a73c" acquired by "delete_volume" :: waited 0.036s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:20:59 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2fc115-f33a-4314-ad00-b42d07007ce5]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:20:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f2356176-703b-4aeb-849d-4b872f5ed00b tempest-AbsoluteLimitsTests-611793088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-19738cfe-7363-439a-ba81-5942f3b3a73c {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:59 devstack sudo[96545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf Aug 31 15:20:59 devstack sudo[96545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7aec8657-1665-4396-9e68-ce3c0323d65a tempest-VolumesCloneNegativeTest-1231359595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:20:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7aec8657-1665-4396-9e68-ce3c0323d65a tempest-VolumesCloneNegativeTest-1231359595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:20:59 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-7aec8657-1665-4396-9e68-ce3c0323d65a tempest-VolumesCloneNegativeTest-1231359595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:20:59 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-7aec8657-1665-4396-9e68-ce3c0323d65a tempest-VolumesCloneNegativeTest-1231359595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:20:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7aec8657-1665-4396-9e68-ce3c0323d65a tempest-VolumesCloneNegativeTest-1231359595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:20:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7aec8657-1665-4396-9e68-ce3c0323d65a tempest-VolumesCloneNegativeTest-1231359595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:59 devstack sudo[96551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:20:59 devstack sudo[96551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:59 devstack sudo[96550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-19738cfe-7363-439a-ba81-5942f3b3a73c Aug 31 15:20:59 devstack sudo[96550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:59 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-11ad8bf5-4446-4750-bede-72b89462f539 tempest-VolumesListAdminTestJSON-1775751277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ddd4284a-c3ba-4d03-b9da-12840f27902f" returned: 0 in 0.330s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:59 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-11ad8bf5-4446-4750-bede-72b89462f539 tempest-VolumesListAdminTestJSON-1775751277 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:20:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-11ad8bf5-4446-4750-bede-72b89462f539 tempest-VolumesListAdminTestJSON-1775751277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:20:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-11ad8bf5-4446-4750-bede-72b89462f539 tempest-VolumesListAdminTestJSON-1775751277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7f6c808-4d1e-4b95-b44f-050444b67511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddd4284a-c3ba-4d03-b9da-12840f27902f', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-11ad8bf5-4446-4750-bede-72b89462f539 tempest-VolumesListAdminTestJSON-1775751277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f93d601-a2de-4a93-993d-1914a427aa7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:20:59 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-11ad8bf5-4446-4750-bede-72b89462f539 tempest-VolumesListAdminTestJSON-1775751277 None] Volume volume-ddd4284a-c3ba-4d03-b9da-12840f27902f (ddd4284a-c3ba-4d03-b9da-12840f27902f): created successfully Aug 31 15:20:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-11ad8bf5-4446-4750-bede-72b89462f539 tempest-VolumesListAdminTestJSON-1775751277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f93d601-a2de-4a93-993d-1914a427aa7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:20:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-11ad8bf5-4446-4750-bede-72b89462f539 tempest-VolumesListAdminTestJSON-1775751277 None] Flow 'volume_create_manager' (6b31cfea-2928-4060-89c7-a08ef758746b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:20:59 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-11ad8bf5-4446-4750-bede-72b89462f539 tempest-VolumesListAdminTestJSON-1775751277 None] Created volume successfully. Aug 31 15:20:59 devstack sudo[96545]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-04c54d28-f93e-4153-90fd-48ddbaf366f0 tempest-GroupSnapshotsTest-2057849738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf" returned: 0 in 0.498s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-04c54d28-f93e-4153-90fd-48ddbaf366f0 tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf.aa567b35-b841-4a0c-8b33-0f531e8fa583 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:20:59 devstack sudo[96558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf.aa567b35-b841-4a0c-8b33-0f531e8fa583 Aug 31 15:20:59 devstack sudo[96558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:20:59 devstack sudo[96551]: pam_unix(sudo:session): session closed for user root Aug 31 15:20:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7aec8657-1665-4396-9e68-ce3c0323d65a tempest-VolumesCloneNegativeTest-1231359595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.345s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:20:59 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-7aec8657-1665-4396-9e68-ce3c0323d65a tempest-VolumesCloneNegativeTest-1231359595 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:20:59 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-7aec8657-1665-4396-9e68-ce3c0323d65a tempest-VolumesCloneNegativeTest-1231359595 None] Deleted volume successfully. Aug 31 15:20:59 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7aec8657-1665-4396-9e68-ce3c0323d65a tempest-VolumesCloneNegativeTest-1231359595 None] Lock "cinder-62a155e6-6e48-4f9d-9d95-3541a172b9da-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:21:00 devstack sudo[96550]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f2356176-703b-4aeb-849d-4b872f5ed00b tempest-AbsoluteLimitsTests-611793088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-19738cfe-7363-439a-ba81-5942f3b3a73c" returned: 0 in 0.535s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f2356176-703b-4aeb-849d-4b872f5ed00b tempest-AbsoluteLimitsTests-611793088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-19738cfe-7363-439a-ba81-5942f3b3a73c {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:00 devstack sudo[96564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-19738cfe-7363-439a-ba81-5942f3b3a73c Aug 31 15:21:00 devstack sudo[96564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:00 devstack sudo[96558]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-04c54d28-f93e-4153-90fd-48ddbaf366f0 tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf.aa567b35-b841-4a0c-8b33-0f531e8fa583" returned: 0 in 0.423s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-04c54d28-f93e-4153-90fd-48ddbaf366f0 tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf.aa567b35-b841-4a0c-8b33-0f531e8fa583 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:00 devstack sudo[96570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf.aa567b35-b841-4a0c-8b33-0f531e8fa583 Aug 31 15:21:00 devstack sudo[96570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:00 devstack sudo[96564]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f2356176-703b-4aeb-849d-4b872f5ed00b tempest-AbsoluteLimitsTests-611793088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-19738cfe-7363-439a-ba81-5942f3b3a73c" returned: 0 in 0.301s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:00 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-f2356176-703b-4aeb-849d-4b872f5ed00b tempest-AbsoluteLimitsTests-611793088 None] Lock "cinder-quobyte-19738cfe-7363-439a-ba81-5942f3b3a73c" released by "delete_volume" :: held 0.891s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:21:00 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-f2356176-703b-4aeb-849d-4b872f5ed00b tempest-AbsoluteLimitsTests-611793088 None] Created reservations ['966c9b6b-fa8b-45a5-b06a-99fe42106258', 'f657dc98-f1fc-4810-8dc7-abfe810fb9ce', '73dd243a-d7a4-46fe-a786-137460713df1', 'b643b391-a5ca-4b03-bd8d-e4e735408d85'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:21:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f2356176-703b-4aeb-849d-4b872f5ed00b tempest-AbsoluteLimitsTests-611793088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:21:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f2356176-703b-4aeb-849d-4b872f5ed00b tempest-AbsoluteLimitsTests-611793088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:21:00 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f2356176-703b-4aeb-849d-4b872f5ed00b tempest-AbsoluteLimitsTests-611793088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:21:00 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f2356176-703b-4aeb-849d-4b872f5ed00b tempest-AbsoluteLimitsTests-611793088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:21:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f2356176-703b-4aeb-849d-4b872f5ed00b tempest-AbsoluteLimitsTests-611793088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:21:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f2356176-703b-4aeb-849d-4b872f5ed00b tempest-AbsoluteLimitsTests-611793088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:00 devstack sudo[96572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:21:00 devstack sudo[96572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:00 devstack sudo[96570]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-04c54d28-f93e-4153-90fd-48ddbaf366f0 tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf.aa567b35-b841-4a0c-8b33-0f531e8fa583" returned: 0 in 0.411s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:00 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-04c54d28-f93e-4153-90fd-48ddbaf366f0 tempest-GroupSnapshotsTest-2057849738 None] Lock "cinder-quobyte-aa567b35-b841-4a0c-8b33-0f531e8fa583" released by "_delete_snapshot" :: held 1.972s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:21:00 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-04c54d28-f93e-4153-90fd-48ddbaf366f0 tempest-GroupSnapshotsTest-2057849738 None] Lock "cinder-quobyte-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf" released by "delete_snapshot" :: held 2.006s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:21:00 devstack cinder-volume[86000]: WARNING cinder.quota [None req-04c54d28-f93e-4153-90fd-48ddbaf366f0 tempest-GroupSnapshotsTest-2057849738 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-785517988 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-785517988, it is now deprecated. Please use the default quota class for default quota. Aug 31 15:21:00 devstack cinder-volume[86000]: WARNING cinder.quota [None req-04c54d28-f93e-4153-90fd-48ddbaf366f0 tempest-GroupSnapshotsTest-2057849738 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-785517988 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-785517988, it is now deprecated. Please use the default quota class for default quota. Aug 31 15:21:00 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-04c54d28-f93e-4153-90fd-48ddbaf366f0 tempest-GroupSnapshotsTest-2057849738 None] Created reservations ['fe2173c9-2784-474d-a166-7a6226d88847', '109e403d-57d3-4bf5-9cd9-0fae1b157777', '7b7b15d7-61e3-4fa1-bf7a-5966d6c16f28', 'a8896244-1105-48ee-8cf7-c917d610a5f5'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:21:00 devstack sudo[96572]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f2356176-703b-4aeb-849d-4b872f5ed00b tempest-AbsoluteLimitsTests-611793088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.370s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:00 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-f2356176-703b-4aeb-849d-4b872f5ed00b tempest-AbsoluteLimitsTests-611793088 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:21:00 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-f2356176-703b-4aeb-849d-4b872f5ed00b tempest-AbsoluteLimitsTests-611793088 None] Deleted volume successfully. Aug 31 15:21:00 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-f2356176-703b-4aeb-849d-4b872f5ed00b tempest-AbsoluteLimitsTests-611793088 None] Lock "cinder-19738cfe-7363-439a-ba81-5942f3b3a73c-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:21:01 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-04c54d28-f93e-4153-90fd-48ddbaf366f0 tempest-GroupSnapshotsTest-2057849738 None] Created reservations ['5fb0c808-c33a-4e98-b0cf-5389b0502fe6', 'd97b272a-7ca0-40b9-9d1c-37ea85131c0a', '1679e96a-8f65-450e-b626-4d23c8132dd3', '677cb73e-d69b-483d-b2ab-d67f0d67c96f'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:21:01 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-27312967-785f-4cb1-9c70-1bcc7d600ddc tempest-VolumesListAdminTestJSON-1775751277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:21:01 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-27312967-785f-4cb1-9c70-1bcc7d600ddc tempest-VolumesListAdminTestJSON-1775751277 None] Flow 'volume_create_manager' (f781fbd7-b6c7-439a-bd9e-01a9ebfdc894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:21:01 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-27312967-785f-4cb1-9c70-1bcc7d600ddc tempest-VolumesListAdminTestJSON-1775751277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13629ae0-1b48-4894-b2b3-99d87a355b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:01 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-27312967-785f-4cb1-9c70-1bcc7d600ddc tempest-VolumesListAdminTestJSON-1775751277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13629ae0-1b48-4894-b2b3-99d87a355b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-261813656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38d3fffd-2876-4e2f-b749-edb69c4004e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c060b65a8fcd4de8b38b5a16cbfeb5cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:21:01Z,use_quota=True,user_id='75445243a54d412a947b0b1d3c42a5c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:01 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-27312967-785f-4cb1-9c70-1bcc7d600ddc tempest-VolumesListAdminTestJSON-1775751277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41beceef-08c4-45cd-838b-a7424a74d147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:01 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-27312967-785f-4cb1-9c70-1bcc7d600ddc tempest-VolumesListAdminTestJSON-1775751277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41beceef-08c4-45cd-838b-a7424a74d147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:01 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-27312967-785f-4cb1-9c70-1bcc7d600ddc tempest-VolumesListAdminTestJSON-1775751277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52ce9014-0d20-4671-a78d-bb4e3de0e9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:01 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-27312967-785f-4cb1-9c70-1bcc7d600ddc tempest-VolumesListAdminTestJSON-1775751277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52ce9014-0d20-4671-a78d-bb4e3de0e9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38d3fffd-2876-4e2f-b749-edb69c4004e6', 'volume_name': 'volume-38d3fffd-2876-4e2f-b749-edb69c4004e6', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:01 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-27312967-785f-4cb1-9c70-1bcc7d600ddc tempest-VolumesListAdminTestJSON-1775751277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4494fa94-a681-4ed7-b039-be36ba184136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:01 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-27312967-785f-4cb1-9c70-1bcc7d600ddc tempest-VolumesListAdminTestJSON-1775751277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4494fa94-a681-4ed7-b039-be36ba184136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:01 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-27312967-785f-4cb1-9c70-1bcc7d600ddc tempest-VolumesListAdminTestJSON-1775751277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (599983e0-9a6a-4417-8331-676251fc0548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:01 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-27312967-785f-4cb1-9c70-1bcc7d600ddc tempest-VolumesListAdminTestJSON-1775751277 None] Volume 38d3fffd-2876-4e2f-b749-edb69c4004e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38d3fffd-2876-4e2f-b749-edb69c4004e6', 'volume_size': 1} Aug 31 15:21:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-27312967-785f-4cb1-9c70-1bcc7d600ddc tempest-VolumesListAdminTestJSON-1775751277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:21:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-27312967-785f-4cb1-9c70-1bcc7d600ddc tempest-VolumesListAdminTestJSON-1775751277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:21:01 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-27312967-785f-4cb1-9c70-1bcc7d600ddc tempest-VolumesListAdminTestJSON-1775751277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-261813656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38d3fffd-2876-4e2f-b749-edb69c4004e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c060b65a8fcd4de8b38b5a16cbfeb5cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:21:01Z,use_quota=True,user_id='75445243a54d412a947b0b1d3c42a5c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:21:01 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-27312967-785f-4cb1-9c70-1bcc7d600ddc tempest-VolumesListAdminTestJSON-1775751277 None] Creating volume 38d3fffd-2876-4e2f-b749-edb69c4004e6 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:21:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-27312967-785f-4cb1-9c70-1bcc7d600ddc tempest-VolumesListAdminTestJSON-1775751277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:21:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-27312967-785f-4cb1-9c70-1bcc7d600ddc tempest-VolumesListAdminTestJSON-1775751277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:21:01 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-27312967-785f-4cb1-9c70-1bcc7d600ddc tempest-VolumesListAdminTestJSON-1775751277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:21:01 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-27312967-785f-4cb1-9c70-1bcc7d600ddc tempest-VolumesListAdminTestJSON-1775751277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:21:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-27312967-785f-4cb1-9c70-1bcc7d600ddc tempest-VolumesListAdminTestJSON-1775751277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:21:01 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-27312967-785f-4cb1-9c70-1bcc7d600ddc tempest-VolumesListAdminTestJSON-1775751277 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:21:01 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-27312967-785f-4cb1-9c70-1bcc7d600ddc tempest-VolumesListAdminTestJSON-1775751277 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:21:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-27312967-785f-4cb1-9c70-1bcc7d600ddc tempest-VolumesListAdminTestJSON-1775751277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-38d3fffd-2876-4e2f-b749-edb69c4004e6 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:01 devstack sudo[96576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-38d3fffd-2876-4e2f-b749-edb69c4004e6 1073741824 Aug 31 15:21:01 devstack sudo[96576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:01 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-04c54d28-f93e-4153-90fd-48ddbaf366f0 tempest-GroupSnapshotsTest-2057849738 None] group_snapshot 97be3c00-db53-4276-ad1f-4edadee2809c: deleted successfully Aug 31 15:21:01 devstack sudo[96576]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-27312967-785f-4cb1-9c70-1bcc7d600ddc tempest-VolumesListAdminTestJSON-1775751277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-38d3fffd-2876-4e2f-b749-edb69c4004e6 1073741824" returned: 0 in 0.595s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-27312967-785f-4cb1-9c70-1bcc7d600ddc tempest-VolumesListAdminTestJSON-1775751277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-38d3fffd-2876-4e2f-b749-edb69c4004e6 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:01 devstack sudo[96582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-38d3fffd-2876-4e2f-b749-edb69c4004e6 Aug 31 15:21:01 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:01 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-190a25c7-89a1-4684-95b2-912e366dfe8d tempest-GroupSnapshotsTest-2057849738 None] Acquiring lock "cinder-quobyte-0a1ca112-aae4-4afc-a381-1a32c2f44e3d" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:21:01 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-190a25c7-89a1-4684-95b2-912e366dfe8d tempest-GroupSnapshotsTest-2057849738 None] Lock "cinder-quobyte-0a1ca112-aae4-4afc-a381-1a32c2f44e3d" acquired by "delete_volume" :: waited 0.044s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:21:02 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[433b3c23-58da-4716-a5ce-798ec296c709]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:21:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-190a25c7-89a1-4684-95b2-912e366dfe8d tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:02 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-27312967-785f-4cb1-9c70-1bcc7d600ddc tempest-VolumesListAdminTestJSON-1775751277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-38d3fffd-2876-4e2f-b749-edb69c4004e6" returned: 0 in 0.381s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:02 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-27312967-785f-4cb1-9c70-1bcc7d600ddc tempest-VolumesListAdminTestJSON-1775751277 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:21:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-27312967-785f-4cb1-9c70-1bcc7d600ddc tempest-VolumesListAdminTestJSON-1775751277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:21:02 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-27312967-785f-4cb1-9c70-1bcc7d600ddc tempest-VolumesListAdminTestJSON-1775751277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (599983e0-9a6a-4417-8331-676251fc0548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38d3fffd-2876-4e2f-b749-edb69c4004e6', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:02 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-27312967-785f-4cb1-9c70-1bcc7d600ddc tempest-VolumesListAdminTestJSON-1775751277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad5ea06f-c37c-4b66-840a-611f7e0b2c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:02 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-27312967-785f-4cb1-9c70-1bcc7d600ddc tempest-VolumesListAdminTestJSON-1775751277 None] Volume volume-38d3fffd-2876-4e2f-b749-edb69c4004e6 (38d3fffd-2876-4e2f-b749-edb69c4004e6): created successfully Aug 31 15:21:02 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-27312967-785f-4cb1-9c70-1bcc7d600ddc tempest-VolumesListAdminTestJSON-1775751277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad5ea06f-c37c-4b66-840a-611f7e0b2c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:02 devstack sudo[96584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d Aug 31 15:21:02 devstack sudo[96584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:02 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-27312967-785f-4cb1-9c70-1bcc7d600ddc tempest-VolumesListAdminTestJSON-1775751277 None] Flow 'volume_create_manager' (f781fbd7-b6c7-439a-bd9e-01a9ebfdc894) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:21:02 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-27312967-785f-4cb1-9c70-1bcc7d600ddc tempest-VolumesListAdminTestJSON-1775751277 None] Created volume successfully. Aug 31 15:21:02 devstack sudo[96584]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-190a25c7-89a1-4684-95b2-912e366dfe8d tempest-GroupSnapshotsTest-2057849738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d" returned: 0 in 0.450s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-190a25c7-89a1-4684-95b2-912e366dfe8d tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:02 devstack sudo[96590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d Aug 31 15:21:02 devstack sudo[96590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:02 devstack sudo[96590]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-190a25c7-89a1-4684-95b2-912e366dfe8d tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0a1ca112-aae4-4afc-a381-1a32c2f44e3d" returned: 0 in 0.274s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:02 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-190a25c7-89a1-4684-95b2-912e366dfe8d tempest-GroupSnapshotsTest-2057849738 None] Lock "cinder-quobyte-0a1ca112-aae4-4afc-a381-1a32c2f44e3d" released by "delete_volume" :: held 0.820s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:21:02 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-190a25c7-89a1-4684-95b2-912e366dfe8d tempest-GroupSnapshotsTest-2057849738 None] Acquiring lock "cinder-quobyte-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:21:02 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-190a25c7-89a1-4684-95b2-912e366dfe8d tempest-GroupSnapshotsTest-2057849738 None] Lock "cinder-quobyte-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf" acquired by "delete_volume" :: waited 0.021s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:21:02 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[24999aca-fb60-4475-8dd7-89025550a6e0]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:21:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-190a25c7-89a1-4684-95b2-912e366dfe8d tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:02 devstack sudo[96593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf Aug 31 15:21:02 devstack sudo[96593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:03 devstack sudo[96593]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-190a25c7-89a1-4684-95b2-912e366dfe8d tempest-GroupSnapshotsTest-2057849738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf" returned: 0 in 0.561s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-190a25c7-89a1-4684-95b2-912e366dfe8d tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:03 devstack sudo[96598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf Aug 31 15:21:03 devstack sudo[96598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:03 devstack sudo[96598]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-190a25c7-89a1-4684-95b2-912e366dfe8d tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf" returned: 0 in 0.327s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:03 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-190a25c7-89a1-4684-95b2-912e366dfe8d tempest-GroupSnapshotsTest-2057849738 None] Lock "cinder-quobyte-97cfc4e1-5f6b-4ee7-9a83-4a7246ff8dbf" released by "delete_volume" :: held 0.968s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:21:03 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-190a25c7-89a1-4684-95b2-912e366dfe8d tempest-GroupSnapshotsTest-2057849738 None] Created reservations ['518b71e3-9a50-4ea2-809d-e9cb761fae35'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:21:03 devstack cinder-volume[86000]: WARNING cinder.quota [None req-190a25c7-89a1-4684-95b2-912e366dfe8d tempest-GroupSnapshotsTest-2057849738 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-785517988 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-785517988, it is now deprecated. Please use the default quota class for default quota. Aug 31 15:21:03 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-190a25c7-89a1-4684-95b2-912e366dfe8d tempest-GroupSnapshotsTest-2057849738 None] Created reservations ['727ca0c9-d4ac-4985-a5fd-7654678fa73f', '17eea28c-6c50-480d-a91a-e9bb258ab2e8', '7bb33886-c4df-46cf-865d-e533d4e379a5', '82743cb6-2937-48e3-ab4e-b8f67e64163b'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:21:04 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-190a25c7-89a1-4684-95b2-912e366dfe8d tempest-GroupSnapshotsTest-2057849738 None] Created reservations ['1310469c-38ce-4fda-a4e2-b39dbf820750', '74884b7f-74ac-4fae-af85-7c8c20d0a366', '9b8f6673-853b-49ce-8cde-96933f62ec58', '373839fc-a413-4761-bb58-1614324fbd41'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:21:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-190a25c7-89a1-4684-95b2-912e366dfe8d tempest-GroupSnapshotsTest-2057849738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:21:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-190a25c7-89a1-4684-95b2-912e366dfe8d tempest-GroupSnapshotsTest-2057849738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:21:04 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-190a25c7-89a1-4684-95b2-912e366dfe8d tempest-GroupSnapshotsTest-2057849738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:21:04 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-190a25c7-89a1-4684-95b2-912e366dfe8d tempest-GroupSnapshotsTest-2057849738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:21:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-190a25c7-89a1-4684-95b2-912e366dfe8d tempest-GroupSnapshotsTest-2057849738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:21:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-190a25c7-89a1-4684-95b2-912e366dfe8d tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:04 devstack sudo[96601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:21:04 devstack sudo[96601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:04 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fb58aeb-9e5d-455a-b937-793c4ecb2d76 tempest-VolumesListAdminTestJSON-400973015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:21:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6fb58aeb-9e5d-455a-b937-793c4ecb2d76 tempest-VolumesListAdminTestJSON-400973015 None] Flow 'volume_create_manager' (09a7ec3a-b241-4c8a-bfd3-e916b902a0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:21:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6fb58aeb-9e5d-455a-b937-793c4ecb2d76 tempest-VolumesListAdminTestJSON-400973015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e027542-2593-474d-821f-a5d0e9802592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6fb58aeb-9e5d-455a-b937-793c4ecb2d76 tempest-VolumesListAdminTestJSON-400973015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e027542-2593-474d-821f-a5d0e9802592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:21:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dde698e9-7a0d-45a0-a499-f2305625721f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b06ec79ba1415589bc6245fabf40c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:21:04Z,use_quota=True,user_id='0fb06e397b314bf6910e04b7eb6cbcea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6fb58aeb-9e5d-455a-b937-793c4ecb2d76 tempest-VolumesListAdminTestJSON-400973015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (034b4a0d-7379-4df9-adec-59178d5e11e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6fb58aeb-9e5d-455a-b937-793c4ecb2d76 tempest-VolumesListAdminTestJSON-400973015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (034b4a0d-7379-4df9-adec-59178d5e11e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6fb58aeb-9e5d-455a-b937-793c4ecb2d76 tempest-VolumesListAdminTestJSON-400973015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31c1f621-69fb-4e09-a181-0664ddcb277e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6fb58aeb-9e5d-455a-b937-793c4ecb2d76 tempest-VolumesListAdminTestJSON-400973015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31c1f621-69fb-4e09-a181-0664ddcb277e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dde698e9-7a0d-45a0-a499-f2305625721f', 'volume_name': 'volume-dde698e9-7a0d-45a0-a499-f2305625721f', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6fb58aeb-9e5d-455a-b937-793c4ecb2d76 tempest-VolumesListAdminTestJSON-400973015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d685f4b-13ac-46d2-9a7e-3f5d8ff4e530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6fb58aeb-9e5d-455a-b937-793c4ecb2d76 tempest-VolumesListAdminTestJSON-400973015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d685f4b-13ac-46d2-9a7e-3f5d8ff4e530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6fb58aeb-9e5d-455a-b937-793c4ecb2d76 tempest-VolumesListAdminTestJSON-400973015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86023f9d-5d29-45a9-b9e9-2413f6276693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:04 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-6fb58aeb-9e5d-455a-b937-793c4ecb2d76 tempest-VolumesListAdminTestJSON-400973015 None] Volume dde698e9-7a0d-45a0-a499-f2305625721f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dde698e9-7a0d-45a0-a499-f2305625721f', 'volume_size': 1} Aug 31 15:21:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6fb58aeb-9e5d-455a-b937-793c4ecb2d76 tempest-VolumesListAdminTestJSON-400973015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:21:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6fb58aeb-9e5d-455a-b937-793c4ecb2d76 tempest-VolumesListAdminTestJSON-400973015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:21:04 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6fb58aeb-9e5d-455a-b937-793c4ecb2d76 tempest-VolumesListAdminTestJSON-400973015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:21:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dde698e9-7a0d-45a0-a499-f2305625721f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b06ec79ba1415589bc6245fabf40c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:21:04Z,use_quota=True,user_id='0fb06e397b314bf6910e04b7eb6cbcea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:21:04 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-6fb58aeb-9e5d-455a-b937-793c4ecb2d76 tempest-VolumesListAdminTestJSON-400973015 None] Creating volume dde698e9-7a0d-45a0-a499-f2305625721f {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:21:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6fb58aeb-9e5d-455a-b937-793c4ecb2d76 tempest-VolumesListAdminTestJSON-400973015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:21:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6fb58aeb-9e5d-455a-b937-793c4ecb2d76 tempest-VolumesListAdminTestJSON-400973015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:21:04 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6fb58aeb-9e5d-455a-b937-793c4ecb2d76 tempest-VolumesListAdminTestJSON-400973015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:21:04 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6fb58aeb-9e5d-455a-b937-793c4ecb2d76 tempest-VolumesListAdminTestJSON-400973015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:21:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6fb58aeb-9e5d-455a-b937-793c4ecb2d76 tempest-VolumesListAdminTestJSON-400973015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:21:04 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6fb58aeb-9e5d-455a-b937-793c4ecb2d76 tempest-VolumesListAdminTestJSON-400973015 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:21:04 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-6fb58aeb-9e5d-455a-b937-793c4ecb2d76 tempest-VolumesListAdminTestJSON-400973015 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:21:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6fb58aeb-9e5d-455a-b937-793c4ecb2d76 tempest-VolumesListAdminTestJSON-400973015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-dde698e9-7a0d-45a0-a499-f2305625721f 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:04 devstack sudo[96601]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-190a25c7-89a1-4684-95b2-912e366dfe8d tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.560s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:04 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-190a25c7-89a1-4684-95b2-912e366dfe8d tempest-GroupSnapshotsTest-2057849738 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:21:04 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-190a25c7-89a1-4684-95b2-912e366dfe8d tempest-GroupSnapshotsTest-2057849738 None] Delete group completed successfully. Aug 31 15:21:04 devstack sudo[96604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-dde698e9-7a0d-45a0-a499-f2305625721f 1073741824 Aug 31 15:21:04 devstack sudo[96604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:05 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-ee03e5d0-ebfe-4d7c-8e16-dd2ffb8adcb9 tempest-GroupSnapshotsTest-2057849738 None] Group tempest-GroupSnapshotsTest-Group-1555929826: creating Aug 31 15:21:05 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-ee03e5d0-ebfe-4d7c-8e16-dd2ffb8adcb9 tempest-GroupSnapshotsTest-2057849738 None] Group tempest-GroupSnapshotsTest-Group-1555929826: created successfully Aug 31 15:21:05 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-ee03e5d0-ebfe-4d7c-8e16-dd2ffb8adcb9 tempest-GroupSnapshotsTest-2057849738 None] Create group completed successfully. Aug 31 15:21:05 devstack sudo[96604]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6fb58aeb-9e5d-455a-b937-793c4ecb2d76 tempest-VolumesListAdminTestJSON-400973015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-dde698e9-7a0d-45a0-a499-f2305625721f 1073741824" returned: 0 in 0.586s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6fb58aeb-9e5d-455a-b937-793c4ecb2d76 tempest-VolumesListAdminTestJSON-400973015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-dde698e9-7a0d-45a0-a499-f2305625721f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:05 devstack sudo[96610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-dde698e9-7a0d-45a0-a499-f2305625721f Aug 31 15:21:05 devstack sudo[96610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:05 devstack sudo[96610]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6fb58aeb-9e5d-455a-b937-793c4ecb2d76 tempest-VolumesListAdminTestJSON-400973015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-dde698e9-7a0d-45a0-a499-f2305625721f" returned: 0 in 0.291s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:05 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6fb58aeb-9e5d-455a-b937-793c4ecb2d76 tempest-VolumesListAdminTestJSON-400973015 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:21:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6fb58aeb-9e5d-455a-b937-793c4ecb2d76 tempest-VolumesListAdminTestJSON-400973015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:21:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6fb58aeb-9e5d-455a-b937-793c4ecb2d76 tempest-VolumesListAdminTestJSON-400973015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86023f9d-5d29-45a9-b9e9-2413f6276693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dde698e9-7a0d-45a0-a499-f2305625721f', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6fb58aeb-9e5d-455a-b937-793c4ecb2d76 tempest-VolumesListAdminTestJSON-400973015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db4ee057-8be9-4cf8-bd02-bddc960d247f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:05 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-6fb58aeb-9e5d-455a-b937-793c4ecb2d76 tempest-VolumesListAdminTestJSON-400973015 None] Volume volume-dde698e9-7a0d-45a0-a499-f2305625721f (dde698e9-7a0d-45a0-a499-f2305625721f): created successfully Aug 31 15:21:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6fb58aeb-9e5d-455a-b937-793c4ecb2d76 tempest-VolumesListAdminTestJSON-400973015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db4ee057-8be9-4cf8-bd02-bddc960d247f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6fb58aeb-9e5d-455a-b937-793c4ecb2d76 tempest-VolumesListAdminTestJSON-400973015 None] Flow 'volume_create_manager' (09a7ec3a-b241-4c8a-bfd3-e916b902a0c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:21:05 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-6fb58aeb-9e5d-455a-b937-793c4ecb2d76 tempest-VolumesListAdminTestJSON-400973015 None] Created volume successfully. Aug 31 15:21:06 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-deeee96f-f857-4eb7-8da6-f38d6572cd73 tempest-VolumesDeleteCascade-853061173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:21:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-deeee96f-f857-4eb7-8da6-f38d6572cd73 tempest-VolumesDeleteCascade-853061173 None] Flow 'volume_create_manager' (fabe6525-aa77-41c9-84f2-2dc2b2cf8a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:21:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-deeee96f-f857-4eb7-8da6-f38d6572cd73 tempest-VolumesDeleteCascade-853061173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1295c690-d891-425e-8972-c085769b45a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:06 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-43b0ab36-41ce-4149-a238-5e11411f16f1 tempest-VolumesListAdminTestJSON-400973015 None] Acquiring lock "cinder-dde698e9-7a0d-45a0-a499-f2305625721f-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:21:06 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-43b0ab36-41ce-4149-a238-5e11411f16f1 tempest-VolumesListAdminTestJSON-400973015 None] Lock "cinder-dde698e9-7a0d-45a0-a499-f2305625721f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:21:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-deeee96f-f857-4eb7-8da6-f38d6572cd73 tempest-VolumesDeleteCascade-853061173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1295c690-d891-425e-8972-c085769b45a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-431923329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34414d15-c502-468c-80e9-29b226e9adc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6327f302d19d4be3bd563f33a327f576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:21:07Z,use_quota=True,user_id='0d5716deed304813b32a716326b7d3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-deeee96f-f857-4eb7-8da6-f38d6572cd73 tempest-VolumesDeleteCascade-853061173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dfecfa7-ecf9-4927-812e-e3f2342e3a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-deeee96f-f857-4eb7-8da6-f38d6572cd73 tempest-VolumesDeleteCascade-853061173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dfecfa7-ecf9-4927-812e-e3f2342e3a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-deeee96f-f857-4eb7-8da6-f38d6572cd73 tempest-VolumesDeleteCascade-853061173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (228d4ac5-4025-4cdc-b403-b4b0127bef61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-deeee96f-f857-4eb7-8da6-f38d6572cd73 tempest-VolumesDeleteCascade-853061173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (228d4ac5-4025-4cdc-b403-b4b0127bef61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34414d15-c502-468c-80e9-29b226e9adc8', 'volume_name': 'volume-34414d15-c502-468c-80e9-29b226e9adc8', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-deeee96f-f857-4eb7-8da6-f38d6572cd73 tempest-VolumesDeleteCascade-853061173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34fc167f-14d4-4b6e-943d-95f226791c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-deeee96f-f857-4eb7-8da6-f38d6572cd73 tempest-VolumesDeleteCascade-853061173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34fc167f-14d4-4b6e-943d-95f226791c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-deeee96f-f857-4eb7-8da6-f38d6572cd73 tempest-VolumesDeleteCascade-853061173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a25b6cb-ed72-44c3-aefe-8e0e77c514f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:07 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-deeee96f-f857-4eb7-8da6-f38d6572cd73 tempest-VolumesDeleteCascade-853061173 None] Volume 34414d15-c502-468c-80e9-29b226e9adc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34414d15-c502-468c-80e9-29b226e9adc8', 'volume_size': 1} Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-deeee96f-f857-4eb7-8da6-f38d6572cd73 tempest-VolumesDeleteCascade-853061173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-deeee96f-f857-4eb7-8da6-f38d6572cd73 tempest-VolumesDeleteCascade-853061173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-deeee96f-f857-4eb7-8da6-f38d6572cd73 tempest-VolumesDeleteCascade-853061173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-431923329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34414d15-c502-468c-80e9-29b226e9adc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6327f302d19d4be3bd563f33a327f576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:21:07Z,use_quota=True,user_id='0d5716deed304813b32a716326b7d3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-deeee96f-f857-4eb7-8da6-f38d6572cd73 tempest-VolumesDeleteCascade-853061173 None] Creating volume 34414d15-c502-468c-80e9-29b226e9adc8 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-deeee96f-f857-4eb7-8da6-f38d6572cd73 tempest-VolumesDeleteCascade-853061173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-deeee96f-f857-4eb7-8da6-f38d6572cd73 tempest-VolumesDeleteCascade-853061173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-deeee96f-f857-4eb7-8da6-f38d6572cd73 tempest-VolumesDeleteCascade-853061173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-deeee96f-f857-4eb7-8da6-f38d6572cd73 tempest-VolumesDeleteCascade-853061173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-deeee96f-f857-4eb7-8da6-f38d6572cd73 tempest-VolumesDeleteCascade-853061173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-deeee96f-f857-4eb7-8da6-f38d6572cd73 tempest-VolumesDeleteCascade-853061173 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:21:07 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-deeee96f-f857-4eb7-8da6-f38d6572cd73 tempest-VolumesDeleteCascade-853061173 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-deeee96f-f857-4eb7-8da6-f38d6572cd73 tempest-VolumesDeleteCascade-853061173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a145bf81-40cc-4f77-8683-db727265be3c tempest-VolumesListAdminTestJSON-1775751277 None] Acquiring lock "cinder-38d3fffd-2876-4e2f-b749-edb69c4004e6-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:21:07 devstack sudo[96614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8 1073741824 Aug 31 15:21:07 devstack sudo[96614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-43b0ab36-41ce-4149-a238-5e11411f16f1 tempest-VolumesListAdminTestJSON-400973015 None] Acquiring lock "cinder-quobyte-dde698e9-7a0d-45a0-a499-f2305625721f" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a145bf81-40cc-4f77-8683-db727265be3c tempest-VolumesListAdminTestJSON-1775751277 None] Lock "cinder-38d3fffd-2876-4e2f-b749-edb69c4004e6-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-6da32fbc-e58f-4666-a4f9-95fad5a80dcf tempest-GroupSnapshotsTest-2057849738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6da32fbc-e58f-4666-a4f9-95fad5a80dcf tempest-GroupSnapshotsTest-2057849738 None] Flow 'volume_create_manager' (fe20b39e-33fe-41e5-9532-03bbfc33144d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6da32fbc-e58f-4666-a4f9-95fad5a80dcf tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6efeb810-3249-4b42-b6d1-24252b6d5b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-43b0ab36-41ce-4149-a238-5e11411f16f1 tempest-VolumesListAdminTestJSON-400973015 None] Lock "cinder-quobyte-dde698e9-7a0d-45a0-a499-f2305625721f" acquired by "delete_volume" :: waited 0.075s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6da32fbc-e58f-4666-a4f9-95fad5a80dcf tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6efeb810-3249-4b42-b6d1-24252b6d5b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1101778670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=48f43ceb-9748-4dac-96c2-fb5062c27c98,host='devstack@QuobyteHD#QuobyteHD',id=eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1729177f36914ba782887f84390b3cf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:21:07Z,use_quota=True,user_id='51779a9573da46cbaf455bdf61cbcd84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e502cec8-db49-4b5e-a236-b1956cfc2e34),volume_type_id=e502cec8-db49-4b5e-a236-b1956cfc2e34)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6da32fbc-e58f-4666-a4f9-95fad5a80dcf tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ae88897-6262-4c23-9983-8680d08a8afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6da32fbc-e58f-4666-a4f9-95fad5a80dcf tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ae88897-6262-4c23-9983-8680d08a8afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6da32fbc-e58f-4666-a4f9-95fad5a80dcf tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13aa87ad-72a5-4c5f-a4fa-a1572276576b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6da32fbc-e58f-4666-a4f9-95fad5a80dcf tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13aa87ad-72a5-4c5f-a4fa-a1572276576b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d', 'volume_name': 'volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6da32fbc-e58f-4666-a4f9-95fad5a80dcf tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36598d5b-206f-48cb-b9b5-cc33fc8c7138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6da32fbc-e58f-4666-a4f9-95fad5a80dcf tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36598d5b-206f-48cb-b9b5-cc33fc8c7138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6da32fbc-e58f-4666-a4f9-95fad5a80dcf tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7976b46-25cf-4f10-b52c-2dc60c623e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:07 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-6da32fbc-e58f-4666-a4f9-95fad5a80dcf tempest-GroupSnapshotsTest-2057849738 None] Volume eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d', 'volume_size': 1} Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6da32fbc-e58f-4666-a4f9-95fad5a80dcf tempest-GroupSnapshotsTest-2057849738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd296ab9-2a34-4c11-a92f-37977fe2a7ec]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-43b0ab36-41ce-4149-a238-5e11411f16f1 tempest-VolumesListAdminTestJSON-400973015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-dde698e9-7a0d-45a0-a499-f2305625721f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a145bf81-40cc-4f77-8683-db727265be3c tempest-VolumesListAdminTestJSON-1775751277 None] Acquiring lock "cinder-quobyte-38d3fffd-2876-4e2f-b749-edb69c4004e6" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a145bf81-40cc-4f77-8683-db727265be3c tempest-VolumesListAdminTestJSON-1775751277 None] Lock "cinder-quobyte-38d3fffd-2876-4e2f-b749-edb69c4004e6" acquired by "delete_volume" :: waited 0.022s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:21:07 devstack sudo[96616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-dde698e9-7a0d-45a0-a499-f2305625721f Aug 31 15:21:07 devstack sudo[96616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7929926-7e26-4764-acd2-759372b809ab]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a145bf81-40cc-4f77-8683-db727265be3c tempest-VolumesListAdminTestJSON-1775751277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-38d3fffd-2876-4e2f-b749-edb69c4004e6 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:07 devstack sudo[96621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-38d3fffd-2876-4e2f-b749-edb69c4004e6 Aug 31 15:21:07 devstack sudo[96621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:07 devstack sudo[96614]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-deeee96f-f857-4eb7-8da6-f38d6572cd73 tempest-VolumesDeleteCascade-853061173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8 1073741824" returned: 0 in 0.642s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-deeee96f-f857-4eb7-8da6-f38d6572cd73 tempest-VolumesDeleteCascade-853061173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:07 devstack sudo[96627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8 Aug 31 15:21:07 devstack sudo[96627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:07 devstack sudo[96616]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-43b0ab36-41ce-4149-a238-5e11411f16f1 tempest-VolumesListAdminTestJSON-400973015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-dde698e9-7a0d-45a0-a499-f2305625721f" returned: 0 in 0.471s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-43b0ab36-41ce-4149-a238-5e11411f16f1 tempest-VolumesListAdminTestJSON-400973015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-dde698e9-7a0d-45a0-a499-f2305625721f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:07 devstack sudo[96629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-dde698e9-7a0d-45a0-a499-f2305625721f Aug 31 15:21:07 devstack sudo[96629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:07 devstack sudo[96621]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a145bf81-40cc-4f77-8683-db727265be3c tempest-VolumesListAdminTestJSON-1775751277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-38d3fffd-2876-4e2f-b749-edb69c4004e6" returned: 0 in 0.462s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a145bf81-40cc-4f77-8683-db727265be3c tempest-VolumesListAdminTestJSON-1775751277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-38d3fffd-2876-4e2f-b749-edb69c4004e6 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:08 devstack sudo[96635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-38d3fffd-2876-4e2f-b749-edb69c4004e6 Aug 31 15:21:08 devstack sudo[96635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:08 devstack sudo[96627]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-deeee96f-f857-4eb7-8da6-f38d6572cd73 tempest-VolumesDeleteCascade-853061173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8" returned: 0 in 0.270s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:08 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-deeee96f-f857-4eb7-8da6-f38d6572cd73 tempest-VolumesDeleteCascade-853061173 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:21:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-deeee96f-f857-4eb7-8da6-f38d6572cd73 tempest-VolumesDeleteCascade-853061173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:21:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6da32fbc-e58f-4666-a4f9-95fad5a80dcf tempest-GroupSnapshotsTest-2057849738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.713s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:21:08 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6da32fbc-e58f-4666-a4f9-95fad5a80dcf tempest-GroupSnapshotsTest-2057849738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=48f43ceb-9748-4dac-96c2-fb5062c27c98,created_at=2026-08-31T13:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1101778670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=48f43ceb-9748-4dac-96c2-fb5062c27c98,host='devstack@QuobyteHD#QuobyteHD',id=eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1729177f36914ba782887f84390b3cf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:21:07Z,use_quota=True,user_id='51779a9573da46cbaf455bdf61cbcd84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e502cec8-db49-4b5e-a236-b1956cfc2e34),volume_type_id=e502cec8-db49-4b5e-a236-b1956cfc2e34)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:21:08 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-6da32fbc-e58f-4666-a4f9-95fad5a80dcf tempest-GroupSnapshotsTest-2057849738 None] Creating volume eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:21:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6da32fbc-e58f-4666-a4f9-95fad5a80dcf tempest-GroupSnapshotsTest-2057849738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:21:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6da32fbc-e58f-4666-a4f9-95fad5a80dcf tempest-GroupSnapshotsTest-2057849738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:21:08 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6da32fbc-e58f-4666-a4f9-95fad5a80dcf tempest-GroupSnapshotsTest-2057849738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:21:08 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6da32fbc-e58f-4666-a4f9-95fad5a80dcf tempest-GroupSnapshotsTest-2057849738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:21:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6da32fbc-e58f-4666-a4f9-95fad5a80dcf tempest-GroupSnapshotsTest-2057849738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:21:08 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6da32fbc-e58f-4666-a4f9-95fad5a80dcf tempest-GroupSnapshotsTest-2057849738 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:21:08 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-6da32fbc-e58f-4666-a4f9-95fad5a80dcf tempest-GroupSnapshotsTest-2057849738 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:21:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6da32fbc-e58f-4666-a4f9-95fad5a80dcf tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:08 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-deeee96f-f857-4eb7-8da6-f38d6572cd73 tempest-VolumesDeleteCascade-853061173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a25b6cb-ed72-44c3-aefe-8e0e77c514f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34414d15-c502-468c-80e9-29b226e9adc8', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:08 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-deeee96f-f857-4eb7-8da6-f38d6572cd73 tempest-VolumesDeleteCascade-853061173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28cc6cb5-4e73-4af5-9beb-cae80f83dbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:08 devstack sudo[96638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d 1073741824 Aug 31 15:21:08 devstack sudo[96638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:08 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-deeee96f-f857-4eb7-8da6-f38d6572cd73 tempest-VolumesDeleteCascade-853061173 None] Volume volume-34414d15-c502-468c-80e9-29b226e9adc8 (34414d15-c502-468c-80e9-29b226e9adc8): created successfully Aug 31 15:21:08 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-deeee96f-f857-4eb7-8da6-f38d6572cd73 tempest-VolumesDeleteCascade-853061173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28cc6cb5-4e73-4af5-9beb-cae80f83dbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:08 devstack sudo[96629]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:08 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-deeee96f-f857-4eb7-8da6-f38d6572cd73 tempest-VolumesDeleteCascade-853061173 None] Flow 'volume_create_manager' (fabe6525-aa77-41c9-84f2-2dc2b2cf8a13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:21:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-43b0ab36-41ce-4149-a238-5e11411f16f1 tempest-VolumesListAdminTestJSON-400973015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-dde698e9-7a0d-45a0-a499-f2305625721f" returned: 0 in 0.319s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:08 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-43b0ab36-41ce-4149-a238-5e11411f16f1 tempest-VolumesListAdminTestJSON-400973015 None] Lock "cinder-quobyte-dde698e9-7a0d-45a0-a499-f2305625721f" released by "delete_volume" :: held 0.892s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:21:08 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-deeee96f-f857-4eb7-8da6-f38d6572cd73 tempest-VolumesDeleteCascade-853061173 None] Created volume successfully. Aug 31 15:21:08 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-43b0ab36-41ce-4149-a238-5e11411f16f1 tempest-VolumesListAdminTestJSON-400973015 None] Created reservations ['4816be7b-1977-4459-b2bf-a764d7431625', 'fbc42d53-c477-4d17-8b88-49ccd4625985', '45554506-aa68-453c-8692-c4fd19ffba05', '8efe7c2d-c77a-4d30-ae92-6f12ffcabb00'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:21:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-43b0ab36-41ce-4149-a238-5e11411f16f1 tempest-VolumesListAdminTestJSON-400973015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:21:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-43b0ab36-41ce-4149-a238-5e11411f16f1 tempest-VolumesListAdminTestJSON-400973015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:21:08 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-43b0ab36-41ce-4149-a238-5e11411f16f1 tempest-VolumesListAdminTestJSON-400973015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:21:08 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-43b0ab36-41ce-4149-a238-5e11411f16f1 tempest-VolumesListAdminTestJSON-400973015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:21:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-43b0ab36-41ce-4149-a238-5e11411f16f1 tempest-VolumesListAdminTestJSON-400973015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:21:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-43b0ab36-41ce-4149-a238-5e11411f16f1 tempest-VolumesListAdminTestJSON-400973015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:08 devstack sudo[96635]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a145bf81-40cc-4f77-8683-db727265be3c tempest-VolumesListAdminTestJSON-1775751277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-38d3fffd-2876-4e2f-b749-edb69c4004e6" returned: 0 in 0.427s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:08 devstack sudo[96641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:21:08 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:08 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a145bf81-40cc-4f77-8683-db727265be3c tempest-VolumesListAdminTestJSON-1775751277 None] Lock "cinder-quobyte-38d3fffd-2876-4e2f-b749-edb69c4004e6" released by "delete_volume" :: held 0.968s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:21:08 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-a145bf81-40cc-4f77-8683-db727265be3c tempest-VolumesListAdminTestJSON-1775751277 None] Created reservations ['1faa516b-4d96-441f-9e9a-f41eeeb396f4', 'da592bdf-7220-48dd-90cb-6f1035cc81ec', 'd01669ff-3346-4da1-84b7-a81934c76083', '7967905a-ad61-4cd3-82fa-f04add0edb9e'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:21:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-a145bf81-40cc-4f77-8683-db727265be3c tempest-VolumesListAdminTestJSON-1775751277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:21:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-a145bf81-40cc-4f77-8683-db727265be3c tempest-VolumesListAdminTestJSON-1775751277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:21:08 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-a145bf81-40cc-4f77-8683-db727265be3c tempest-VolumesListAdminTestJSON-1775751277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:21:08 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-a145bf81-40cc-4f77-8683-db727265be3c tempest-VolumesListAdminTestJSON-1775751277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:21:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-a145bf81-40cc-4f77-8683-db727265be3c tempest-VolumesListAdminTestJSON-1775751277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:21:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a145bf81-40cc-4f77-8683-db727265be3c tempest-VolumesListAdminTestJSON-1775751277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:08 devstack sudo[96646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:21:08 devstack sudo[96646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:08 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-43b0ab36-41ce-4149-a238-5e11411f16f1 tempest-VolumesListAdminTestJSON-400973015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.288s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:08 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-43b0ab36-41ce-4149-a238-5e11411f16f1 tempest-VolumesListAdminTestJSON-400973015 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:21:08 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-43b0ab36-41ce-4149-a238-5e11411f16f1 tempest-VolumesListAdminTestJSON-400973015 None] Deleted volume successfully. Aug 31 15:21:08 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-43b0ab36-41ce-4149-a238-5e11411f16f1 tempest-VolumesListAdminTestJSON-400973015 None] Lock "cinder-dde698e9-7a0d-45a0-a499-f2305625721f-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:21:08 devstack sudo[96638]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6da32fbc-e58f-4666-a4f9-95fad5a80dcf tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d 1073741824" returned: 0 in 0.704s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6da32fbc-e58f-4666-a4f9-95fad5a80dcf tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:08 devstack sudo[96650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d Aug 31 15:21:08 devstack sudo[96650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:08 devstack sudo[96646]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a145bf81-40cc-4f77-8683-db727265be3c tempest-VolumesListAdminTestJSON-1775751277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.311s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:08 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-a145bf81-40cc-4f77-8683-db727265be3c tempest-VolumesListAdminTestJSON-1775751277 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:21:08 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-a145bf81-40cc-4f77-8683-db727265be3c tempest-VolumesListAdminTestJSON-1775751277 None] Deleted volume successfully. Aug 31 15:21:08 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a145bf81-40cc-4f77-8683-db727265be3c tempest-VolumesListAdminTestJSON-1775751277 None] Lock "cinder-38d3fffd-2876-4e2f-b749-edb69c4004e6-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:21:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-42ae0627-e865-4c53-9731-e794ae8ef691 tempest-VolumesDeleteCascade-853061173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:21:09 devstack sudo[96650]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6da32fbc-e58f-4666-a4f9-95fad5a80dcf tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d" returned: 0 in 0.402s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:09 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6da32fbc-e58f-4666-a4f9-95fad5a80dcf tempest-GroupSnapshotsTest-2057849738 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:21:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6da32fbc-e58f-4666-a4f9-95fad5a80dcf tempest-GroupSnapshotsTest-2057849738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:21:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-42ae0627-e865-4c53-9731-e794ae8ef691 tempest-VolumesDeleteCascade-853061173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.112s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:21:09 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-42ae0627-e865-4c53-9731-e794ae8ef691 tempest-VolumesDeleteCascade-853061173 None] Creating offline snapshot 6ab414af-dc11-483a-b37e-cbd467cc26d3 of volume 34414d15-c502-468c-80e9-29b226e9adc8 {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:21:09 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6da32fbc-e58f-4666-a4f9-95fad5a80dcf tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7976b46-25cf-4f10-b52c-2dc60c623e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:09 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6da32fbc-e58f-4666-a4f9-95fad5a80dcf tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92d97164-b058-4f0b-9b6a-497b6e29ee68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:09 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[183b9022-94e8-4673-9ec6-a165b859ec77]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:21:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-42ae0627-e865-4c53-9731-e794ae8ef691 tempest-VolumesDeleteCascade-853061173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:09 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-6da32fbc-e58f-4666-a4f9-95fad5a80dcf tempest-GroupSnapshotsTest-2057849738 None] Volume volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d (eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d): created successfully Aug 31 15:21:09 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6da32fbc-e58f-4666-a4f9-95fad5a80dcf tempest-GroupSnapshotsTest-2057849738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92d97164-b058-4f0b-9b6a-497b6e29ee68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:09 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6da32fbc-e58f-4666-a4f9-95fad5a80dcf tempest-GroupSnapshotsTest-2057849738 None] Flow 'volume_create_manager' (fe20b39e-33fe-41e5-9532-03bbfc33144d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:21:09 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-6da32fbc-e58f-4666-a4f9-95fad5a80dcf tempest-GroupSnapshotsTest-2057849738 None] Created volume successfully. Aug 31 15:21:09 devstack sudo[96654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8 Aug 31 15:21:09 devstack sudo[96654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:09 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-96e2fde4-0992-4824-a0e2-028d9102b874 tempest-VolumesListAdminTestJSON-1775751277 None] Acquiring lock "cinder-ddd4284a-c3ba-4d03-b9da-12840f27902f-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:21:09 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-96e2fde4-0992-4824-a0e2-028d9102b874 tempest-VolumesListAdminTestJSON-1775751277 None] Lock "cinder-ddd4284a-c3ba-4d03-b9da-12840f27902f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:21:09 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-96e2fde4-0992-4824-a0e2-028d9102b874 tempest-VolumesListAdminTestJSON-1775751277 None] Acquiring lock "cinder-quobyte-ddd4284a-c3ba-4d03-b9da-12840f27902f" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:21:09 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-96e2fde4-0992-4824-a0e2-028d9102b874 tempest-VolumesListAdminTestJSON-1775751277 None] Lock "cinder-quobyte-ddd4284a-c3ba-4d03-b9da-12840f27902f" acquired by "delete_volume" :: waited 0.024s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:21:09 devstack sudo[96654]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-42ae0627-e865-4c53-9731-e794ae8ef691 tempest-VolumesDeleteCascade-853061173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8" returned: 0 in 0.475s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-42ae0627-e865-4c53-9731-e794ae8ef691 tempest-VolumesDeleteCascade-853061173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.6ab414af-dc11-483a-b37e-cbd467cc26d3 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:09 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0997e5-8a0e-49d4-9b90-e95d0d2b4963]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:21:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-96e2fde4-0992-4824-a0e2-028d9102b874 tempest-VolumesListAdminTestJSON-1775751277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ddd4284a-c3ba-4d03-b9da-12840f27902f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:09 devstack sudo[96660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.6ab414af-dc11-483a-b37e-cbd467cc26d3 1G Aug 31 15:21:09 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:09 devstack sudo[96661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ddd4284a-c3ba-4d03-b9da-12840f27902f Aug 31 15:21:09 devstack sudo[96661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:09 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-75bcd6e3-c995-4a9d-8102-7cbf26975f4b tempest-GroupSnapshotsTest-2057849738 None] GroupSnapshot ed7ec873-6393-4625-8108-6bae98f87d58: creating. Aug 31 15:21:09 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-75bcd6e3-c995-4a9d-8102-7cbf26975f4b tempest-GroupSnapshotsTest-2057849738 None] Group snapshot ed7ec873-6393-4625-8108-6bae98f87d58: creating. {{(pid=86000) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 31 15:21:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-75bcd6e3-c995-4a9d-8102-7cbf26975f4b tempest-GroupSnapshotsTest-2057849738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:21:10 devstack sudo[96661]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-96e2fde4-0992-4824-a0e2-028d9102b874 tempest-VolumesListAdminTestJSON-1775751277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ddd4284a-c3ba-4d03-b9da-12840f27902f" returned: 0 in 0.430s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-96e2fde4-0992-4824-a0e2-028d9102b874 tempest-VolumesListAdminTestJSON-1775751277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ddd4284a-c3ba-4d03-b9da-12840f27902f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:10 devstack sudo[96671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ddd4284a-c3ba-4d03-b9da-12840f27902f Aug 31 15:21:10 devstack sudo[96671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:10 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-42ae0627-e865-4c53-9731-e794ae8ef691 tempest-VolumesDeleteCascade-853061173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.6ab414af-dc11-483a-b37e-cbd467cc26d3 1G" returned: 0 in 0.482s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-42ae0627-e865-4c53-9731-e794ae8ef691 tempest-VolumesDeleteCascade-853061173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34414d15-c502-468c-80e9-29b226e9adc8 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.6ab414af-dc11-483a-b37e-cbd467cc26d3 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:10 devstack sudo[96673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34414d15-c502-468c-80e9-29b226e9adc8 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.6ab414af-dc11-483a-b37e-cbd467cc26d3 Aug 31 15:21:10 devstack sudo[96673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:10 devstack sudo[96671]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-96e2fde4-0992-4824-a0e2-028d9102b874 tempest-VolumesListAdminTestJSON-1775751277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ddd4284a-c3ba-4d03-b9da-12840f27902f" returned: 0 in 0.304s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:10 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-96e2fde4-0992-4824-a0e2-028d9102b874 tempest-VolumesListAdminTestJSON-1775751277 None] Lock "cinder-quobyte-ddd4284a-c3ba-4d03-b9da-12840f27902f" released by "delete_volume" :: held 0.796s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:21:10 devstack sudo[96673]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-42ae0627-e865-4c53-9731-e794ae8ef691 tempest-VolumesDeleteCascade-853061173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34414d15-c502-468c-80e9-29b226e9adc8 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.6ab414af-dc11-483a-b37e-cbd467cc26d3" returned: 0 in 0.321s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:10 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-42ae0627-e865-4c53-9731-e794ae8ef691 tempest-VolumesDeleteCascade-853061173 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.6ab414af-dc11-483a-b37e-cbd467cc26d3 is being set with open permissions: ugo+rw Aug 31 15:21:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-42ae0627-e865-4c53-9731-e794ae8ef691 tempest-VolumesDeleteCascade-853061173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.6ab414af-dc11-483a-b37e-cbd467cc26d3 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:10 devstack sudo[96680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.6ab414af-dc11-483a-b37e-cbd467cc26d3 Aug 31 15:21:10 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:10 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-96e2fde4-0992-4824-a0e2-028d9102b874 tempest-VolumesListAdminTestJSON-1775751277 None] Created reservations ['f6a67b4b-0125-43e2-b6d1-ed4bffe2dffb', 'f6214e30-0788-4335-8b61-53d02fc290b8', '1cb04057-5e32-46ce-a935-434a2b3efe93', '92da12d9-06e4-40b5-a0e8-6cdb10c104ed'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:21:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-96e2fde4-0992-4824-a0e2-028d9102b874 tempest-VolumesListAdminTestJSON-1775751277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:21:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-96e2fde4-0992-4824-a0e2-028d9102b874 tempest-VolumesListAdminTestJSON-1775751277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:21:10 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-96e2fde4-0992-4824-a0e2-028d9102b874 tempest-VolumesListAdminTestJSON-1775751277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:21:10 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-96e2fde4-0992-4824-a0e2-028d9102b874 tempest-VolumesListAdminTestJSON-1775751277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:21:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-96e2fde4-0992-4824-a0e2-028d9102b874 tempest-VolumesListAdminTestJSON-1775751277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:21:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-96e2fde4-0992-4824-a0e2-028d9102b874 tempest-VolumesListAdminTestJSON-1775751277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:10 devstack sudo[96682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:21:10 devstack sudo[96682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:10 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-42ae0627-e865-4c53-9731-e794ae8ef691 tempest-VolumesDeleteCascade-853061173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.6ab414af-dc11-483a-b37e-cbd467cc26d3" returned: 0 in 0.292s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-42ae0627-e865-4c53-9731-e794ae8ef691 tempest-VolumesDeleteCascade-853061173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:10 devstack sudo[96685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.info Aug 31 15:21:10 devstack sudo[96685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:10 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a5a63063-32cb-474a-952c-1b9add2f471e tempest-VolumesListAdminTestJSON-1775751277 None] Acquiring lock "cinder-4a969216-4d1c-41e9-b15f-3e6048453ecb-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:21:10 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a5a63063-32cb-474a-952c-1b9add2f471e tempest-VolumesListAdminTestJSON-1775751277 None] Lock "cinder-4a969216-4d1c-41e9-b15f-3e6048453ecb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:21:11 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a5a63063-32cb-474a-952c-1b9add2f471e tempest-VolumesListAdminTestJSON-1775751277 None] Acquiring lock "cinder-quobyte-4a969216-4d1c-41e9-b15f-3e6048453ecb" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:21:11 devstack sudo[96682]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-96e2fde4-0992-4824-a0e2-028d9102b874 tempest-VolumesListAdminTestJSON-1775751277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.400s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:11 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-96e2fde4-0992-4824-a0e2-028d9102b874 tempest-VolumesListAdminTestJSON-1775751277 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:21:11 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a5a63063-32cb-474a-952c-1b9add2f471e tempest-VolumesListAdminTestJSON-1775751277 None] Lock "cinder-quobyte-4a969216-4d1c-41e9-b15f-3e6048453ecb" acquired by "delete_volume" :: waited 0.027s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:21:11 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-96e2fde4-0992-4824-a0e2-028d9102b874 tempest-VolumesListAdminTestJSON-1775751277 None] Deleted volume successfully. Aug 31 15:21:11 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[40460ab7-44e4-4791-adf1-27d55416a801]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:21:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a5a63063-32cb-474a-952c-1b9add2f471e tempest-VolumesListAdminTestJSON-1775751277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4a969216-4d1c-41e9-b15f-3e6048453ecb {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:11 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-96e2fde4-0992-4824-a0e2-028d9102b874 tempest-VolumesListAdminTestJSON-1775751277 None] Lock "cinder-ddd4284a-c3ba-4d03-b9da-12840f27902f-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:21:11 devstack sudo[96685]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:11 devstack sudo[96688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4a969216-4d1c-41e9-b15f-3e6048453ecb Aug 31 15:21:11 devstack sudo[96688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-42ae0627-e865-4c53-9731-e794ae8ef691 tempest-VolumesDeleteCascade-853061173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.info" returned: 0 in 0.413s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:11 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-42ae0627-e865-4c53-9731-e794ae8ef691 tempest-VolumesDeleteCascade-853061173 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.info is being set with open permissions: ugo+rw Aug 31 15:21:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-42ae0627-e865-4c53-9731-e794ae8ef691 tempest-VolumesDeleteCascade-853061173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:11 devstack sudo[96691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.info Aug 31 15:21:11 devstack sudo[96691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:11 devstack sudo[96691]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:11 devstack sudo[96688]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-42ae0627-e865-4c53-9731-e794ae8ef691 tempest-VolumesDeleteCascade-853061173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.info" returned: 0 in 0.323s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-42ae0627-e865-4c53-9731-e794ae8ef691 tempest-VolumesDeleteCascade-853061173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.412s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:21:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-75bcd6e3-c995-4a9d-8102-7cbf26975f4b tempest-GroupSnapshotsTest-2057849738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.658s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:21:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a5a63063-32cb-474a-952c-1b9add2f471e tempest-VolumesListAdminTestJSON-1775751277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4a969216-4d1c-41e9-b15f-3e6048453ecb" returned: 0 in 0.514s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a5a63063-32cb-474a-952c-1b9add2f471e tempest-VolumesListAdminTestJSON-1775751277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4a969216-4d1c-41e9-b15f-3e6048453ecb {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:11 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-75bcd6e3-c995-4a9d-8102-7cbf26975f4b tempest-GroupSnapshotsTest-2057849738 None] Creating offline snapshot 5f352455-d6cd-4575-8a1f-edc8b6e9d60f of volume eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:21:11 devstack sudo[96697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4a969216-4d1c-41e9-b15f-3e6048453ecb Aug 31 15:21:11 devstack sudo[96697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:11 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-42ae0627-e865-4c53-9731-e794ae8ef691 tempest-VolumesDeleteCascade-853061173 None] Create snapshot completed successfully Aug 31 15:21:11 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd9af0d-11e1-4f2a-bd35-4e7b5d9c7894]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:21:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-75bcd6e3-c995-4a9d-8102-7cbf26975f4b tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:11 devstack sudo[96699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d Aug 31 15:21:11 devstack sudo[96699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:11 devstack sudo[96697]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a5a63063-32cb-474a-952c-1b9add2f471e tempest-VolumesListAdminTestJSON-1775751277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4a969216-4d1c-41e9-b15f-3e6048453ecb" returned: 0 in 0.342s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:11 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a5a63063-32cb-474a-952c-1b9add2f471e tempest-VolumesListAdminTestJSON-1775751277 None] Lock "cinder-quobyte-4a969216-4d1c-41e9-b15f-3e6048453ecb" released by "delete_volume" :: held 0.930s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:21:12 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-a5a63063-32cb-474a-952c-1b9add2f471e tempest-VolumesListAdminTestJSON-1775751277 None] Created reservations ['ab9e014b-fdd4-42ae-a502-1c06a9c74887', 'e7dffcae-3b75-46f7-939f-4248bd8d7308', 'ef33827f-3ee0-4be1-aa95-9118997e4004', 'c2819b55-c838-46dc-b267-498369905091'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:21:12 devstack sudo[96699]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-a5a63063-32cb-474a-952c-1b9add2f471e tempest-VolumesListAdminTestJSON-1775751277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:21:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-a5a63063-32cb-474a-952c-1b9add2f471e tempest-VolumesListAdminTestJSON-1775751277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:21:12 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-a5a63063-32cb-474a-952c-1b9add2f471e tempest-VolumesListAdminTestJSON-1775751277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:21:12 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-a5a63063-32cb-474a-952c-1b9add2f471e tempest-VolumesListAdminTestJSON-1775751277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:21:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-a5a63063-32cb-474a-952c-1b9add2f471e tempest-VolumesListAdminTestJSON-1775751277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:21:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a5a63063-32cb-474a-952c-1b9add2f471e tempest-VolumesListAdminTestJSON-1775751277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-75bcd6e3-c995-4a9d-8102-7cbf26975f4b tempest-GroupSnapshotsTest-2057849738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d" returned: 0 in 0.542s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-75bcd6e3-c995-4a9d-8102-7cbf26975f4b tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d.5f352455-d6cd-4575-8a1f-edc8b6e9d60f 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:12 devstack sudo[96705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:21:12 devstack sudo[96705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:12 devstack sudo[96706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d.5f352455-d6cd-4575-8a1f-edc8b6e9d60f 1G Aug 31 15:21:12 devstack sudo[96706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-04c36346-958e-4fe3-bbf7-78c5a1305f9f tempest-VolumesDeleteCascade-853061173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:21:12 devstack sudo[96705]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a5a63063-32cb-474a-952c-1b9add2f471e tempest-VolumesListAdminTestJSON-1775751277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.495s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:12 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-a5a63063-32cb-474a-952c-1b9add2f471e tempest-VolumesListAdminTestJSON-1775751277 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:21:12 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-a5a63063-32cb-474a-952c-1b9add2f471e tempest-VolumesListAdminTestJSON-1775751277 None] Deleted volume successfully. Aug 31 15:21:12 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a5a63063-32cb-474a-952c-1b9add2f471e tempest-VolumesListAdminTestJSON-1775751277 None] Lock "cinder-4a969216-4d1c-41e9-b15f-3e6048453ecb-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:21:12 devstack sudo[96706]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-75bcd6e3-c995-4a9d-8102-7cbf26975f4b tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d.5f352455-d6cd-4575-8a1f-edc8b6e9d60f 1G" returned: 0 in 0.564s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-75bcd6e3-c995-4a9d-8102-7cbf26975f4b tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d.5f352455-d6cd-4575-8a1f-edc8b6e9d60f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:12 devstack sudo[96714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d.5f352455-d6cd-4575-8a1f-edc8b6e9d60f Aug 31 15:21:12 devstack sudo[96714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:13 devstack sudo[96714]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-75bcd6e3-c995-4a9d-8102-7cbf26975f4b tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d.5f352455-d6cd-4575-8a1f-edc8b6e9d60f" returned: 0 in 0.314s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:13 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-75bcd6e3-c995-4a9d-8102-7cbf26975f4b tempest-GroupSnapshotsTest-2057849738 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d.5f352455-d6cd-4575-8a1f-edc8b6e9d60f is being set with open permissions: ugo+rw: NotImplementedError Aug 31 15:21:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-75bcd6e3-c995-4a9d-8102-7cbf26975f4b tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d.5f352455-d6cd-4575-8a1f-edc8b6e9d60f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:13 devstack sudo[96719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d.5f352455-d6cd-4575-8a1f-edc8b6e9d60f Aug 31 15:21:13 devstack sudo[96719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:13 devstack sudo[96719]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-75bcd6e3-c995-4a9d-8102-7cbf26975f4b tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d.5f352455-d6cd-4575-8a1f-edc8b6e9d60f" returned: 0 in 0.314s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-75bcd6e3-c995-4a9d-8102-7cbf26975f4b tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:13 devstack sudo[96722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d.info Aug 31 15:21:13 devstack sudo[96722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:13 devstack sudo[96722]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-75bcd6e3-c995-4a9d-8102-7cbf26975f4b tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d.info" returned: 0 in 0.323s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:13 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-75bcd6e3-c995-4a9d-8102-7cbf26975f4b tempest-GroupSnapshotsTest-2057849738 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d.info is being set with open permissions: ugo+rw: NotImplementedError Aug 31 15:21:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-75bcd6e3-c995-4a9d-8102-7cbf26975f4b tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:13 devstack sudo[96725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d.info Aug 31 15:21:13 devstack sudo[96725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:14 devstack sudo[96725]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-75bcd6e3-c995-4a9d-8102-7cbf26975f4b tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d.info" returned: 0 in 0.286s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-75bcd6e3-c995-4a9d-8102-7cbf26975f4b tempest-GroupSnapshotsTest-2057849738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.486s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:21:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-04c36346-958e-4fe3-bbf7-78c5a1305f9f tempest-VolumesDeleteCascade-853061173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.540s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:21:14 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-04c36346-958e-4fe3-bbf7-78c5a1305f9f tempest-VolumesDeleteCascade-853061173 None] Creating offline snapshot 31241655-d8d6-4302-b008-d41165dfef62 of volume 34414d15-c502-468c-80e9-29b226e9adc8 {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:21:14 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3cbfe49-40a7-44d5-8b03-a1111289e4a8]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:21:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-04c36346-958e-4fe3-bbf7-78c5a1305f9f tempest-VolumesDeleteCascade-853061173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.6ab414af-dc11-483a-b37e-cbd467cc26d3 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:14 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-75bcd6e3-c995-4a9d-8102-7cbf26975f4b tempest-GroupSnapshotsTest-2057849738 None] group_snapshot ed7ec873-6393-4625-8108-6bae98f87d58: created successfully Aug 31 15:21:14 devstack sudo[96728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.6ab414af-dc11-483a-b37e-cbd467cc26d3 Aug 31 15:21:14 devstack sudo[96728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:14 devstack sudo[96728]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-04c36346-958e-4fe3-bbf7-78c5a1305f9f tempest-VolumesDeleteCascade-853061173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.6ab414af-dc11-483a-b37e-cbd467cc26d3" returned: 0 in 0.488s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:14 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-04c36346-958e-4fe3-bbf7-78c5a1305f9f tempest-VolumesDeleteCascade-853061173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34414d15-c502-468c-80e9-29b226e9adc8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:21:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-04c36346-958e-4fe3-bbf7-78c5a1305f9f tempest-VolumesDeleteCascade-853061173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.6ab414af-dc11-483a-b37e-cbd467cc26d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.31241655-d8d6-4302-b008-d41165dfef62 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:14 devstack sudo[96733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.6ab414af-dc11-483a-b37e-cbd467cc26d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.31241655-d8d6-4302-b008-d41165dfef62 1G Aug 31 15:21:14 devstack sudo[96733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:15 devstack sudo[96733]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-04c36346-958e-4fe3-bbf7-78c5a1305f9f tempest-VolumesDeleteCascade-853061173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.6ab414af-dc11-483a-b37e-cbd467cc26d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.31241655-d8d6-4302-b008-d41165dfef62 1G" returned: 0 in 0.669s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-04c36346-958e-4fe3-bbf7-78c5a1305f9f tempest-VolumesDeleteCascade-853061173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34414d15-c502-468c-80e9-29b226e9adc8.6ab414af-dc11-483a-b37e-cbd467cc26d3 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.31241655-d8d6-4302-b008-d41165dfef62 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:15 devstack sudo[96739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34414d15-c502-468c-80e9-29b226e9adc8.6ab414af-dc11-483a-b37e-cbd467cc26d3 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.31241655-d8d6-4302-b008-d41165dfef62 Aug 31 15:21:15 devstack sudo[96739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:15 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-57954932-f52a-41bf-8b95-f385908f91d1 tempest-GroupSnapshotsTest-2057849738 None] group_snapshot ed7ec873-6393-4625-8108-6bae98f87d58: deleting Aug 31 15:21:15 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-57954932-f52a-41bf-8b95-f385908f91d1 tempest-GroupSnapshotsTest-2057849738 None] group_snapshot ed7ec873-6393-4625-8108-6bae98f87d58: deleting {{(pid=86000) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 31 15:21:15 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-57954932-f52a-41bf-8b95-f385908f91d1 tempest-GroupSnapshotsTest-2057849738 None] Acquiring lock "cinder-quobyte-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:21:15 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-57954932-f52a-41bf-8b95-f385908f91d1 tempest-GroupSnapshotsTest-2057849738 None] Lock "cinder-quobyte-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:21:15 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-57954932-f52a-41bf-8b95-f385908f91d1 tempest-GroupSnapshotsTest-2057849738 None] Acquiring lock "cinder-quobyte-5f352455-d6cd-4575-8a1f-edc8b6e9d60f" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:21:15 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-57954932-f52a-41bf-8b95-f385908f91d1 tempest-GroupSnapshotsTest-2057849738 None] Lock "cinder-quobyte-5f352455-d6cd-4575-8a1f-edc8b6e9d60f" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:21:15 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-57954932-f52a-41bf-8b95-f385908f91d1 tempest-GroupSnapshotsTest-2057849738 None] Deleting offline snapshot 5f352455-d6cd-4575-8a1f-edc8b6e9d60f of volume eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:21:15 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-57954932-f52a-41bf-8b95-f385908f91d1 tempest-GroupSnapshotsTest-2057849738 None] snapshot_file for this snap is: volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d.5f352455-d6cd-4575-8a1f-edc8b6e9d60f {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:21:15 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[141be670-9149-46b8-b291-5fe0c5cb4cde]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:21:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-57954932-f52a-41bf-8b95-f385908f91d1 tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d.5f352455-d6cd-4575-8a1f-edc8b6e9d60f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:15 devstack sudo[96739]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-04c36346-958e-4fe3-bbf7-78c5a1305f9f tempest-VolumesDeleteCascade-853061173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34414d15-c502-468c-80e9-29b226e9adc8.6ab414af-dc11-483a-b37e-cbd467cc26d3 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.31241655-d8d6-4302-b008-d41165dfef62" returned: 0 in 0.529s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:15 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-04c36346-958e-4fe3-bbf7-78c5a1305f9f tempest-VolumesDeleteCascade-853061173 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.31241655-d8d6-4302-b008-d41165dfef62 is being set with open permissions: ugo+rw Aug 31 15:21:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-04c36346-958e-4fe3-bbf7-78c5a1305f9f tempest-VolumesDeleteCascade-853061173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.31241655-d8d6-4302-b008-d41165dfef62 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:15 devstack sudo[96745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.31241655-d8d6-4302-b008-d41165dfef62 Aug 31 15:21:15 devstack sudo[96745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:15 devstack sudo[96743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d.5f352455-d6cd-4575-8a1f-edc8b6e9d60f Aug 31 15:21:15 devstack sudo[96743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:16 devstack sudo[96745]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-04c36346-958e-4fe3-bbf7-78c5a1305f9f tempest-VolumesDeleteCascade-853061173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.31241655-d8d6-4302-b008-d41165dfef62" returned: 0 in 0.314s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:16 devstack sudo[96743]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-04c36346-958e-4fe3-bbf7-78c5a1305f9f tempest-VolumesDeleteCascade-853061173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.161s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:21:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-57954932-f52a-41bf-8b95-f385908f91d1 tempest-GroupSnapshotsTest-2057849738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d.5f352455-d6cd-4575-8a1f-edc8b6e9d60f" returned: 0 in 0.526s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:16 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-57954932-f52a-41bf-8b95-f385908f91d1 tempest-GroupSnapshotsTest-2057849738 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:21:16 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7303921c-7faa-4351-833b-70c8622e54ff]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:21:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-57954932-f52a-41bf-8b95-f385908f91d1 tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:16 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-04c36346-958e-4fe3-bbf7-78c5a1305f9f tempest-VolumesDeleteCascade-853061173 None] Create snapshot completed successfully Aug 31 15:21:16 devstack sudo[96752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d Aug 31 15:21:16 devstack sudo[96752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:16 devstack sudo[96752]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-57954932-f52a-41bf-8b95-f385908f91d1 tempest-GroupSnapshotsTest-2057849738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d" returned: 0 in 0.441s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-57954932-f52a-41bf-8b95-f385908f91d1 tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d.5f352455-d6cd-4575-8a1f-edc8b6e9d60f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:16 devstack sudo[96758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d.5f352455-d6cd-4575-8a1f-edc8b6e9d60f Aug 31 15:21:16 devstack sudo[96758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:16 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Acquiring lock "cinder-34414d15-c502-468c-80e9-29b226e9adc8-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:21:16 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Lock "cinder-34414d15-c502-468c-80e9-29b226e9adc8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:21:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Performing cascade delete. {{(pid=86000) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 31 15:21:17 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Acquiring lock "cinder-31241655-d8d6-4302-b008-d41165dfef62-delete_snapshot" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:21:17 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Lock "cinder-31241655-d8d6-4302-b008-d41165dfef62-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:21:17 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Acquiring lock "cinder-quobyte-34414d15-c502-468c-80e9-29b226e9adc8" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:21:17 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Lock "cinder-quobyte-34414d15-c502-468c-80e9-29b226e9adc8" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:21:17 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Acquiring lock "cinder-quobyte-31241655-d8d6-4302-b008-d41165dfef62" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:21:17 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Lock "cinder-quobyte-31241655-d8d6-4302-b008-d41165dfef62" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:21:17 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Deleting offline snapshot 31241655-d8d6-4302-b008-d41165dfef62 of volume 34414d15-c502-468c-80e9-29b226e9adc8 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:21:17 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] snapshot_file for this snap is: volume-34414d15-c502-468c-80e9-29b226e9adc8.31241655-d8d6-4302-b008-d41165dfef62 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:21:17 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa6b2ea-ff22-4978-8cd7-1ae296057dec]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:21:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.31241655-d8d6-4302-b008-d41165dfef62 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:17 devstack sudo[96758]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-57954932-f52a-41bf-8b95-f385908f91d1 tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d.5f352455-d6cd-4575-8a1f-edc8b6e9d60f" returned: 0 in 0.454s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-57954932-f52a-41bf-8b95-f385908f91d1 tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d.5f352455-d6cd-4575-8a1f-edc8b6e9d60f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:17 devstack sudo[96765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d.5f352455-d6cd-4575-8a1f-edc8b6e9d60f Aug 31 15:21:17 devstack sudo[96765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:17 devstack sudo[96764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.31241655-d8d6-4302-b008-d41165dfef62 Aug 31 15:21:17 devstack sudo[96764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:17 devstack sudo[96765]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-57954932-f52a-41bf-8b95-f385908f91d1 tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d.5f352455-d6cd-4575-8a1f-edc8b6e9d60f" returned: 0 in 0.330s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:17 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-57954932-f52a-41bf-8b95-f385908f91d1 tempest-GroupSnapshotsTest-2057849738 None] Lock "cinder-quobyte-5f352455-d6cd-4575-8a1f-edc8b6e9d60f" released by "_delete_snapshot" :: held 1.896s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:21:17 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-57954932-f52a-41bf-8b95-f385908f91d1 tempest-GroupSnapshotsTest-2057849738 None] Lock "cinder-quobyte-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d" released by "delete_snapshot" :: held 1.940s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:21:17 devstack sudo[96764]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.31241655-d8d6-4302-b008-d41165dfef62" returned: 0 in 0.517s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:17 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34414d15-c502-468c-80e9-29b226e9adc8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:21:17 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[896c66db-73b7-4f98-87bb-9bd4d0da42a1]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:21:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.6ab414af-dc11-483a-b37e-cbd467cc26d3 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:17 devstack cinder-volume[86000]: WARNING cinder.quota [None req-57954932-f52a-41bf-8b95-f385908f91d1 tempest-GroupSnapshotsTest-2057849738 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1742445077 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1742445077, it is now deprecated. Please use the default quota class for default quota. Aug 31 15:21:17 devstack cinder-volume[86000]: WARNING cinder.quota [None req-57954932-f52a-41bf-8b95-f385908f91d1 tempest-GroupSnapshotsTest-2057849738 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1742445077 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1742445077, it is now deprecated. Please use the default quota class for default quota. Aug 31 15:21:17 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-57954932-f52a-41bf-8b95-f385908f91d1 tempest-GroupSnapshotsTest-2057849738 None] Created reservations ['260743bb-89a3-4844-b50c-f14cadc7be9b', '2a88619e-5c01-4a79-9068-3c0eeba5a774', '27ce1eaf-d781-417d-be82-a970baef34f2', 'a0a9ac00-e583-4383-9b67-a357c6b1768e'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:21:17 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.6ab414af-dc11-483a-b37e-cbd467cc26d3 Aug 31 15:21:17 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:17 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-57954932-f52a-41bf-8b95-f385908f91d1 tempest-GroupSnapshotsTest-2057849738 None] group_snapshot ed7ec873-6393-4625-8108-6bae98f87d58: deleted successfully Aug 31 15:21:18 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.6ab414af-dc11-483a-b37e-cbd467cc26d3" returned: 0 in 0.530s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:18 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34414d15-c502-468c-80e9-29b226e9adc8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:21:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.31241655-d8d6-4302-b008-d41165dfef62 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:18 devstack sudo[96812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.31241655-d8d6-4302-b008-d41165dfef62 Aug 31 15:21:18 devstack sudo[96812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:18 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-43f75941-6bfe-4d6b-90af-d7ce84493599 tempest-GroupSnapshotsTest-2057849738 None] Acquiring lock "cinder-quobyte-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:21:18 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-43f75941-6bfe-4d6b-90af-d7ce84493599 tempest-GroupSnapshotsTest-2057849738 None] Lock "cinder-quobyte-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d" acquired by "delete_volume" :: waited 0.053s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:21:18 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7713774f-0266-4073-9fbf-664e398593ce]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:21:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-43f75941-6bfe-4d6b-90af-d7ce84493599 tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:18 devstack sudo[96821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d Aug 31 15:21:18 devstack sudo[96821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:18 devstack sudo[96812]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.31241655-d8d6-4302-b008-d41165dfef62" returned: 0 in 0.663s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.31241655-d8d6-4302-b008-d41165dfef62 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:18 devstack sudo[96823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.31241655-d8d6-4302-b008-d41165dfef62 Aug 31 15:21:18 devstack sudo[96823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:19 devstack sudo[96823]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.31241655-d8d6-4302-b008-d41165dfef62" returned: 0 in 0.309s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:19 devstack sudo[96821]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-43f75941-6bfe-4d6b-90af-d7ce84493599 tempest-GroupSnapshotsTest-2057849738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d" returned: 0 in 0.515s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-43f75941-6bfe-4d6b-90af-d7ce84493599 tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:19 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Lock "cinder-quobyte-31241655-d8d6-4302-b008-d41165dfef62" released by "_delete_snapshot" :: held 2.162s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:21:19 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Lock "cinder-quobyte-34414d15-c502-468c-80e9-29b226e9adc8" released by "delete_snapshot" :: held 2.201s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:21:19 devstack sudo[96829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d Aug 31 15:21:19 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:19 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Created reservations ['9e49ce6a-a342-4bbe-b86c-6fd734f56bbb', '5d6e57db-969f-4ace-a0fe-d7490d468e10', '88c568a1-5bd1-428d-a4bb-f7cdf3fa6189', '47d68bbd-3236-4d17-b038-3d93438a604c'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:21:19 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Delete snapshot completed successfully. Aug 31 15:21:19 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Lock "cinder-31241655-d8d6-4302-b008-d41165dfef62-delete_snapshot" released by "delete_snapshot" :: held 2.437s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:21:19 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Acquiring lock "cinder-6ab414af-dc11-483a-b37e-cbd467cc26d3-delete_snapshot" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:21:19 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Lock "cinder-6ab414af-dc11-483a-b37e-cbd467cc26d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:21:19 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Acquiring lock "cinder-quobyte-34414d15-c502-468c-80e9-29b226e9adc8" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:21:19 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Lock "cinder-quobyte-34414d15-c502-468c-80e9-29b226e9adc8" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:21:19 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Acquiring lock "cinder-quobyte-6ab414af-dc11-483a-b37e-cbd467cc26d3" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:21:19 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Lock "cinder-quobyte-6ab414af-dc11-483a-b37e-cbd467cc26d3" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:21:19 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Deleting offline snapshot 6ab414af-dc11-483a-b37e-cbd467cc26d3 of volume 34414d15-c502-468c-80e9-29b226e9adc8 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:21:19 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] snapshot_file for this snap is: volume-34414d15-c502-468c-80e9-29b226e9adc8.6ab414af-dc11-483a-b37e-cbd467cc26d3 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:21:19 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-43f75941-6bfe-4d6b-90af-d7ce84493599 tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d" returned: 0 in 0.359s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:19 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b56313d-ea7e-4bb0-ae86-f5fe3d562686]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:21:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.6ab414af-dc11-483a-b37e-cbd467cc26d3 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:19 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-43f75941-6bfe-4d6b-90af-d7ce84493599 tempest-GroupSnapshotsTest-2057849738 None] Lock "cinder-quobyte-eb74a6f7-a2b0-4bc6-99f9-508ec4abf67d" released by "delete_volume" :: held 0.985s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:21:19 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-43f75941-6bfe-4d6b-90af-d7ce84493599 tempest-GroupSnapshotsTest-2057849738 None] Created reservations ['c0968d58-b98e-4865-963e-20535f78a329'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:21:19 devstack sudo[96833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.6ab414af-dc11-483a-b37e-cbd467cc26d3 Aug 31 15:21:19 devstack sudo[96833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:19 devstack cinder-volume[86000]: WARNING cinder.quota [None req-43f75941-6bfe-4d6b-90af-d7ce84493599 tempest-GroupSnapshotsTest-2057849738 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1742445077 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1742445077, it is now deprecated. Please use the default quota class for default quota. Aug 31 15:21:19 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-43f75941-6bfe-4d6b-90af-d7ce84493599 tempest-GroupSnapshotsTest-2057849738 None] Created reservations ['a746ecd5-a739-44a8-b453-86d4537497d8', 'c5c64c7b-19c9-4250-9321-9551752e6b0f', '81ddf8cd-42d6-4eff-825c-05be65dee955', 'cc4a56d7-a20f-4f6c-983b-6a64cf9d7d12'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:21:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-43f75941-6bfe-4d6b-90af-d7ce84493599 tempest-GroupSnapshotsTest-2057849738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:21:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-43f75941-6bfe-4d6b-90af-d7ce84493599 tempest-GroupSnapshotsTest-2057849738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:21:20 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-43f75941-6bfe-4d6b-90af-d7ce84493599 tempest-GroupSnapshotsTest-2057849738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:21:20 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-43f75941-6bfe-4d6b-90af-d7ce84493599 tempest-GroupSnapshotsTest-2057849738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:21:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-43f75941-6bfe-4d6b-90af-d7ce84493599 tempest-GroupSnapshotsTest-2057849738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:21:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-43f75941-6bfe-4d6b-90af-d7ce84493599 tempest-GroupSnapshotsTest-2057849738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:20 devstack sudo[96837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:21:20 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:20 devstack sudo[96833]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.6ab414af-dc11-483a-b37e-cbd467cc26d3" returned: 0 in 0.498s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:20 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34414d15-c502-468c-80e9-29b226e9adc8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:21:20 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a716605-93ef-413c-9f91-db7d56005958]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:21:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:20 devstack sudo[96841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8 Aug 31 15:21:20 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:20 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-43f75941-6bfe-4d6b-90af-d7ce84493599 tempest-GroupSnapshotsTest-2057849738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.476s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:20 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-43f75941-6bfe-4d6b-90af-d7ce84493599 tempest-GroupSnapshotsTest-2057849738 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:21:20 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-43f75941-6bfe-4d6b-90af-d7ce84493599 tempest-GroupSnapshotsTest-2057849738 None] Delete group completed successfully. Aug 31 15:21:20 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8" returned: 0 in 0.456s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.6ab414af-dc11-483a-b37e-cbd467cc26d3 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:20 devstack sudo[96849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.6ab414af-dc11-483a-b37e-cbd467cc26d3 Aug 31 15:21:20 devstack sudo[96849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:21 devstack sudo[96849]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.6ab414af-dc11-483a-b37e-cbd467cc26d3" returned: 0 in 0.497s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.6ab414af-dc11-483a-b37e-cbd467cc26d3 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:21 devstack sudo[96855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.6ab414af-dc11-483a-b37e-cbd467cc26d3 Aug 31 15:21:21 devstack sudo[96855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:21 devstack sudo[96855]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8.6ab414af-dc11-483a-b37e-cbd467cc26d3" returned: 0 in 0.409s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:21 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Lock "cinder-quobyte-6ab414af-dc11-483a-b37e-cbd467cc26d3" released by "_delete_snapshot" :: held 2.039s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:21:21 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Lock "cinder-quobyte-34414d15-c502-468c-80e9-29b226e9adc8" released by "delete_snapshot" :: held 2.067s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:21:21 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Created reservations ['438a6188-aace-4927-865f-f7b827d11829', 'b301bffb-fe6a-48bb-bcae-68f16b0a86b0', '3dbb5300-fe8f-485d-9443-3c0fc9238690', '7891f50f-f682-4c24-a2c4-8faf54f7529a'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:21:21 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Delete snapshot completed successfully. Aug 31 15:21:21 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Lock "cinder-6ab414af-dc11-483a-b37e-cbd467cc26d3-delete_snapshot" released by "delete_snapshot" :: held 2.281s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:21:21 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Snapshots deleted, issuing volume delete {{(pid=86000) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 31 15:21:21 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Acquiring lock "cinder-quobyte-34414d15-c502-468c-80e9-29b226e9adc8" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:21:21 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Lock "cinder-quobyte-34414d15-c502-468c-80e9-29b226e9adc8" acquired by "delete_volume" :: waited 0.022s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:21:21 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4386f1d6-b96b-43da-89c2-7bdb5b6b8851]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:21:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:21 devstack sudo[96860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8 Aug 31 15:21:21 devstack sudo[96860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:22 devstack sudo[96860]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8" returned: 0 in 0.419s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:22 devstack sudo[96865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8 Aug 31 15:21:22 devstack sudo[96865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:22 devstack sudo[96865]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-34414d15-c502-468c-80e9-29b226e9adc8" returned: 0 in 0.371s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:22 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Lock "cinder-quobyte-34414d15-c502-468c-80e9-29b226e9adc8" released by "delete_volume" :: held 0.874s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:21:22 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Created reservations ['9b3b517e-2b9d-4f36-9228-6a709d199f2f', 'b5f64509-942f-4f64-a780-129f66b4cd72', 'fed19545-e1e4-4ed7-af00-4c81269e7a02', '7e2e2af9-caa7-450a-885b-621d3d7bf7e1'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:21:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:21:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:21:22 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:21:22 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:21:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:21:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:22 devstack sudo[96868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:21:22 devstack sudo[96868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:23 devstack sudo[96868]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.386s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:23 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:21:23 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Deleted volume successfully. Aug 31 15:21:23 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:21:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Flow 'volume_create_manager' (7f747194-4b98-40dd-88ef-68166089961b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:21:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04d43c73-02ea-43ac-9862-59559ea82d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04d43c73-02ea-43ac-9862-59559ea82d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:21:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1895564227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b27efcb1-7959-410d-995d-8452052c1457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='982e66a4fc7849e4bfffe9f4065c11e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:21:23Z,use_quota=True,user_id='978b17455dc74a5f938498c5e71dcf48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00dfa0e1-e30f-4ed7-896b-9829c50b714b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00dfa0e1-e30f-4ed7-896b-9829c50b714b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03427707-e4c3-450f-8056-500c928f3ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:23 devstack cinder-volume[86000]: DEBUG cinder.image.glance [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Creating Keystone auth plugin from conf {{(pid=86000) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 31 15:21:23 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6f3498da-0c23-42d1-ab53-ff0b66fea331 tempest-VolumesDeleteCascade-853061173 None] Lock "cinder-34414d15-c502-468c-80e9-29b226e9adc8-delete_volume" released by "delete_volume" :: held 6.486s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:21:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03427707-e4c3-450f-8056-500c928f3ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b27efcb1-7959-410d-995d-8452052c1457', 'volume_name': 'volume-b27efcb1-7959-410d-995d-8452052c1457', 'volume_size': 1, 'image_id': '20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '567fd89339ed4743bca5bfab8ec3766d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'created_at': datetime.datetime(2026, 8, 31, 13, 6, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 13, 6, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20bdf4f4-1731-4a30-8e37-8e698c01bf5d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c803a100-8455-4e49-87b8-3718e86e0200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c803a100-8455-4e49-87b8-3718e86e0200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8480189-2d7c-4a51-94e2-5b6b3ffd9ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:23 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Volume b27efcb1-7959-410d-995d-8452052c1457: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b27efcb1-7959-410d-995d-8452052c1457', 'volume_size': 1, 'image_id': '20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '567fd89339ed4743bca5bfab8ec3766d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'created_at': datetime.datetime(2026, 8, 31, 13, 6, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 13, 6, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20bdf4f4-1731-4a30-8e37-8e698c01bf5d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 31 15:21:23 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Trying to clone b27efcb1-7959-410d-995d-8452052c1457 from image 20bdf4f4-1731-4a30-8e37-8e698c01bf5d at location (None, [{'url': 'file:///opt/stack/data/glance/images/20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'metadata': {}}]). {{(pid=86000) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 31 15:21:24 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_ez2pabswdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86000) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 31 15:21:24 devstack cinder-volume[86000]: INFO cinder.image.image_utils [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Image download 20.69 MB at 20.69 MB/s Aug 31 15:21:24 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[49911e61-7444-4f81-af79-da54090a5531]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:21:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_ez2pabswdevstack@QuobyteHD {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:24 devstack sudo[96872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_ez2pabswdevstack@QuobyteHD Aug 31 15:21:24 devstack sudo[96872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:24 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb432574-e79a-4428-9d30-d2434727946e tempest-VolumesDeleteCascade-853061173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:21:24 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb432574-e79a-4428-9d30-d2434727946e tempest-VolumesDeleteCascade-853061173 None] Flow 'volume_create_manager' (ff85075b-2a6f-44a0-93bd-e75d1677a62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:21:24 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb432574-e79a-4428-9d30-d2434727946e tempest-VolumesDeleteCascade-853061173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25d0a0a6-5587-4bd6-af39-55799137138c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:24 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb432574-e79a-4428-9d30-d2434727946e tempest-VolumesDeleteCascade-853061173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25d0a0a6-5587-4bd6-af39-55799137138c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2010259013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6327f302d19d4be3bd563f33a327f576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:21:25Z,use_quota=True,user_id='0d5716deed304813b32a716326b7d3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:24 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb432574-e79a-4428-9d30-d2434727946e tempest-VolumesDeleteCascade-853061173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d901c625-fbde-4e00-9eff-c2725735d7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:24 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb432574-e79a-4428-9d30-d2434727946e tempest-VolumesDeleteCascade-853061173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d901c625-fbde-4e00-9eff-c2725735d7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:24 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb432574-e79a-4428-9d30-d2434727946e tempest-VolumesDeleteCascade-853061173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e0ebe35-272b-4fa5-bb6a-0fbc692b1243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:24 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb432574-e79a-4428-9d30-d2434727946e tempest-VolumesDeleteCascade-853061173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e0ebe35-272b-4fa5-bb6a-0fbc692b1243) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a', 'volume_name': 'volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:24 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb432574-e79a-4428-9d30-d2434727946e tempest-VolumesDeleteCascade-853061173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f33d571-478e-4499-9dfb-b1ab2e20fe7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:24 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb432574-e79a-4428-9d30-d2434727946e tempest-VolumesDeleteCascade-853061173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f33d571-478e-4499-9dfb-b1ab2e20fe7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:24 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb432574-e79a-4428-9d30-d2434727946e tempest-VolumesDeleteCascade-853061173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd378d88-d7f9-41f9-aaa3-1eeec53dbbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:24 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-eb432574-e79a-4428-9d30-d2434727946e tempest-VolumesDeleteCascade-853061173 None] Volume 6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a', 'volume_size': 1} Aug 31 15:21:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-eb432574-e79a-4428-9d30-d2434727946e tempest-VolumesDeleteCascade-853061173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:21:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-eb432574-e79a-4428-9d30-d2434727946e tempest-VolumesDeleteCascade-853061173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:21:24 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-eb432574-e79a-4428-9d30-d2434727946e tempest-VolumesDeleteCascade-853061173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2010259013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6327f302d19d4be3bd563f33a327f576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:21:25Z,use_quota=True,user_id='0d5716deed304813b32a716326b7d3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:21:24 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-eb432574-e79a-4428-9d30-d2434727946e tempest-VolumesDeleteCascade-853061173 None] Creating volume 6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:21:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-eb432574-e79a-4428-9d30-d2434727946e tempest-VolumesDeleteCascade-853061173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:21:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-eb432574-e79a-4428-9d30-d2434727946e tempest-VolumesDeleteCascade-853061173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:21:24 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-eb432574-e79a-4428-9d30-d2434727946e tempest-VolumesDeleteCascade-853061173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:21:24 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-eb432574-e79a-4428-9d30-d2434727946e tempest-VolumesDeleteCascade-853061173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:21:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-eb432574-e79a-4428-9d30-d2434727946e tempest-VolumesDeleteCascade-853061173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:21:24 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-eb432574-e79a-4428-9d30-d2434727946e tempest-VolumesDeleteCascade-853061173 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:21:24 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-eb432574-e79a-4428-9d30-d2434727946e tempest-VolumesDeleteCascade-853061173 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:21:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-eb432574-e79a-4428-9d30-d2434727946e tempest-VolumesDeleteCascade-853061173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:24 devstack sudo[96874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a 1073741824 Aug 31 15:21:24 devstack sudo[96874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:24 devstack sudo[96872]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_ez2pabswdevstack@QuobyteHD" returned: 0 in 0.485s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:24 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Temporary image 20bdf4f4-1731-4a30-8e37-8e698c01bf5d is fetched for user 978b17455dc74a5f938498c5e71dcf48. {{(pid=86000) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 31 15:21:25 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ba2c0c-174d-4df5-a30b-981c6beb6921]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:21:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_ez2pabswdevstack@QuobyteHD {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:25 devstack sudo[96879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_ez2pabswdevstack@QuobyteHD Aug 31 15:21:25 devstack sudo[96879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:25 devstack sudo[96874]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-eb432574-e79a-4428-9d30-d2434727946e tempest-VolumesDeleteCascade-853061173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a 1073741824" returned: 0 in 0.683s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:25 devstack sudo[96879]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_ez2pabswdevstack@QuobyteHD" returned: 0 in 0.507s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:21:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-eb432574-e79a-4428-9d30-d2434727946e tempest-VolumesDeleteCascade-853061173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:25 devstack sudo[96889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a Aug 31 15:21:25 devstack sudo[96889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:25 devstack sudo[96889]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-eb432574-e79a-4428-9d30-d2434727946e tempest-VolumesDeleteCascade-853061173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a" returned: 0 in 0.269s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:25 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-eb432574-e79a-4428-9d30-d2434727946e tempest-VolumesDeleteCascade-853061173 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:21:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-eb432574-e79a-4428-9d30-d2434727946e tempest-VolumesDeleteCascade-853061173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:21:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.315s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:21:25 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:21:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1895564227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b27efcb1-7959-410d-995d-8452052c1457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='982e66a4fc7849e4bfffe9f4065c11e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:21:23Z,use_quota=True,user_id='978b17455dc74a5f938498c5e71dcf48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:21:25 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Creating volume b27efcb1-7959-410d-995d-8452052c1457 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:21:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:21:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:21:25 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:21:25 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:21:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:21:25 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:21:25 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:21:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b27efcb1-7959-410d-995d-8452052c1457 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:25 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb432574-e79a-4428-9d30-d2434727946e tempest-VolumesDeleteCascade-853061173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd378d88-d7f9-41f9-aaa3-1eeec53dbbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:25 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb432574-e79a-4428-9d30-d2434727946e tempest-VolumesDeleteCascade-853061173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe5cc74d-cedd-4be0-b140-43fbd2dce2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:25 devstack sudo[96892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b27efcb1-7959-410d-995d-8452052c1457 1073741824 Aug 31 15:21:25 devstack sudo[96892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:25 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-eb432574-e79a-4428-9d30-d2434727946e tempest-VolumesDeleteCascade-853061173 None] Volume volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a (6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a): created successfully Aug 31 15:21:25 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb432574-e79a-4428-9d30-d2434727946e tempest-VolumesDeleteCascade-853061173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe5cc74d-cedd-4be0-b140-43fbd2dce2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:25 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb432574-e79a-4428-9d30-d2434727946e tempest-VolumesDeleteCascade-853061173 None] Flow 'volume_create_manager' (ff85075b-2a6f-44a0-93bd-e75d1677a62b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:21:25 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-eb432574-e79a-4428-9d30-d2434727946e tempest-VolumesDeleteCascade-853061173 None] Created volume successfully. Aug 31 15:21:26 devstack sudo[96892]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b27efcb1-7959-410d-995d-8452052c1457 1073741824" returned: 0 in 0.586s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b27efcb1-7959-410d-995d-8452052c1457 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:26 devstack sudo[96898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b27efcb1-7959-410d-995d-8452052c1457 Aug 31 15:21:26 devstack sudo[96898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:26 devstack sudo[96898]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b27efcb1-7959-410d-995d-8452052c1457" returned: 0 in 0.365s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:26 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:21:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:21:26 devstack cinder-volume[86000]: DEBUG cinder.volume.volume_utils [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Attempting download of 20bdf4f4-1731-4a30-8e37-8e698c01bf5d ((None, [{'url': 'file:///opt/stack/data/glance/images/20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'metadata': {}}])) to volume b27efcb1-7959-410d-995d-8452052c1457. {{(pid=86000) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 31 15:21:27 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e8217b-21ec-4813-952a-6078a3326d6b]: (4, 'raw') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:21:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_xir5n4wc {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f72964b4-1f8f-4372-a863-1162be328a74 tempest-VolumesDeleteCascade-853061173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:21:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f72964b4-1f8f-4372-a863-1162be328a74 tempest-VolumesDeleteCascade-853061173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:21:27 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-f72964b4-1f8f-4372-a863-1162be328a74 tempest-VolumesDeleteCascade-853061173 None] Creating offline snapshot 68960609-1f9c-4d1b-9d79-79629e682ccd of volume 6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:21:27 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a32a52-cee3-416c-a7ab-57dd6a0ace86]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:21:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f72964b4-1f8f-4372-a863-1162be328a74 tempest-VolumesDeleteCascade-853061173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:27 devstack sudo[96901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_xir5n4wc Aug 31 15:21:27 devstack sudo[96901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:27 devstack sudo[96902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a Aug 31 15:21:27 devstack sudo[96902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:27 devstack sudo[96901]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_xir5n4wc" returned: 0 in 0.513s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_xir5n4wc {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:27 devstack sudo[96907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_xir5n4wc Aug 31 15:21:27 devstack sudo[96907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:27 devstack sudo[96902]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f72964b4-1f8f-4372-a863-1162be328a74 tempest-VolumesDeleteCascade-853061173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a" returned: 0 in 0.551s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f72964b4-1f8f-4372-a863-1162be328a74 tempest-VolumesDeleteCascade-853061173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a.68960609-1f9c-4d1b-9d79-79629e682ccd 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:27 devstack sudo[96912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a.68960609-1f9c-4d1b-9d79-79629e682ccd 1G Aug 31 15:21:27 devstack sudo[96912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:28 devstack sudo[96907]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_xir5n4wc" returned: 1 in 0.432s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_xir5n4wc' failed. Not Retrying. {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 31 15:21:28 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1689f1e-62c9-40bf-8e01-821cae415f91]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:21:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_ez2pabswdevstack@QuobyteHD {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:28 devstack sudo[96916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_ez2pabswdevstack@QuobyteHD Aug 31 15:21:28 devstack sudo[96916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:28 devstack sudo[96916]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_ez2pabswdevstack@QuobyteHD" returned: 0 in 0.450s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:28 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] 20bdf4f4-1731-4a30-8e37-8e698c01bf5d was qcow2, converting to qcow2 {{(pid=86000) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 31 15:21:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_ez2pabswdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b27efcb1-7959-410d-995d-8452052c1457 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:28 devstack sudo[96912]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f72964b4-1f8f-4372-a863-1162be328a74 tempest-VolumesDeleteCascade-853061173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a.68960609-1f9c-4d1b-9d79-79629e682ccd 1G" returned: 0 in 0.741s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:28 devstack sudo[96926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_ez2pabswdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b27efcb1-7959-410d-995d-8452052c1457 Aug 31 15:21:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f72964b4-1f8f-4372-a863-1162be328a74 tempest-VolumesDeleteCascade-853061173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a.68960609-1f9c-4d1b-9d79-79629e682ccd {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:28 devstack sudo[96926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:28 devstack sudo[96928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a.68960609-1f9c-4d1b-9d79-79629e682ccd Aug 31 15:21:28 devstack sudo[96928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:29 devstack sudo[96928]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f72964b4-1f8f-4372-a863-1162be328a74 tempest-VolumesDeleteCascade-853061173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a.68960609-1f9c-4d1b-9d79-79629e682ccd" returned: 0 in 0.505s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:29 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-f72964b4-1f8f-4372-a863-1162be328a74 tempest-VolumesDeleteCascade-853061173 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a.68960609-1f9c-4d1b-9d79-79629e682ccd is being set with open permissions: ugo+rw Aug 31 15:21:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f72964b4-1f8f-4372-a863-1162be328a74 tempest-VolumesDeleteCascade-853061173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a.68960609-1f9c-4d1b-9d79-79629e682ccd {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:29 devstack sudo[96937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a.68960609-1f9c-4d1b-9d79-79629e682ccd Aug 31 15:21:29 devstack sudo[96937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:29 devstack sudo[96937]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f72964b4-1f8f-4372-a863-1162be328a74 tempest-VolumesDeleteCascade-853061173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a.68960609-1f9c-4d1b-9d79-79629e682ccd" returned: 0 in 0.437s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:29 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:UPDATE=214,cinder:SELECT=162,cinder:INSERT=49,cinder:DELETE=13 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:21:29 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:SELECT=178,cinder:INSERT=49,cinder:UPDATE=188,cinder:DELETE=13 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:21:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f72964b4-1f8f-4372-a863-1162be328a74 tempest-VolumesDeleteCascade-853061173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:29 devstack sudo[96942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a.info Aug 31 15:21:29 devstack sudo[96942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:29 devstack sudo[96942]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f72964b4-1f8f-4372-a863-1162be328a74 tempest-VolumesDeleteCascade-853061173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a.info" returned: 0 in 0.350s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:29 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-f72964b4-1f8f-4372-a863-1162be328a74 tempest-VolumesDeleteCascade-853061173 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a.info is being set with open permissions: ugo+rw Aug 31 15:21:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f72964b4-1f8f-4372-a863-1162be328a74 tempest-VolumesDeleteCascade-853061173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:29 devstack sudo[96946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a.info Aug 31 15:21:29 devstack sudo[96946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:30 devstack sudo[96946]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f72964b4-1f8f-4372-a863-1162be328a74 tempest-VolumesDeleteCascade-853061173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a.info" returned: 0 in 0.292s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f72964b4-1f8f-4372-a863-1162be328a74 tempest-VolumesDeleteCascade-853061173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.078s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:21:30 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-f72964b4-1f8f-4372-a863-1162be328a74 tempest-VolumesDeleteCascade-853061173 None] Create snapshot completed successfully Aug 31 15:21:30 devstack sudo[96926]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_ez2pabswdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b27efcb1-7959-410d-995d-8452052c1457" returned: 0 in 2.494s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:30 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_ez2pabswdevstack@QuobyteHD, size 112.00 MB, duration 2.49 sec, destination /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b27efcb1-7959-410d-995d-8452052c1457 {{(pid=86000) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 31 15:21:30 devstack cinder-volume[86000]: INFO cinder.image.image_utils [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Converted 112.00 MB image at 44.89 MB/s Aug 31 15:21:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b27efcb1-7959-410d-995d-8452052c1457 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:31 devstack sudo[96949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b27efcb1-7959-410d-995d-8452052c1457 1G Aug 31 15:21:31 devstack sudo[96949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:31 devstack sudo[96949]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b27efcb1-7959-410d-995d-8452052c1457 1G" returned: 0 in 0.413s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:31 devstack cinder-volume[86000]: DEBUG cinder.volume.volume_utils [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Downloaded image 20bdf4f4-1731-4a30-8e37-8e698c01bf5d ((None, [{'url': 'file:///opt/stack/data/glance/images/20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'metadata': {}}])) to volume b27efcb1-7959-410d-995d-8452052c1457 successfully. {{(pid=86000) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 31 15:21:31 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Temporary image 20bdf4f4-1731-4a30-8e37-8e698c01bf5d for user 978b17455dc74a5f938498c5e71dcf48 is deleted. {{(pid=86000) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 31 15:21:31 devstack cinder-volume[86000]: DEBUG cinder.volume.volume_utils [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Marking volume b27efcb1-7959-410d-995d-8452052c1457 as bootable. {{(pid=86000) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 31 15:21:31 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1f831db-c125-49a1-992a-2d7b7b9e6873 tempest-VolumeTypesAccessTest-1909749631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:21:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f1f831db-c125-49a1-992a-2d7b7b9e6873 tempest-VolumeTypesAccessTest-1909749631 None] Flow 'volume_create_manager' (73ac6f30-abe1-416d-bbe9-d8309c5bed39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:21:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f1f831db-c125-49a1-992a-2d7b7b9e6873 tempest-VolumeTypesAccessTest-1909749631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb0326fa-66f8-4222-8dc8-1bfc72a1dcfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:31 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Copying metadata from image 20bdf4f4-1731-4a30-8e37-8e698c01bf5d to b27efcb1-7959-410d-995d-8452052c1457. {{(pid=86000) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 31 15:21:31 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Creating volume glance metadata for volume b27efcb1-7959-410d-995d-8452052c1457 backed by image 20bdf4f4-1731-4a30-8e37-8e698c01bf5d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86000) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 31 15:21:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f1f831db-c125-49a1-992a-2d7b7b9e6873 tempest-VolumeTypesAccessTest-1909749631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb0326fa-66f8-4222-8dc8-1bfc72a1dcfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1441528386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de195f8f-04e1-4b3e-86a6-4a2c2a6a2261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='823c6ef1162d448aa5c5cc28b4db4e29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:21:31Z,use_quota=True,user_id='b0cdf90165aa46318e02debc76d405f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d8d508a-1888-472a-b122-dc6939515572),volume_type_id=5d8d508a-1888-472a-b122-dc6939515572)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f1f831db-c125-49a1-992a-2d7b7b9e6873 tempest-VolumeTypesAccessTest-1909749631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0fb98ee-e9cd-4c57-8580-2209b81835f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f1f831db-c125-49a1-992a-2d7b7b9e6873 tempest-VolumeTypesAccessTest-1909749631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0fb98ee-e9cd-4c57-8580-2209b81835f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f1f831db-c125-49a1-992a-2d7b7b9e6873 tempest-VolumeTypesAccessTest-1909749631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c050cc85-d9ac-48f4-85da-bae95972b3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f1f831db-c125-49a1-992a-2d7b7b9e6873 tempest-VolumeTypesAccessTest-1909749631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c050cc85-d9ac-48f4-85da-bae95972b3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de195f8f-04e1-4b3e-86a6-4a2c2a6a2261', 'volume_name': 'volume-de195f8f-04e1-4b3e-86a6-4a2c2a6a2261', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f1f831db-c125-49a1-992a-2d7b7b9e6873 tempest-VolumeTypesAccessTest-1909749631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c97e85b-3171-46b0-b7b4-5d2615e0793f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f1f831db-c125-49a1-992a-2d7b7b9e6873 tempest-VolumeTypesAccessTest-1909749631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c97e85b-3171-46b0-b7b4-5d2615e0793f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f1f831db-c125-49a1-992a-2d7b7b9e6873 tempest-VolumeTypesAccessTest-1909749631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6d493de-3c50-4734-ae4a-76f4a8b76111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:31 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-f1f831db-c125-49a1-992a-2d7b7b9e6873 tempest-VolumeTypesAccessTest-1909749631 None] Volume de195f8f-04e1-4b3e-86a6-4a2c2a6a2261: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de195f8f-04e1-4b3e-86a6-4a2c2a6a2261', 'volume_size': 1} Aug 31 15:21:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f1f831db-c125-49a1-992a-2d7b7b9e6873 tempest-VolumeTypesAccessTest-1909749631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:21:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f1f831db-c125-49a1-992a-2d7b7b9e6873 tempest-VolumeTypesAccessTest-1909749631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:21:31 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f1f831db-c125-49a1-992a-2d7b7b9e6873 tempest-VolumeTypesAccessTest-1909749631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1441528386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de195f8f-04e1-4b3e-86a6-4a2c2a6a2261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='823c6ef1162d448aa5c5cc28b4db4e29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:21:31Z,use_quota=True,user_id='b0cdf90165aa46318e02debc76d405f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d8d508a-1888-472a-b122-dc6939515572),volume_type_id=5d8d508a-1888-472a-b122-dc6939515572)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:21:31 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-f1f831db-c125-49a1-992a-2d7b7b9e6873 tempest-VolumeTypesAccessTest-1909749631 None] Creating volume de195f8f-04e1-4b3e-86a6-4a2c2a6a2261 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:21:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f1f831db-c125-49a1-992a-2d7b7b9e6873 tempest-VolumeTypesAccessTest-1909749631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:21:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f1f831db-c125-49a1-992a-2d7b7b9e6873 tempest-VolumeTypesAccessTest-1909749631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:21:31 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f1f831db-c125-49a1-992a-2d7b7b9e6873 tempest-VolumeTypesAccessTest-1909749631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:21:31 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f1f831db-c125-49a1-992a-2d7b7b9e6873 tempest-VolumeTypesAccessTest-1909749631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:21:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f1f831db-c125-49a1-992a-2d7b7b9e6873 tempest-VolumeTypesAccessTest-1909749631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:21:31 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f1f831db-c125-49a1-992a-2d7b7b9e6873 tempest-VolumeTypesAccessTest-1909749631 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:21:31 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-f1f831db-c125-49a1-992a-2d7b7b9e6873 tempest-VolumeTypesAccessTest-1909749631 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:21:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f1f831db-c125-49a1-992a-2d7b7b9e6873 tempest-VolumeTypesAccessTest-1909749631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-de195f8f-04e1-4b3e-86a6-4a2c2a6a2261 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:31 devstack sudo[96954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-de195f8f-04e1-4b3e-86a6-4a2c2a6a2261 1073741824 Aug 31 15:21:31 devstack sudo[96954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8480189-2d7c-4a51-94e2-5b6b3ffd9ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b27efcb1-7959-410d-995d-8452052c1457', 'volume_size': 1, 'image_id': '20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '567fd89339ed4743bca5bfab8ec3766d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'created_at': datetime.datetime(2026, 8, 31, 13, 6, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 13, 6, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20bdf4f4-1731-4a30-8e37-8e698c01bf5d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16862ef6-5776-4669-83bc-b504966fafc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:31 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Volume volume-b27efcb1-7959-410d-995d-8452052c1457 (b27efcb1-7959-410d-995d-8452052c1457): created successfully Aug 31 15:21:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16862ef6-5776-4669-83bc-b504966fafc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Flow 'volume_create_manager' (7f747194-4b98-40dd-88ef-68166089961b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:21:31 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-eab6dc63-78e9-482a-a2ed-1ef691121833 tempest-VolumesImageMetadata-1866322160 None] Created volume successfully. Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Flow 'volume_create_manager' (fe73677a-0094-4e15-9733-6367fb6413b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1884361e-6a97-4423-8cad-5342491cad7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1884361e-6a97-4423-8cad-5342491cad7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2090061064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=107e9835-10cc-401a-8817-e66a604023e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6327f302d19d4be3bd563f33a327f576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=68960609-1f9c-4d1b-9d79-79629e682ccd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:21:32Z,use_quota=True,user_id='0d5716deed304813b32a716326b7d3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d2184d-508d-4cd7-a273-b4ad95aeade1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d2184d-508d-4cd7-a273-b4ad95aeade1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d96a351e-9d3a-42fc-b95c-d5a0470b4f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d96a351e-9d3a-42fc-b95c-d5a0470b4f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '107e9835-10cc-401a-8817-e66a604023e3', 'volume_name': 'volume-107e9835-10cc-401a-8817-e66a604023e3', 'volume_size': 1, 'snapshot_id': '68960609-1f9c-4d1b-9d79-79629e682ccd'}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05657159-20ea-487a-9bba-64a8cdb0962b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05657159-20ea-487a-9bba-64a8cdb0962b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (438d87ee-cdda-463d-91d8-9c798496b11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:32 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Volume 107e9835-10cc-401a-8817-e66a604023e3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-107e9835-10cc-401a-8817-e66a604023e3', 'volume_size': 1, 'snapshot_id': '68960609-1f9c-4d1b-9d79-79629e682ccd'} Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:21:32 devstack sudo[96954]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f1f831db-c125-49a1-992a-2d7b7b9e6873 tempest-VolumeTypesAccessTest-1909749631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-de195f8f-04e1-4b3e-86a6-4a2c2a6a2261 1073741824" returned: 0 in 0.687s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f1f831db-c125-49a1-992a-2d7b7b9e6873 tempest-VolumeTypesAccessTest-1909749631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-de195f8f-04e1-4b3e-86a6-4a2c2a6a2261 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:32 devstack sudo[96960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-de195f8f-04e1-4b3e-86a6-4a2c2a6a2261 Aug 31 15:21:32 devstack sudo[96960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:32 devstack sudo[96960]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f1f831db-c125-49a1-992a-2d7b7b9e6873 tempest-VolumeTypesAccessTest-1909749631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-de195f8f-04e1-4b3e-86a6-4a2c2a6a2261" returned: 0 in 0.300s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f1f831db-c125-49a1-992a-2d7b7b9e6873 tempest-VolumeTypesAccessTest-1909749631 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f1f831db-c125-49a1-992a-2d7b7b9e6873 tempest-VolumeTypesAccessTest-1909749631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.366s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Acquiring lock "cinder-quobyte-68960609-1f9c-4d1b-9d79-79629e682ccd-107e9835-10cc-401a-8817-e66a604023e3" by "_create_volume_from_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f1f831db-c125-49a1-992a-2d7b7b9e6873 tempest-VolumeTypesAccessTest-1909749631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6d493de-3c50-4734-ae4a-76f4a8b76111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de195f8f-04e1-4b3e-86a6-4a2c2a6a2261', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f1f831db-c125-49a1-992a-2d7b7b9e6873 tempest-VolumeTypesAccessTest-1909749631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b0b4aba-7949-4867-82a4-06ea6202e297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Lock "cinder-quobyte-68960609-1f9c-4d1b-9d79-79629e682ccd-107e9835-10cc-401a-8817-e66a604023e3" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Creating volume 107e9835-10cc-401a-8817-e66a604023e3 from snapshot 68960609-1f9c-4d1b-9d79-79629e682ccd {{(pid=86000) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Acquiring lock "cinder-quobyte-107e9835-10cc-401a-8817-e66a604023e3" by "_copy_volume_from_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-799ca006-75cb-46e8-8f77-e1b0dce74bf6 tempest-VolumesImageMetadata-1866322160 None] Acquiring lock "cinder-b27efcb1-7959-410d-995d-8452052c1457-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Lock "cinder-quobyte-107e9835-10cc-401a-8817-e66a604023e3" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] snapshot: 68960609-1f9c-4d1b-9d79-79629e682ccd, volume: 107e9835-10cc-401a-8817-e66a604023e3, {{(pid=86000) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 31 15:21:32 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-f1f831db-c125-49a1-992a-2d7b7b9e6873 tempest-VolumeTypesAccessTest-1909749631 None] Volume volume-de195f8f-04e1-4b3e-86a6-4a2c2a6a2261 (de195f8f-04e1-4b3e-86a6-4a2c2a6a2261): created successfully Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f1f831db-c125-49a1-992a-2d7b7b9e6873 tempest-VolumeTypesAccessTest-1909749631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b0b4aba-7949-4867-82a4-06ea6202e297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f1f831db-c125-49a1-992a-2d7b7b9e6873 tempest-VolumeTypesAccessTest-1909749631 None] Flow 'volume_create_manager' (73ac6f30-abe1-416d-bbe9-d8309c5bed39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-799ca006-75cb-46e8-8f77-e1b0dce74bf6 tempest-VolumesImageMetadata-1866322160 None] Lock "cinder-b27efcb1-7959-410d-995d-8452052c1457-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:21:32 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-f1f831db-c125-49a1-992a-2d7b7b9e6873 tempest-VolumeTypesAccessTest-1909749631 None] Created volume successfully. Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e0a783-504d-4e70-bda0-81c30a31526b]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a.68960609-1f9c-4d1b-9d79-79629e682ccd {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-799ca006-75cb-46e8-8f77-e1b0dce74bf6 tempest-VolumesImageMetadata-1866322160 None] Acquiring lock "cinder-quobyte-b27efcb1-7959-410d-995d-8452052c1457" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-799ca006-75cb-46e8-8f77-e1b0dce74bf6 tempest-VolumesImageMetadata-1866322160 None] Lock "cinder-quobyte-b27efcb1-7959-410d-995d-8452052c1457" acquired by "delete_volume" :: waited 0.018s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94ced86-b973-41c8-ab55-0b662274a9cb]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:21:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-799ca006-75cb-46e8-8f77-e1b0dce74bf6 tempest-VolumesImageMetadata-1866322160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b27efcb1-7959-410d-995d-8452052c1457 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:32 devstack sudo[96963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a.68960609-1f9c-4d1b-9d79-79629e682ccd Aug 31 15:21:32 devstack sudo[96963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:32 devstack sudo[96964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b27efcb1-7959-410d-995d-8452052c1457 Aug 31 15:21:32 devstack sudo[96964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:33 devstack sudo[96963]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a.68960609-1f9c-4d1b-9d79-79629e682ccd" returned: 0 in 0.426s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:33 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:21:33 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[48864736-33f9-47ac-a0d6-e5e1225a6096]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:21:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:33 devstack sudo[96964]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-799ca006-75cb-46e8-8f77-e1b0dce74bf6 tempest-VolumesImageMetadata-1866322160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b27efcb1-7959-410d-995d-8452052c1457" returned: 0 in 0.419s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-799ca006-75cb-46e8-8f77-e1b0dce74bf6 tempest-VolumesImageMetadata-1866322160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b27efcb1-7959-410d-995d-8452052c1457 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:33 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b27efcb1-7959-410d-995d-8452052c1457 Aug 31 15:21:33 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:33 devstack sudo[96973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a Aug 31 15:21:33 devstack sudo[96973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:33 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b9fd2145-5aba-44ea-80fe-0f63951350e8 tempest-VolumeTypesAccessTest-1909749631 None] Acquiring lock "cinder-de195f8f-04e1-4b3e-86a6-4a2c2a6a2261-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:21:33 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-799ca006-75cb-46e8-8f77-e1b0dce74bf6 tempest-VolumesImageMetadata-1866322160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b27efcb1-7959-410d-995d-8452052c1457" returned: 0 in 0.390s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:33 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b9fd2145-5aba-44ea-80fe-0f63951350e8 tempest-VolumeTypesAccessTest-1909749631 None] Lock "cinder-de195f8f-04e1-4b3e-86a6-4a2c2a6a2261-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:21:33 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-799ca006-75cb-46e8-8f77-e1b0dce74bf6 tempest-VolumesImageMetadata-1866322160 None] Lock "cinder-quobyte-b27efcb1-7959-410d-995d-8452052c1457" released by "delete_volume" :: held 0.858s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:21:33 devstack sudo[96973]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:33 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b9fd2145-5aba-44ea-80fe-0f63951350e8 tempest-VolumeTypesAccessTest-1909749631 None] Acquiring lock "cinder-quobyte-de195f8f-04e1-4b3e-86a6-4a2c2a6a2261" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:21:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a" returned: 0 in 0.517s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:33 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a {{(pid=86000) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 31 15:21:33 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Creating direct copy from snapshot {{(pid=86000) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 31 15:21:33 devstack cinder-volume[86000]: DEBUG cinder.utils [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Path /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-107e9835-10cc-401a-8817-e66a604023e3 not found in is_blk_device check {{(pid=86000) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 31 15:21:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-107e9835-10cc-401a-8817-e66a604023e3 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:33 devstack sudo[96986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-107e9835-10cc-401a-8817-e66a604023e3 Aug 31 15:21:33 devstack sudo[96986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:33 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b9fd2145-5aba-44ea-80fe-0f63951350e8 tempest-VolumeTypesAccessTest-1909749631 None] Lock "cinder-quobyte-de195f8f-04e1-4b3e-86a6-4a2c2a6a2261" acquired by "delete_volume" :: waited 0.072s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:21:33 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d7c587-3940-4b5b-ae45-f0a1e02816fe]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:21:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b9fd2145-5aba-44ea-80fe-0f63951350e8 tempest-VolumeTypesAccessTest-1909749631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-de195f8f-04e1-4b3e-86a6-4a2c2a6a2261 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:33 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-799ca006-75cb-46e8-8f77-e1b0dce74bf6 tempest-VolumesImageMetadata-1866322160 None] Created reservations ['92888cb1-1401-4506-b6f0-8efb7042faa9', '567b15ca-578f-4778-9ded-8af982280752', 'beef92e3-6b38-4e3f-bb49-d9748fce67ba', '7533ab03-0f82-4795-a2cb-9cf84f1ed92c'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:21:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-799ca006-75cb-46e8-8f77-e1b0dce74bf6 tempest-VolumesImageMetadata-1866322160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:21:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-799ca006-75cb-46e8-8f77-e1b0dce74bf6 tempest-VolumesImageMetadata-1866322160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:21:33 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-799ca006-75cb-46e8-8f77-e1b0dce74bf6 tempest-VolumesImageMetadata-1866322160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:21:33 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-799ca006-75cb-46e8-8f77-e1b0dce74bf6 tempest-VolumesImageMetadata-1866322160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:21:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-799ca006-75cb-46e8-8f77-e1b0dce74bf6 tempest-VolumesImageMetadata-1866322160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:21:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-799ca006-75cb-46e8-8f77-e1b0dce74bf6 tempest-VolumesImageMetadata-1866322160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:33 devstack sudo[96989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:21:33 devstack sudo[96989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:33 devstack sudo[96988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-de195f8f-04e1-4b3e-86a6-4a2c2a6a2261 Aug 31 15:21:33 devstack sudo[96988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:34 devstack sudo[96989]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-799ca006-75cb-46e8-8f77-e1b0dce74bf6 tempest-VolumesImageMetadata-1866322160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.338s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:34 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-799ca006-75cb-46e8-8f77-e1b0dce74bf6 tempest-VolumesImageMetadata-1866322160 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:21:34 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-799ca006-75cb-46e8-8f77-e1b0dce74bf6 tempest-VolumesImageMetadata-1866322160 None] Deleted volume successfully. Aug 31 15:21:34 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-799ca006-75cb-46e8-8f77-e1b0dce74bf6 tempest-VolumesImageMetadata-1866322160 None] Lock "cinder-b27efcb1-7959-410d-995d-8452052c1457-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:21:34 devstack sudo[96988]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b9fd2145-5aba-44ea-80fe-0f63951350e8 tempest-VolumeTypesAccessTest-1909749631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-de195f8f-04e1-4b3e-86a6-4a2c2a6a2261" returned: 0 in 0.647s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b9fd2145-5aba-44ea-80fe-0f63951350e8 tempest-VolumeTypesAccessTest-1909749631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-de195f8f-04e1-4b3e-86a6-4a2c2a6a2261 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:34 devstack sudo[97006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-de195f8f-04e1-4b3e-86a6-4a2c2a6a2261 Aug 31 15:21:34 devstack sudo[97006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:35 devstack sudo[97006]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b9fd2145-5aba-44ea-80fe-0f63951350e8 tempest-VolumeTypesAccessTest-1909749631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-de195f8f-04e1-4b3e-86a6-4a2c2a6a2261" returned: 0 in 0.826s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:35 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b9fd2145-5aba-44ea-80fe-0f63951350e8 tempest-VolumeTypesAccessTest-1909749631 None] Lock "cinder-quobyte-de195f8f-04e1-4b3e-86a6-4a2c2a6a2261" released by "delete_volume" :: held 1.549s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:21:35 devstack cinder-volume[86000]: WARNING cinder.quota [None req-b9fd2145-5aba-44ea-80fe-0f63951350e8 tempest-VolumeTypesAccessTest-1909749631 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-917227202 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-917227202, it is now deprecated. Please use the default quota class for default quota. Aug 31 15:21:35 devstack cinder-volume[86000]: WARNING cinder.quota [None req-b9fd2145-5aba-44ea-80fe-0f63951350e8 tempest-VolumeTypesAccessTest-1909749631 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-917227202 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-917227202, it is now deprecated. Please use the default quota class for default quota. Aug 31 15:21:35 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-b9fd2145-5aba-44ea-80fe-0f63951350e8 tempest-VolumeTypesAccessTest-1909749631 None] Created reservations ['84144d66-3899-43f3-81a4-012c01881d2f', 'a7cb1280-164a-4e76-b98a-da068f426624', 'a1f5323d-428a-4e88-9bda-170790a9abc9', 'eb856c0a-0e95-4838-a36b-d660d8f0f201'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:21:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b9fd2145-5aba-44ea-80fe-0f63951350e8 tempest-VolumeTypesAccessTest-1909749631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:21:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b9fd2145-5aba-44ea-80fe-0f63951350e8 tempest-VolumeTypesAccessTest-1909749631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:21:35 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-b9fd2145-5aba-44ea-80fe-0f63951350e8 tempest-VolumeTypesAccessTest-1909749631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:21:35 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-b9fd2145-5aba-44ea-80fe-0f63951350e8 tempest-VolumeTypesAccessTest-1909749631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:21:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b9fd2145-5aba-44ea-80fe-0f63951350e8 tempest-VolumeTypesAccessTest-1909749631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:21:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b9fd2145-5aba-44ea-80fe-0f63951350e8 tempest-VolumeTypesAccessTest-1909749631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:35 devstack sudo[97010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:21:35 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:36 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b9fd2145-5aba-44ea-80fe-0f63951350e8 tempest-VolumeTypesAccessTest-1909749631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 1.009s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:36 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-b9fd2145-5aba-44ea-80fe-0f63951350e8 tempest-VolumeTypesAccessTest-1909749631 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:21:36 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-b9fd2145-5aba-44ea-80fe-0f63951350e8 tempest-VolumeTypesAccessTest-1909749631 None] Deleted volume successfully. Aug 31 15:21:36 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b9fd2145-5aba-44ea-80fe-0f63951350e8 tempest-VolumeTypesAccessTest-1909749631 None] Lock "cinder-de195f8f-04e1-4b3e-86a6-4a2c2a6a2261-delete_volume" released by "delete_volume" :: held 3.181s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:21:40 devstack sudo[96986]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-107e9835-10cc-401a-8817-e66a604023e3" returned: 0 in 7.038s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:40 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a, size 1024.00 MB, duration 7.04 sec, destination /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-107e9835-10cc-401a-8817-e66a604023e3 {{(pid=86000) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 31 15:21:40 devstack cinder-volume[86000]: INFO cinder.image.image_utils [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Converted 1024.00 MB image at 145.47 MB/s Aug 31 15:21:40 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-107e9835-10cc-401a-8817-e66a604023e3 is being set with open permissions: ugo+rw Aug 31 15:21:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-107e9835-10cc-401a-8817-e66a604023e3 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:40 devstack sudo[97045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-107e9835-10cc-401a-8817-e66a604023e3 Aug 31 15:21:40 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:41 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-107e9835-10cc-401a-8817-e66a604023e3" returned: 0 in 0.422s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:41 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Lock "cinder-quobyte-107e9835-10cc-401a-8817-e66a604023e3" released by "_copy_volume_from_snapshot" :: held 8.547s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:21:41 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Lock "cinder-quobyte-68960609-1f9c-4d1b-9d79-79629e682ccd-107e9835-10cc-401a-8817-e66a604023e3" released by "_create_volume_from_snapshot" :: held 8.663s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:21:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.707s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:21:41 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (438d87ee-cdda-463d-91d8-9c798496b11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-107e9835-10cc-401a-8817-e66a604023e3', 'volume_size': 1, 'snapshot_id': '68960609-1f9c-4d1b-9d79-79629e682ccd'}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:41 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (714ee0bc-63c6-4514-9059-4dbe7ca52b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:41 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Volume volume-107e9835-10cc-401a-8817-e66a604023e3 (107e9835-10cc-401a-8817-e66a604023e3): created successfully Aug 31 15:21:41 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (714ee0bc-63c6-4514-9059-4dbe7ca52b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:41 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Flow 'volume_create_manager' (fe73677a-0094-4e15-9733-6367fb6413b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:21:41 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-4a7c4989-bcce-45ee-8d3c-99544ca394e2 tempest-VolumesDeleteCascade-853061173 None] Created volume successfully. Aug 31 15:21:42 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b3cfdb42-3db2-4aa1-9bcb-e79e54d6d9b8 tempest-VolumesDeleteCascade-853061173 None] Acquiring lock "cinder-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:21:42 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b3cfdb42-3db2-4aa1-9bcb-e79e54d6d9b8 tempest-VolumesDeleteCascade-853061173 None] Lock "cinder-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:21:42 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b3cfdb42-3db2-4aa1-9bcb-e79e54d6d9b8 tempest-VolumesDeleteCascade-853061173 None] Performing cascade delete. {{(pid=86000) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 31 15:21:42 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b3cfdb42-3db2-4aa1-9bcb-e79e54d6d9b8 tempest-VolumesDeleteCascade-853061173 None] Acquiring lock "cinder-68960609-1f9c-4d1b-9d79-79629e682ccd-delete_snapshot" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:21:42 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b3cfdb42-3db2-4aa1-9bcb-e79e54d6d9b8 tempest-VolumesDeleteCascade-853061173 None] Lock "cinder-68960609-1f9c-4d1b-9d79-79629e682ccd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:21:42 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b3cfdb42-3db2-4aa1-9bcb-e79e54d6d9b8 tempest-VolumesDeleteCascade-853061173 None] Acquiring lock "cinder-quobyte-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:21:42 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b3cfdb42-3db2-4aa1-9bcb-e79e54d6d9b8 tempest-VolumesDeleteCascade-853061173 None] Lock "cinder-quobyte-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:21:42 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b3cfdb42-3db2-4aa1-9bcb-e79e54d6d9b8 tempest-VolumesDeleteCascade-853061173 None] Acquiring lock "cinder-quobyte-68960609-1f9c-4d1b-9d79-79629e682ccd" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:21:42 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b3cfdb42-3db2-4aa1-9bcb-e79e54d6d9b8 tempest-VolumesDeleteCascade-853061173 None] Lock "cinder-quobyte-68960609-1f9c-4d1b-9d79-79629e682ccd" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:21:42 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-b3cfdb42-3db2-4aa1-9bcb-e79e54d6d9b8 tempest-VolumesDeleteCascade-853061173 None] Deleting offline snapshot 68960609-1f9c-4d1b-9d79-79629e682ccd of volume 6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:21:42 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-b3cfdb42-3db2-4aa1-9bcb-e79e54d6d9b8 tempest-VolumesDeleteCascade-853061173 None] snapshot_file for this snap is: volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a.68960609-1f9c-4d1b-9d79-79629e682ccd {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:21:42 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd84329-310f-4fa3-9b8a-90afad65e6c6]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:21:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b3cfdb42-3db2-4aa1-9bcb-e79e54d6d9b8 tempest-VolumesDeleteCascade-853061173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a.68960609-1f9c-4d1b-9d79-79629e682ccd {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:43 devstack sudo[97114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a.68960609-1f9c-4d1b-9d79-79629e682ccd Aug 31 15:21:43 devstack sudo[97114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:43 devstack sudo[97114]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b3cfdb42-3db2-4aa1-9bcb-e79e54d6d9b8 tempest-VolumesDeleteCascade-853061173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a.68960609-1f9c-4d1b-9d79-79629e682ccd" returned: 0 in 0.774s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:43 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-b3cfdb42-3db2-4aa1-9bcb-e79e54d6d9b8 tempest-VolumesDeleteCascade-853061173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:21:43 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b428c964-2b74-401c-8d43-32aedac05ec8]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:21:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b3cfdb42-3db2-4aa1-9bcb-e79e54d6d9b8 tempest-VolumesDeleteCascade-853061173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:43 devstack sudo[97128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a Aug 31 15:21:43 devstack sudo[97128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:44 devstack sudo[97128]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b3cfdb42-3db2-4aa1-9bcb-e79e54d6d9b8 tempest-VolumesDeleteCascade-853061173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a" returned: 0 in 0.885s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b3cfdb42-3db2-4aa1-9bcb-e79e54d6d9b8 tempest-VolumesDeleteCascade-853061173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a.68960609-1f9c-4d1b-9d79-79629e682ccd {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:44 devstack sudo[97136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a.68960609-1f9c-4d1b-9d79-79629e682ccd Aug 31 15:21:44 devstack sudo[97136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:45 devstack cinder-volume[86000]: DEBUG oslo_service.periodic_task [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86000) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:21:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:21:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:21:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:21:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:21:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:21:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:45 devstack sudo[97142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:21:45 devstack sudo[97142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:45 devstack sudo[97136]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b3cfdb42-3db2-4aa1-9bcb-e79e54d6d9b8 tempest-VolumesDeleteCascade-853061173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a.68960609-1f9c-4d1b-9d79-79629e682ccd" returned: 0 in 0.636s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b3cfdb42-3db2-4aa1-9bcb-e79e54d6d9b8 tempest-VolumesDeleteCascade-853061173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a.68960609-1f9c-4d1b-9d79-79629e682ccd {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:45 devstack sudo[97144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a.68960609-1f9c-4d1b-9d79-79629e682ccd Aug 31 15:21:45 devstack sudo[97144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:45 devstack sudo[97142]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.376s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:45 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:21:45 devstack cinder-volume[86000]: DEBUG oslo_service.periodic_task [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running periodic task VolumeManager._thread_info {{(pid=86000) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:21:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] thread count: 28 {{(pid=86000) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 31 15:21:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] thread info: [<_MainThread(MainThread, started 137631281086592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86000) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 31 15:21:45 devstack sudo[97144]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b3cfdb42-3db2-4aa1-9bcb-e79e54d6d9b8 tempest-VolumesDeleteCascade-853061173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a.68960609-1f9c-4d1b-9d79-79629e682ccd" returned: 0 in 0.368s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:45 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b3cfdb42-3db2-4aa1-9bcb-e79e54d6d9b8 tempest-VolumesDeleteCascade-853061173 None] Lock "cinder-quobyte-68960609-1f9c-4d1b-9d79-79629e682ccd" released by "_delete_snapshot" :: held 2.833s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:21:45 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b3cfdb42-3db2-4aa1-9bcb-e79e54d6d9b8 tempest-VolumesDeleteCascade-853061173 None] Lock "cinder-quobyte-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a" released by "delete_snapshot" :: held 2.872s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:21:45 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-b3cfdb42-3db2-4aa1-9bcb-e79e54d6d9b8 tempest-VolumesDeleteCascade-853061173 None] Created reservations ['db284a38-071d-4408-b3d5-591bacd1ce26', 'd6972bd5-172c-41d4-8c0e-a7c6f5e6b67c', 'd3c91144-8cd5-4169-aafb-e28b4efafe51', '918bb360-c9c8-4d2d-acb8-fe6233d65afe'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:21:45 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-b3cfdb42-3db2-4aa1-9bcb-e79e54d6d9b8 tempest-VolumesDeleteCascade-853061173 None] Delete snapshot completed successfully. Aug 31 15:21:45 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b3cfdb42-3db2-4aa1-9bcb-e79e54d6d9b8 tempest-VolumesDeleteCascade-853061173 None] Lock "cinder-68960609-1f9c-4d1b-9d79-79629e682ccd-delete_snapshot" released by "delete_snapshot" :: held 3.168s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:21:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b3cfdb42-3db2-4aa1-9bcb-e79e54d6d9b8 tempest-VolumesDeleteCascade-853061173 None] Snapshots deleted, issuing volume delete {{(pid=86000) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 31 15:21:45 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b3cfdb42-3db2-4aa1-9bcb-e79e54d6d9b8 tempest-VolumesDeleteCascade-853061173 None] Acquiring lock "cinder-quobyte-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:21:46 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b3cfdb42-3db2-4aa1-9bcb-e79e54d6d9b8 tempest-VolumesDeleteCascade-853061173 None] Lock "cinder-quobyte-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a" acquired by "delete_volume" :: waited 0.035s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:21:46 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8d2464-bd4f-4256-b7ef-9e7a6428b379]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:21:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b3cfdb42-3db2-4aa1-9bcb-e79e54d6d9b8 tempest-VolumesDeleteCascade-853061173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:46 devstack sudo[97148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a Aug 31 15:21:46 devstack sudo[97148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:46 devstack sudo[97148]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b3cfdb42-3db2-4aa1-9bcb-e79e54d6d9b8 tempest-VolumesDeleteCascade-853061173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a" returned: 0 in 0.575s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b3cfdb42-3db2-4aa1-9bcb-e79e54d6d9b8 tempest-VolumesDeleteCascade-853061173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:46 devstack sudo[97153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a Aug 31 15:21:46 devstack sudo[97153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:47 devstack sudo[97153]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b3cfdb42-3db2-4aa1-9bcb-e79e54d6d9b8 tempest-VolumesDeleteCascade-853061173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a" returned: 0 in 0.467s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:47 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b3cfdb42-3db2-4aa1-9bcb-e79e54d6d9b8 tempest-VolumesDeleteCascade-853061173 None] Lock "cinder-quobyte-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a" released by "delete_volume" :: held 1.186s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:21:47 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-b3cfdb42-3db2-4aa1-9bcb-e79e54d6d9b8 tempest-VolumesDeleteCascade-853061173 None] Created reservations ['a92d0a51-73cd-42c8-91bb-a4df81e59a0b', '8e866406-f398-4685-88fb-837148a0cbd8', '4ca44e6d-5cda-40ff-8350-5b5ab98b3e84', '87f58416-61f3-45bb-836e-72e0814f9476'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:21:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b3cfdb42-3db2-4aa1-9bcb-e79e54d6d9b8 tempest-VolumesDeleteCascade-853061173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:21:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b3cfdb42-3db2-4aa1-9bcb-e79e54d6d9b8 tempest-VolumesDeleteCascade-853061173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:21:47 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-b3cfdb42-3db2-4aa1-9bcb-e79e54d6d9b8 tempest-VolumesDeleteCascade-853061173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:21:47 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-b3cfdb42-3db2-4aa1-9bcb-e79e54d6d9b8 tempest-VolumesDeleteCascade-853061173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:21:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b3cfdb42-3db2-4aa1-9bcb-e79e54d6d9b8 tempest-VolumesDeleteCascade-853061173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:21:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b3cfdb42-3db2-4aa1-9bcb-e79e54d6d9b8 tempest-VolumesDeleteCascade-853061173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:47 devstack sudo[97156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:21:47 devstack sudo[97156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:47 devstack sudo[97156]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b3cfdb42-3db2-4aa1-9bcb-e79e54d6d9b8 tempest-VolumesDeleteCascade-853061173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.474s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:47 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-b3cfdb42-3db2-4aa1-9bcb-e79e54d6d9b8 tempest-VolumesDeleteCascade-853061173 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:21:47 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-b3cfdb42-3db2-4aa1-9bcb-e79e54d6d9b8 tempest-VolumesDeleteCascade-853061173 None] Deleted volume successfully. Aug 31 15:21:47 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b3cfdb42-3db2-4aa1-9bcb-e79e54d6d9b8 tempest-VolumesDeleteCascade-853061173 None] Lock "cinder-6d7e5e61-c5d4-423d-a18d-fc5fe8fab33a-delete_volume" released by "delete_volume" :: held 5.269s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:21:48 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1c07a08-765b-46f6-9743-43f168fea80a tempest-TestMinimumBasicScenario-1400906245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:21:48 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b1c07a08-765b-46f6-9743-43f168fea80a tempest-TestMinimumBasicScenario-1400906245 None] Flow 'volume_create_manager' (2fe43fb2-cc94-4cce-a623-4263943918c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:21:48 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b1c07a08-765b-46f6-9743-43f168fea80a tempest-TestMinimumBasicScenario-1400906245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (459e140b-23ac-4885-ac7a-f5d64a46dd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:48 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b1c07a08-765b-46f6-9743-43f168fea80a tempest-TestMinimumBasicScenario-1400906245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (459e140b-23ac-4885-ac7a-f5d64a46dd38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-493474801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d50ea58a-fa72-4c4a-b6ad-82c115f473aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3c8c87b3f064281819adf97747be4c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:21:48Z,use_quota=True,user_id='15bf988014664c7bbe0553f7cdd86cb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:48 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b1c07a08-765b-46f6-9743-43f168fea80a tempest-TestMinimumBasicScenario-1400906245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5ee9413-2175-4bb7-b8c6-39bf587c846d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:48 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b1c07a08-765b-46f6-9743-43f168fea80a tempest-TestMinimumBasicScenario-1400906245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5ee9413-2175-4bb7-b8c6-39bf587c846d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:48 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b1c07a08-765b-46f6-9743-43f168fea80a tempest-TestMinimumBasicScenario-1400906245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0f20dc4-eb3c-441c-8112-3f9314f6dd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:48 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b1c07a08-765b-46f6-9743-43f168fea80a tempest-TestMinimumBasicScenario-1400906245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0f20dc4-eb3c-441c-8112-3f9314f6dd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd50ea58a-fa72-4c4a-b6ad-82c115f473aa', 'volume_name': 'volume-d50ea58a-fa72-4c4a-b6ad-82c115f473aa', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:48 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b1c07a08-765b-46f6-9743-43f168fea80a tempest-TestMinimumBasicScenario-1400906245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad68d8a8-65e1-40d8-a8bf-83cfb7722c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:48 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b1c07a08-765b-46f6-9743-43f168fea80a tempest-TestMinimumBasicScenario-1400906245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad68d8a8-65e1-40d8-a8bf-83cfb7722c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:48 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b1c07a08-765b-46f6-9743-43f168fea80a tempest-TestMinimumBasicScenario-1400906245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d63f119a-659a-432b-b384-5d5ae8c7bb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:48 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-b1c07a08-765b-46f6-9743-43f168fea80a tempest-TestMinimumBasicScenario-1400906245 None] Volume d50ea58a-fa72-4c4a-b6ad-82c115f473aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d50ea58a-fa72-4c4a-b6ad-82c115f473aa', 'volume_size': 1} Aug 31 15:21:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b1c07a08-765b-46f6-9743-43f168fea80a tempest-TestMinimumBasicScenario-1400906245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:21:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b1c07a08-765b-46f6-9743-43f168fea80a tempest-TestMinimumBasicScenario-1400906245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:21:48 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-b1c07a08-765b-46f6-9743-43f168fea80a tempest-TestMinimumBasicScenario-1400906245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-493474801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d50ea58a-fa72-4c4a-b6ad-82c115f473aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3c8c87b3f064281819adf97747be4c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:21:48Z,use_quota=True,user_id='15bf988014664c7bbe0553f7cdd86cb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:21:48 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-b1c07a08-765b-46f6-9743-43f168fea80a tempest-TestMinimumBasicScenario-1400906245 None] Creating volume d50ea58a-fa72-4c4a-b6ad-82c115f473aa {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:21:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b1c07a08-765b-46f6-9743-43f168fea80a tempest-TestMinimumBasicScenario-1400906245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:21:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b1c07a08-765b-46f6-9743-43f168fea80a tempest-TestMinimumBasicScenario-1400906245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:21:48 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-b1c07a08-765b-46f6-9743-43f168fea80a tempest-TestMinimumBasicScenario-1400906245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:21:48 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-b1c07a08-765b-46f6-9743-43f168fea80a tempest-TestMinimumBasicScenario-1400906245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:21:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b1c07a08-765b-46f6-9743-43f168fea80a tempest-TestMinimumBasicScenario-1400906245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:21:48 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-b1c07a08-765b-46f6-9743-43f168fea80a tempest-TestMinimumBasicScenario-1400906245 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:21:48 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-b1c07a08-765b-46f6-9743-43f168fea80a tempest-TestMinimumBasicScenario-1400906245 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:21:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b1c07a08-765b-46f6-9743-43f168fea80a tempest-TestMinimumBasicScenario-1400906245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d50ea58a-fa72-4c4a-b6ad-82c115f473aa 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:48 devstack sudo[97159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d50ea58a-fa72-4c4a-b6ad-82c115f473aa 1073741824 Aug 31 15:21:48 devstack sudo[97159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:48 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-1d033b9b-316e-4d02-879e-7e1bef8117ee tempest-VolumesDeleteCascade-853061173 None] Acquiring lock "cinder-107e9835-10cc-401a-8817-e66a604023e3-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:21:48 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-1d033b9b-316e-4d02-879e-7e1bef8117ee tempest-VolumesDeleteCascade-853061173 None] Lock "cinder-107e9835-10cc-401a-8817-e66a604023e3-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:21:48 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-1d033b9b-316e-4d02-879e-7e1bef8117ee tempest-VolumesDeleteCascade-853061173 None] Acquiring lock "cinder-quobyte-107e9835-10cc-401a-8817-e66a604023e3" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:21:48 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-1d033b9b-316e-4d02-879e-7e1bef8117ee tempest-VolumesDeleteCascade-853061173 None] Lock "cinder-quobyte-107e9835-10cc-401a-8817-e66a604023e3" acquired by "delete_volume" :: waited 0.034s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:21:48 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce8e8f3-6ede-4d6a-8642-acbba3f08873]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:21:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1d033b9b-316e-4d02-879e-7e1bef8117ee tempest-VolumesDeleteCascade-853061173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-107e9835-10cc-401a-8817-e66a604023e3 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:49 devstack sudo[97164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-107e9835-10cc-401a-8817-e66a604023e3 Aug 31 15:21:49 devstack sudo[97164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:49 devstack sudo[97159]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b1c07a08-765b-46f6-9743-43f168fea80a tempest-TestMinimumBasicScenario-1400906245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d50ea58a-fa72-4c4a-b6ad-82c115f473aa 1073741824" returned: 0 in 0.809s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b1c07a08-765b-46f6-9743-43f168fea80a tempest-TestMinimumBasicScenario-1400906245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d50ea58a-fa72-4c4a-b6ad-82c115f473aa {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:49 devstack sudo[97167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d50ea58a-fa72-4c4a-b6ad-82c115f473aa Aug 31 15:21:49 devstack sudo[97167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:49 devstack sudo[97164]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1d033b9b-316e-4d02-879e-7e1bef8117ee tempest-VolumesDeleteCascade-853061173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-107e9835-10cc-401a-8817-e66a604023e3" returned: 0 in 0.702s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1d033b9b-316e-4d02-879e-7e1bef8117ee tempest-VolumesDeleteCascade-853061173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-107e9835-10cc-401a-8817-e66a604023e3 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:49 devstack sudo[97174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-107e9835-10cc-401a-8817-e66a604023e3 Aug 31 15:21:49 devstack sudo[97174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:50 devstack sudo[97167]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b1c07a08-765b-46f6-9743-43f168fea80a tempest-TestMinimumBasicScenario-1400906245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d50ea58a-fa72-4c4a-b6ad-82c115f473aa" returned: 0 in 0.551s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:50 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-b1c07a08-765b-46f6-9743-43f168fea80a tempest-TestMinimumBasicScenario-1400906245 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:21:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b1c07a08-765b-46f6-9743-43f168fea80a tempest-TestMinimumBasicScenario-1400906245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:21:50 devstack sudo[97174]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b1c07a08-765b-46f6-9743-43f168fea80a tempest-TestMinimumBasicScenario-1400906245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d63f119a-659a-432b-b384-5d5ae8c7bb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d50ea58a-fa72-4c4a-b6ad-82c115f473aa', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b1c07a08-765b-46f6-9743-43f168fea80a tempest-TestMinimumBasicScenario-1400906245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b204d435-d13a-4c7d-be6c-940d0d73de7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1d033b9b-316e-4d02-879e-7e1bef8117ee tempest-VolumesDeleteCascade-853061173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-107e9835-10cc-401a-8817-e66a604023e3" returned: 0 in 0.380s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:50 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-1d033b9b-316e-4d02-879e-7e1bef8117ee tempest-VolumesDeleteCascade-853061173 None] Lock "cinder-quobyte-107e9835-10cc-401a-8817-e66a604023e3" released by "delete_volume" :: held 1.167s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:21:50 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-b1c07a08-765b-46f6-9743-43f168fea80a tempest-TestMinimumBasicScenario-1400906245 None] Volume volume-d50ea58a-fa72-4c4a-b6ad-82c115f473aa (d50ea58a-fa72-4c4a-b6ad-82c115f473aa): created successfully Aug 31 15:21:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b1c07a08-765b-46f6-9743-43f168fea80a tempest-TestMinimumBasicScenario-1400906245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b204d435-d13a-4c7d-be6c-940d0d73de7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b1c07a08-765b-46f6-9743-43f168fea80a tempest-TestMinimumBasicScenario-1400906245 None] Flow 'volume_create_manager' (2fe43fb2-cc94-4cce-a623-4263943918c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:21:50 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-b1c07a08-765b-46f6-9743-43f168fea80a tempest-TestMinimumBasicScenario-1400906245 None] Created volume successfully. Aug 31 15:21:50 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-1d033b9b-316e-4d02-879e-7e1bef8117ee tempest-VolumesDeleteCascade-853061173 None] Created reservations ['c34fc828-f084-414a-a213-4807c3248e87', 'd429227b-ef94-41ef-8a5d-87e339f04d03', '1b7e9530-1426-4796-bf70-ded0a6427fad', '01d0409a-6b02-4646-b43a-28c4abf0f8e8'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:21:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1d033b9b-316e-4d02-879e-7e1bef8117ee tempest-VolumesDeleteCascade-853061173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:21:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1d033b9b-316e-4d02-879e-7e1bef8117ee tempest-VolumesDeleteCascade-853061173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:21:50 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1d033b9b-316e-4d02-879e-7e1bef8117ee tempest-VolumesDeleteCascade-853061173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:21:50 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1d033b9b-316e-4d02-879e-7e1bef8117ee tempest-VolumesDeleteCascade-853061173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:21:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1d033b9b-316e-4d02-879e-7e1bef8117ee tempest-VolumesDeleteCascade-853061173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:21:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1d033b9b-316e-4d02-879e-7e1bef8117ee tempest-VolumesDeleteCascade-853061173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:50 devstack sudo[97178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:21:50 devstack sudo[97178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:50 devstack sudo[97178]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1d033b9b-316e-4d02-879e-7e1bef8117ee tempest-VolumesDeleteCascade-853061173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.517s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:50 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-1d033b9b-316e-4d02-879e-7e1bef8117ee tempest-VolumesDeleteCascade-853061173 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:21:50 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-1d033b9b-316e-4d02-879e-7e1bef8117ee tempest-VolumesDeleteCascade-853061173 None] Deleted volume successfully. Aug 31 15:21:50 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-1d033b9b-316e-4d02-879e-7e1bef8117ee tempest-VolumesDeleteCascade-853061173 None] Lock "cinder-107e9835-10cc-401a-8817-e66a604023e3-delete_volume" released by "delete_volume" :: held 2.134s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:21:51 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-7050ae30-ba0d-47b9-8600-013102c7fcc7 tempest-VolumesTransfersV355Test-1551789175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:21:51 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7050ae30-ba0d-47b9-8600-013102c7fcc7 tempest-VolumesTransfersV355Test-1551789175 None] Flow 'volume_create_manager' (97fcd284-ef08-4ec4-89cc-04ee6eca3752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:21:51 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7050ae30-ba0d-47b9-8600-013102c7fcc7 tempest-VolumesTransfersV355Test-1551789175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55900546-397d-4e76-a2c6-4987731ebccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:51 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7050ae30-ba0d-47b9-8600-013102c7fcc7 tempest-VolumesTransfersV355Test-1551789175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55900546-397d-4e76-a2c6-4987731ebccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1265186951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=046833b1-07a8-4487-97fd-eb002c17aa79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05491912ef444904911d2b89b1cf05a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:21:51Z,use_quota=True,user_id='25c402623c7d45b4bcdc03ccf4635cd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:51 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7050ae30-ba0d-47b9-8600-013102c7fcc7 tempest-VolumesTransfersV355Test-1551789175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384e77ca-a50d-4c90-9057-1d991d933f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:51 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7050ae30-ba0d-47b9-8600-013102c7fcc7 tempest-VolumesTransfersV355Test-1551789175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384e77ca-a50d-4c90-9057-1d991d933f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:51 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7050ae30-ba0d-47b9-8600-013102c7fcc7 tempest-VolumesTransfersV355Test-1551789175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (697ccdc9-0219-47a4-8b6d-8718ed1c56ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:51 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7050ae30-ba0d-47b9-8600-013102c7fcc7 tempest-VolumesTransfersV355Test-1551789175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (697ccdc9-0219-47a4-8b6d-8718ed1c56ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '046833b1-07a8-4487-97fd-eb002c17aa79', 'volume_name': 'volume-046833b1-07a8-4487-97fd-eb002c17aa79', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:51 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7050ae30-ba0d-47b9-8600-013102c7fcc7 tempest-VolumesTransfersV355Test-1551789175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (584aac35-d04d-44c9-aadc-f625c2e7f8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:51 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7050ae30-ba0d-47b9-8600-013102c7fcc7 tempest-VolumesTransfersV355Test-1551789175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (584aac35-d04d-44c9-aadc-f625c2e7f8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:51 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7050ae30-ba0d-47b9-8600-013102c7fcc7 tempest-VolumesTransfersV355Test-1551789175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e4a914-de7f-496b-8ca0-3e9143defada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:51 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-7050ae30-ba0d-47b9-8600-013102c7fcc7 tempest-VolumesTransfersV355Test-1551789175 None] Volume 046833b1-07a8-4487-97fd-eb002c17aa79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-046833b1-07a8-4487-97fd-eb002c17aa79', 'volume_size': 1} Aug 31 15:21:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7050ae30-ba0d-47b9-8600-013102c7fcc7 tempest-VolumesTransfersV355Test-1551789175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:21:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7050ae30-ba0d-47b9-8600-013102c7fcc7 tempest-VolumesTransfersV355Test-1551789175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:21:51 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-7050ae30-ba0d-47b9-8600-013102c7fcc7 tempest-VolumesTransfersV355Test-1551789175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1265186951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=046833b1-07a8-4487-97fd-eb002c17aa79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05491912ef444904911d2b89b1cf05a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:21:51Z,use_quota=True,user_id='25c402623c7d45b4bcdc03ccf4635cd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:21:51 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-7050ae30-ba0d-47b9-8600-013102c7fcc7 tempest-VolumesTransfersV355Test-1551789175 None] Creating volume 046833b1-07a8-4487-97fd-eb002c17aa79 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:21:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7050ae30-ba0d-47b9-8600-013102c7fcc7 tempest-VolumesTransfersV355Test-1551789175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:21:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7050ae30-ba0d-47b9-8600-013102c7fcc7 tempest-VolumesTransfersV355Test-1551789175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:21:51 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-7050ae30-ba0d-47b9-8600-013102c7fcc7 tempest-VolumesTransfersV355Test-1551789175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:21:51 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-7050ae30-ba0d-47b9-8600-013102c7fcc7 tempest-VolumesTransfersV355Test-1551789175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:21:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7050ae30-ba0d-47b9-8600-013102c7fcc7 tempest-VolumesTransfersV355Test-1551789175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:21:51 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-7050ae30-ba0d-47b9-8600-013102c7fcc7 tempest-VolumesTransfersV355Test-1551789175 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:21:51 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-7050ae30-ba0d-47b9-8600-013102c7fcc7 tempest-VolumesTransfersV355Test-1551789175 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:21:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7050ae30-ba0d-47b9-8600-013102c7fcc7 tempest-VolumesTransfersV355Test-1551789175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-046833b1-07a8-4487-97fd-eb002c17aa79 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:51 devstack sudo[97188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-046833b1-07a8-4487-97fd-eb002c17aa79 1073741824 Aug 31 15:21:51 devstack sudo[97188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-963b4144-57d6-42ab-9b8c-0d6dba7782b1 req-3ed91351-8572-4588-b1a0-9b4ca6997ff1 tempest-TestMinimumBasicScenario-1400906245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:21:52 devstack sudo[97188]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7050ae30-ba0d-47b9-8600-013102c7fcc7 tempest-VolumesTransfersV355Test-1551789175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-046833b1-07a8-4487-97fd-eb002c17aa79 1073741824" returned: 0 in 0.662s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7050ae30-ba0d-47b9-8600-013102c7fcc7 tempest-VolumesTransfersV355Test-1551789175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-046833b1-07a8-4487-97fd-eb002c17aa79 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:52 devstack sudo[97197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-046833b1-07a8-4487-97fd-eb002c17aa79 Aug 31 15:21:52 devstack sudo[97197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:52 devstack sudo[97197]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7050ae30-ba0d-47b9-8600-013102c7fcc7 tempest-VolumesTransfersV355Test-1551789175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-046833b1-07a8-4487-97fd-eb002c17aa79" returned: 0 in 0.324s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:52 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-7050ae30-ba0d-47b9-8600-013102c7fcc7 tempest-VolumesTransfersV355Test-1551789175 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:21:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7050ae30-ba0d-47b9-8600-013102c7fcc7 tempest-VolumesTransfersV355Test-1551789175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:21:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-963b4144-57d6-42ab-9b8c-0d6dba7782b1 req-3ed91351-8572-4588-b1a0-9b4ca6997ff1 tempest-TestMinimumBasicScenario-1400906245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.711s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:21:52 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7050ae30-ba0d-47b9-8600-013102c7fcc7 tempest-VolumesTransfersV355Test-1551789175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e4a914-de7f-496b-8ca0-3e9143defada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-046833b1-07a8-4487-97fd-eb002c17aa79', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:52 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7050ae30-ba0d-47b9-8600-013102c7fcc7 tempest-VolumesTransfersV355Test-1551789175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee82830-0607-4db2-8c40-6c1752ce8d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-963b4144-57d6-42ab-9b8c-0d6dba7782b1 req-3ed91351-8572-4588-b1a0-9b4ca6997ff1 tempest-TestMinimumBasicScenario-1400906245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.043s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:21:52 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-7050ae30-ba0d-47b9-8600-013102c7fcc7 tempest-VolumesTransfersV355Test-1551789175 None] Volume volume-046833b1-07a8-4487-97fd-eb002c17aa79 (046833b1-07a8-4487-97fd-eb002c17aa79): created successfully Aug 31 15:21:52 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7050ae30-ba0d-47b9-8600-013102c7fcc7 tempest-VolumesTransfersV355Test-1551789175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee82830-0607-4db2-8c40-6c1752ce8d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:52 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7050ae30-ba0d-47b9-8600-013102c7fcc7 tempest-VolumesTransfersV355Test-1551789175 None] Flow 'volume_create_manager' (97fcd284-ef08-4ec4-89cc-04ee6eca3752) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:21:53 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-7050ae30-ba0d-47b9-8600-013102c7fcc7 tempest-VolumesTransfersV355Test-1551789175 None] Created volume successfully. Aug 31 15:21:53 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-963b4144-57d6-42ab-9b8c-0d6dba7782b1 req-3ed91351-8572-4588-b1a0-9b4ca6997ff1 tempest-TestMinimumBasicScenario-1400906245 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77', 'name': 'volume-d50ea58a-fa72-4c4a-b6ad-82c115f473aa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '82b7983c-86d9-4387-83c1-b809a99b9fec', 'enforce_multipath': True} {{(pid=86000) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 31 15:21:53 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-963b4144-57d6-42ab-9b8c-0d6dba7782b1 req-3ed91351-8572-4588-b1a0-9b4ca6997ff1 tempest-TestMinimumBasicScenario-1400906245 None] attachment_update completed successfully. Aug 31 15:21:54 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-aa4afc7f-3073-4499-b08a-a3ad35f88045 tempest-VolumesTransfersV355Test-122827406 None] Transfer volume completed successfully. Aug 31 15:21:56 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-45caf102-98c8-4ad3-8162-b20d65eb063a tempest-VolumesTransfersV355Test-1365375252 None] Acquiring lock "cinder-046833b1-07a8-4487-97fd-eb002c17aa79-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:21:56 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-45caf102-98c8-4ad3-8162-b20d65eb063a tempest-VolumesTransfersV355Test-1365375252 None] Lock "cinder-046833b1-07a8-4487-97fd-eb002c17aa79-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:21:56 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-45caf102-98c8-4ad3-8162-b20d65eb063a tempest-VolumesTransfersV355Test-1365375252 None] Acquiring lock "cinder-quobyte-046833b1-07a8-4487-97fd-eb002c17aa79" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:21:56 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-45caf102-98c8-4ad3-8162-b20d65eb063a tempest-VolumesTransfersV355Test-1365375252 None] Lock "cinder-quobyte-046833b1-07a8-4487-97fd-eb002c17aa79" acquired by "delete_volume" :: waited 0.033s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:21:56 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2555d9a6-61e7-4ace-9029-7626783e4986]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:21:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-45caf102-98c8-4ad3-8162-b20d65eb063a tempest-VolumesTransfersV355Test-1365375252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-046833b1-07a8-4487-97fd-eb002c17aa79 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:56 devstack sudo[97582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-046833b1-07a8-4487-97fd-eb002c17aa79 Aug 31 15:21:56 devstack sudo[97582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:56 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3bcf235-0f0c-4ae5-90cf-2007917cab52 tempest-VolumesSnapshotListTestJSON-1751633533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:21:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c3bcf235-0f0c-4ae5-90cf-2007917cab52 tempest-VolumesSnapshotListTestJSON-1751633533 None] Flow 'volume_create_manager' (8192363b-b793-48c9-94c7-e9b84dec4a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:21:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c3bcf235-0f0c-4ae5-90cf-2007917cab52 tempest-VolumesSnapshotListTestJSON-1751633533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57a29eae-aedb-4ae5-916a-cb0c6e24d6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c3bcf235-0f0c-4ae5-90cf-2007917cab52 tempest-VolumesSnapshotListTestJSON-1751633533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57a29eae-aedb-4ae5-916a-cb0c6e24d6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-230700355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e17a60c-7628-4996-9772-c5c7b7a7b90f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c7543af4c7c42ccb26e6caa78e659d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:21:56Z,use_quota=True,user_id='3534d91adafb43d8a900b76c9fcbfb1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c3bcf235-0f0c-4ae5-90cf-2007917cab52 tempest-VolumesSnapshotListTestJSON-1751633533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cdaaef5-ba9d-4067-8098-2e3c3a352d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c3bcf235-0f0c-4ae5-90cf-2007917cab52 tempest-VolumesSnapshotListTestJSON-1751633533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cdaaef5-ba9d-4067-8098-2e3c3a352d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c3bcf235-0f0c-4ae5-90cf-2007917cab52 tempest-VolumesSnapshotListTestJSON-1751633533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dad46fa-6f7c-487f-9dd3-35eea79ae909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c3bcf235-0f0c-4ae5-90cf-2007917cab52 tempest-VolumesSnapshotListTestJSON-1751633533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dad46fa-6f7c-487f-9dd3-35eea79ae909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e17a60c-7628-4996-9772-c5c7b7a7b90f', 'volume_name': 'volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c3bcf235-0f0c-4ae5-90cf-2007917cab52 tempest-VolumesSnapshotListTestJSON-1751633533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f45bf957-7244-47ee-ac4b-f9a9a1d0c7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c3bcf235-0f0c-4ae5-90cf-2007917cab52 tempest-VolumesSnapshotListTestJSON-1751633533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f45bf957-7244-47ee-ac4b-f9a9a1d0c7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c3bcf235-0f0c-4ae5-90cf-2007917cab52 tempest-VolumesSnapshotListTestJSON-1751633533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f6daa6a-3533-4c33-a669-91e3953fea50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:56 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-c3bcf235-0f0c-4ae5-90cf-2007917cab52 tempest-VolumesSnapshotListTestJSON-1751633533 None] Volume 3e17a60c-7628-4996-9772-c5c7b7a7b90f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f', 'volume_size': 1} Aug 31 15:21:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c3bcf235-0f0c-4ae5-90cf-2007917cab52 tempest-VolumesSnapshotListTestJSON-1751633533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:21:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c3bcf235-0f0c-4ae5-90cf-2007917cab52 tempest-VolumesSnapshotListTestJSON-1751633533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:21:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c3bcf235-0f0c-4ae5-90cf-2007917cab52 tempest-VolumesSnapshotListTestJSON-1751633533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-230700355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e17a60c-7628-4996-9772-c5c7b7a7b90f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c7543af4c7c42ccb26e6caa78e659d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:21:56Z,use_quota=True,user_id='3534d91adafb43d8a900b76c9fcbfb1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:21:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-c3bcf235-0f0c-4ae5-90cf-2007917cab52 tempest-VolumesSnapshotListTestJSON-1751633533 None] Creating volume 3e17a60c-7628-4996-9772-c5c7b7a7b90f {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:21:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c3bcf235-0f0c-4ae5-90cf-2007917cab52 tempest-VolumesSnapshotListTestJSON-1751633533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:21:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c3bcf235-0f0c-4ae5-90cf-2007917cab52 tempest-VolumesSnapshotListTestJSON-1751633533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:21:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c3bcf235-0f0c-4ae5-90cf-2007917cab52 tempest-VolumesSnapshotListTestJSON-1751633533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:21:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c3bcf235-0f0c-4ae5-90cf-2007917cab52 tempest-VolumesSnapshotListTestJSON-1751633533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:21:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c3bcf235-0f0c-4ae5-90cf-2007917cab52 tempest-VolumesSnapshotListTestJSON-1751633533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:21:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c3bcf235-0f0c-4ae5-90cf-2007917cab52 tempest-VolumesSnapshotListTestJSON-1751633533 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:21:56 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-c3bcf235-0f0c-4ae5-90cf-2007917cab52 tempest-VolumesSnapshotListTestJSON-1751633533 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:21:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c3bcf235-0f0c-4ae5-90cf-2007917cab52 tempest-VolumesSnapshotListTestJSON-1751633533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:56 devstack sudo[97584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f 1073741824 Aug 31 15:21:56 devstack sudo[97584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:56 devstack sudo[97582]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-45caf102-98c8-4ad3-8162-b20d65eb063a tempest-VolumesTransfersV355Test-1365375252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-046833b1-07a8-4487-97fd-eb002c17aa79" returned: 0 in 0.619s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-45caf102-98c8-4ad3-8162-b20d65eb063a tempest-VolumesTransfersV355Test-1365375252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-046833b1-07a8-4487-97fd-eb002c17aa79 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:57 devstack sudo[97595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-046833b1-07a8-4487-97fd-eb002c17aa79 Aug 31 15:21:57 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:57 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-45caf102-98c8-4ad3-8162-b20d65eb063a tempest-VolumesTransfersV355Test-1365375252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-046833b1-07a8-4487-97fd-eb002c17aa79" returned: 0 in 0.507s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:57 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-45caf102-98c8-4ad3-8162-b20d65eb063a tempest-VolumesTransfersV355Test-1365375252 None] Lock "cinder-quobyte-046833b1-07a8-4487-97fd-eb002c17aa79" released by "delete_volume" :: held 1.215s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:21:57 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-45caf102-98c8-4ad3-8162-b20d65eb063a tempest-VolumesTransfersV355Test-1365375252 None] Created reservations ['e6f4b786-eb04-4943-91dd-3627823836e5', 'e1d0717a-d848-4cae-b144-88e3cfb8d277', 'a510ee75-47bf-4762-967d-b88a61ec3b23', '8bb50fca-43b1-41ee-8b02-87a51b8fed5b'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:21:57 devstack sudo[97584]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c3bcf235-0f0c-4ae5-90cf-2007917cab52 tempest-VolumesSnapshotListTestJSON-1751633533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f 1073741824" returned: 0 in 0.975s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-45caf102-98c8-4ad3-8162-b20d65eb063a tempest-VolumesTransfersV355Test-1365375252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:21:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-45caf102-98c8-4ad3-8162-b20d65eb063a tempest-VolumesTransfersV355Test-1365375252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:21:57 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-45caf102-98c8-4ad3-8162-b20d65eb063a tempest-VolumesTransfersV355Test-1365375252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:21:57 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-45caf102-98c8-4ad3-8162-b20d65eb063a tempest-VolumesTransfersV355Test-1365375252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:21:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-45caf102-98c8-4ad3-8162-b20d65eb063a tempest-VolumesTransfersV355Test-1365375252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:21:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-45caf102-98c8-4ad3-8162-b20d65eb063a tempest-VolumesTransfersV355Test-1365375252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:57 devstack sudo[97620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:21:57 devstack sudo[97620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c3bcf235-0f0c-4ae5-90cf-2007917cab52 tempest-VolumesSnapshotListTestJSON-1751633533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:57 devstack sudo[97622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f Aug 31 15:21:57 devstack sudo[97622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:58 devstack sudo[97620]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-45caf102-98c8-4ad3-8162-b20d65eb063a tempest-VolumesTransfersV355Test-1365375252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.326s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:58 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-45caf102-98c8-4ad3-8162-b20d65eb063a tempest-VolumesTransfersV355Test-1365375252 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:21:58 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-45caf102-98c8-4ad3-8162-b20d65eb063a tempest-VolumesTransfersV355Test-1365375252 None] Deleted volume successfully. Aug 31 15:21:58 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-45caf102-98c8-4ad3-8162-b20d65eb063a tempest-VolumesTransfersV355Test-1365375252 None] Lock "cinder-046833b1-07a8-4487-97fd-eb002c17aa79-delete_volume" released by "delete_volume" :: held 1.981s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:21:58 devstack sudo[97622]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c3bcf235-0f0c-4ae5-90cf-2007917cab52 tempest-VolumesSnapshotListTestJSON-1751633533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f" returned: 0 in 0.377s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:58 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c3bcf235-0f0c-4ae5-90cf-2007917cab52 tempest-VolumesSnapshotListTestJSON-1751633533 None] <== create_volume: return (1441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:21:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c3bcf235-0f0c-4ae5-90cf-2007917cab52 tempest-VolumesSnapshotListTestJSON-1751633533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:21:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c3bcf235-0f0c-4ae5-90cf-2007917cab52 tempest-VolumesSnapshotListTestJSON-1751633533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f6daa6a-3533-4c33-a669-91e3953fea50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c3bcf235-0f0c-4ae5-90cf-2007917cab52 tempest-VolumesSnapshotListTestJSON-1751633533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d13a0631-32a7-4963-95be-729b34370db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:58 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-c3bcf235-0f0c-4ae5-90cf-2007917cab52 tempest-VolumesSnapshotListTestJSON-1751633533 None] Volume volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f (3e17a60c-7628-4996-9772-c5c7b7a7b90f): created successfully Aug 31 15:21:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c3bcf235-0f0c-4ae5-90cf-2007917cab52 tempest-VolumesSnapshotListTestJSON-1751633533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d13a0631-32a7-4963-95be-729b34370db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c3bcf235-0f0c-4ae5-90cf-2007917cab52 tempest-VolumesSnapshotListTestJSON-1751633533 None] Flow 'volume_create_manager' (8192363b-b793-48c9-94c7-e9b84dec4a44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:21:58 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-c3bcf235-0f0c-4ae5-90cf-2007917cab52 tempest-VolumesSnapshotListTestJSON-1751633533 None] Created volume successfully. Aug 31 15:21:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-330df4cc-88d6-4f48-93ea-0682a63e0277 tempest-VolumesSnapshotListTestJSON-1751633533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:21:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-330df4cc-88d6-4f48-93ea-0682a63e0277 tempest-VolumesSnapshotListTestJSON-1751633533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:21:59 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-330df4cc-88d6-4f48-93ea-0682a63e0277 tempest-VolumesSnapshotListTestJSON-1751633533 None] Creating offline snapshot ff4b78bd-a201-426c-af64-0e442b277a0b of volume 3e17a60c-7628-4996-9772-c5c7b7a7b90f {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:21:59 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c275f919-9180-4193-ac99-963cc19e3f34]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:21:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-330df4cc-88d6-4f48-93ea-0682a63e0277 tempest-VolumesSnapshotListTestJSON-1751633533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:59 devstack sudo[97626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f Aug 31 15:21:59 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:21:59 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f4b4c80-a985-4b89-85c2-49232b03e0e2 tempest-VolumesTransfersV355Test-1551789175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:21:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0f4b4c80-a985-4b89-85c2-49232b03e0e2 tempest-VolumesTransfersV355Test-1551789175 None] Flow 'volume_create_manager' (d1c60360-fb39-403d-85d4-d74e286e0b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:21:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0f4b4c80-a985-4b89-85c2-49232b03e0e2 tempest-VolumesTransfersV355Test-1551789175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55d7deee-5d54-4529-8974-038d8e07bde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0f4b4c80-a985-4b89-85c2-49232b03e0e2 tempest-VolumesTransfersV355Test-1551789175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55d7deee-5d54-4529-8974-038d8e07bde8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1212079207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96a52a4c-27cf-4498-8b56-09d9a804b58f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05491912ef444904911d2b89b1cf05a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:21:59Z,use_quota=True,user_id='25c402623c7d45b4bcdc03ccf4635cd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0f4b4c80-a985-4b89-85c2-49232b03e0e2 tempest-VolumesTransfersV355Test-1551789175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8a1309f-4a65-4572-8c0a-018453331d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0f4b4c80-a985-4b89-85c2-49232b03e0e2 tempest-VolumesTransfersV355Test-1551789175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8a1309f-4a65-4572-8c0a-018453331d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0f4b4c80-a985-4b89-85c2-49232b03e0e2 tempest-VolumesTransfersV355Test-1551789175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (846755bd-0322-404e-b67d-ad47218831a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0f4b4c80-a985-4b89-85c2-49232b03e0e2 tempest-VolumesTransfersV355Test-1551789175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (846755bd-0322-404e-b67d-ad47218831a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96a52a4c-27cf-4498-8b56-09d9a804b58f', 'volume_name': 'volume-96a52a4c-27cf-4498-8b56-09d9a804b58f', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0f4b4c80-a985-4b89-85c2-49232b03e0e2 tempest-VolumesTransfersV355Test-1551789175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (123b73b5-6384-44bb-898d-2d722285017b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0f4b4c80-a985-4b89-85c2-49232b03e0e2 tempest-VolumesTransfersV355Test-1551789175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (123b73b5-6384-44bb-898d-2d722285017b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:21:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0f4b4c80-a985-4b89-85c2-49232b03e0e2 tempest-VolumesTransfersV355Test-1551789175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0859d617-f6f2-4c22-8abf-e76bf2571f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:21:59 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-0f4b4c80-a985-4b89-85c2-49232b03e0e2 tempest-VolumesTransfersV355Test-1551789175 None] Volume 96a52a4c-27cf-4498-8b56-09d9a804b58f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96a52a4c-27cf-4498-8b56-09d9a804b58f', 'volume_size': 1} Aug 31 15:21:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-0f4b4c80-a985-4b89-85c2-49232b03e0e2 tempest-VolumesTransfersV355Test-1551789175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:21:59 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root Aug 31 15:21:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-330df4cc-88d6-4f48-93ea-0682a63e0277 tempest-VolumesSnapshotListTestJSON-1751633533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f" returned: 0 in 0.495s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:21:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-330df4cc-88d6-4f48-93ea-0682a63e0277 tempest-VolumesSnapshotListTestJSON-1751633533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.ff4b78bd-a201-426c-af64-0e442b277a0b 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:21:59 devstack sudo[97633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.ff4b78bd-a201-426c-af64-0e442b277a0b 1G Aug 31 15:21:59 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:00 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-330df4cc-88d6-4f48-93ea-0682a63e0277 tempest-VolumesSnapshotListTestJSON-1751633533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.ff4b78bd-a201-426c-af64-0e442b277a0b 1G" returned: 0 in 0.467s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-330df4cc-88d6-4f48-93ea-0682a63e0277 tempest-VolumesSnapshotListTestJSON-1751633533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.ff4b78bd-a201-426c-af64-0e442b277a0b {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:00 devstack sudo[97639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.ff4b78bd-a201-426c-af64-0e442b277a0b Aug 31 15:22:00 devstack sudo[97639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:00 devstack sudo[97639]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-330df4cc-88d6-4f48-93ea-0682a63e0277 tempest-VolumesSnapshotListTestJSON-1751633533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.ff4b78bd-a201-426c-af64-0e442b277a0b" returned: 0 in 0.353s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:00 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-330df4cc-88d6-4f48-93ea-0682a63e0277 tempest-VolumesSnapshotListTestJSON-1751633533 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.ff4b78bd-a201-426c-af64-0e442b277a0b is being set with open permissions: ugo+rw Aug 31 15:22:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-330df4cc-88d6-4f48-93ea-0682a63e0277 tempest-VolumesSnapshotListTestJSON-1751633533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.ff4b78bd-a201-426c-af64-0e442b277a0b {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:00 devstack sudo[97645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.ff4b78bd-a201-426c-af64-0e442b277a0b Aug 31 15:22:00 devstack sudo[97645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:00 devstack sudo[97645]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-330df4cc-88d6-4f48-93ea-0682a63e0277 tempest-VolumesSnapshotListTestJSON-1751633533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.ff4b78bd-a201-426c-af64-0e442b277a0b" returned: 0 in 0.273s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-330df4cc-88d6-4f48-93ea-0682a63e0277 tempest-VolumesSnapshotListTestJSON-1751633533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:00 devstack sudo[97648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.info Aug 31 15:22:00 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:01 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-330df4cc-88d6-4f48-93ea-0682a63e0277 tempest-VolumesSnapshotListTestJSON-1751633533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.info" returned: 0 in 0.327s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:01 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-330df4cc-88d6-4f48-93ea-0682a63e0277 tempest-VolumesSnapshotListTestJSON-1751633533 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.info is being set with open permissions: ugo+rw Aug 31 15:22:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-330df4cc-88d6-4f48-93ea-0682a63e0277 tempest-VolumesSnapshotListTestJSON-1751633533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:01 devstack sudo[97651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.info Aug 31 15:22:01 devstack sudo[97651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:01 devstack sudo[97651]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-330df4cc-88d6-4f48-93ea-0682a63e0277 tempest-VolumesSnapshotListTestJSON-1751633533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.info" returned: 0 in 0.294s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-330df4cc-88d6-4f48-93ea-0682a63e0277 tempest-VolumesSnapshotListTestJSON-1751633533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.368s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:22:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-0f4b4c80-a985-4b89-85c2-49232b03e0e2 tempest-VolumesTransfersV355Test-1551789175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.002s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:22:01 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-0f4b4c80-a985-4b89-85c2-49232b03e0e2 tempest-VolumesTransfersV355Test-1551789175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1212079207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96a52a4c-27cf-4498-8b56-09d9a804b58f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05491912ef444904911d2b89b1cf05a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:21:59Z,use_quota=True,user_id='25c402623c7d45b4bcdc03ccf4635cd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:22:01 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-0f4b4c80-a985-4b89-85c2-49232b03e0e2 tempest-VolumesTransfersV355Test-1551789175 None] Creating volume 96a52a4c-27cf-4498-8b56-09d9a804b58f {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:22:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-0f4b4c80-a985-4b89-85c2-49232b03e0e2 tempest-VolumesTransfersV355Test-1551789175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:22:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-0f4b4c80-a985-4b89-85c2-49232b03e0e2 tempest-VolumesTransfersV355Test-1551789175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:22:01 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-0f4b4c80-a985-4b89-85c2-49232b03e0e2 tempest-VolumesTransfersV355Test-1551789175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:22:01 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-0f4b4c80-a985-4b89-85c2-49232b03e0e2 tempest-VolumesTransfersV355Test-1551789175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:22:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-0f4b4c80-a985-4b89-85c2-49232b03e0e2 tempest-VolumesTransfersV355Test-1551789175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:22:01 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-0f4b4c80-a985-4b89-85c2-49232b03e0e2 tempest-VolumesTransfersV355Test-1551789175 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:22:01 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-0f4b4c80-a985-4b89-85c2-49232b03e0e2 tempest-VolumesTransfersV355Test-1551789175 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:22:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0f4b4c80-a985-4b89-85c2-49232b03e0e2 tempest-VolumesTransfersV355Test-1551789175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-96a52a4c-27cf-4498-8b56-09d9a804b58f 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:01 devstack sudo[97654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-96a52a4c-27cf-4498-8b56-09d9a804b58f 1073741824 Aug 31 15:22:01 devstack sudo[97654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:01 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-330df4cc-88d6-4f48-93ea-0682a63e0277 tempest-VolumesSnapshotListTestJSON-1751633533 None] Create snapshot completed successfully Aug 31 15:22:01 devstack sudo[97654]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0f4b4c80-a985-4b89-85c2-49232b03e0e2 tempest-VolumesTransfersV355Test-1551789175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-96a52a4c-27cf-4498-8b56-09d9a804b58f 1073741824" returned: 0 in 0.554s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0f4b4c80-a985-4b89-85c2-49232b03e0e2 tempest-VolumesTransfersV355Test-1551789175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-96a52a4c-27cf-4498-8b56-09d9a804b58f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:02 devstack sudo[97661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-96a52a4c-27cf-4498-8b56-09d9a804b58f Aug 31 15:22:02 devstack sudo[97661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:02 devstack sudo[97661]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0f4b4c80-a985-4b89-85c2-49232b03e0e2 tempest-VolumesTransfersV355Test-1551789175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-96a52a4c-27cf-4498-8b56-09d9a804b58f" returned: 0 in 0.335s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:02 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-0f4b4c80-a985-4b89-85c2-49232b03e0e2 tempest-VolumesTransfersV355Test-1551789175 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:22:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-0f4b4c80-a985-4b89-85c2-49232b03e0e2 tempest-VolumesTransfersV355Test-1551789175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:22:02 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0f4b4c80-a985-4b89-85c2-49232b03e0e2 tempest-VolumesTransfersV355Test-1551789175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0859d617-f6f2-4c22-8abf-e76bf2571f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96a52a4c-27cf-4498-8b56-09d9a804b58f', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:22:02 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0f4b4c80-a985-4b89-85c2-49232b03e0e2 tempest-VolumesTransfersV355Test-1551789175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95173619-599e-46f3-b498-0ed634d02d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:22:02 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-0f4b4c80-a985-4b89-85c2-49232b03e0e2 tempest-VolumesTransfersV355Test-1551789175 None] Volume volume-96a52a4c-27cf-4498-8b56-09d9a804b58f (96a52a4c-27cf-4498-8b56-09d9a804b58f): created successfully Aug 31 15:22:02 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0f4b4c80-a985-4b89-85c2-49232b03e0e2 tempest-VolumesTransfersV355Test-1551789175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95173619-599e-46f3-b498-0ed634d02d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:22:02 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0f4b4c80-a985-4b89-85c2-49232b03e0e2 tempest-VolumesTransfersV355Test-1551789175 None] Flow 'volume_create_manager' (d1c60360-fb39-403d-85d4-d74e286e0b36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:22:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1566c632-316a-4515-8de9-086f4d616458 tempest-VolumesSnapshotListTestJSON-1751633533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:22:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1566c632-316a-4515-8de9-086f4d616458 tempest-VolumesSnapshotListTestJSON-1751633533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:22:02 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-0f4b4c80-a985-4b89-85c2-49232b03e0e2 tempest-VolumesTransfersV355Test-1551789175 None] Created volume successfully. Aug 31 15:22:02 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-1566c632-316a-4515-8de9-086f4d616458 tempest-VolumesSnapshotListTestJSON-1751633533 None] Creating offline snapshot 03e2a9c8-817a-4b68-8215-97cbed40bf61 of volume 3e17a60c-7628-4996-9772-c5c7b7a7b90f {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:22:02 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf1e3b0-ac83-42bf-8418-ad961ef5378e]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:22:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1566c632-316a-4515-8de9-086f4d616458 tempest-VolumesSnapshotListTestJSON-1751633533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.ff4b78bd-a201-426c-af64-0e442b277a0b {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:02 devstack sudo[97664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.ff4b78bd-a201-426c-af64-0e442b277a0b Aug 31 15:22:02 devstack sudo[97664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:02 devstack sudo[97664]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1566c632-316a-4515-8de9-086f4d616458 tempest-VolumesSnapshotListTestJSON-1751633533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.ff4b78bd-a201-426c-af64-0e442b277a0b" returned: 0 in 0.464s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:02 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-1566c632-316a-4515-8de9-086f4d616458 tempest-VolumesSnapshotListTestJSON-1751633533 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:22:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1566c632-316a-4515-8de9-086f4d616458 tempest-VolumesSnapshotListTestJSON-1751633533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.ff4b78bd-a201-426c-af64-0e442b277a0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.03e2a9c8-817a-4b68-8215-97cbed40bf61 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:03 devstack sudo[97670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.ff4b78bd-a201-426c-af64-0e442b277a0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.03e2a9c8-817a-4b68-8215-97cbed40bf61 1G Aug 31 15:22:03 devstack sudo[97670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:03 devstack sudo[97670]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1566c632-316a-4515-8de9-086f4d616458 tempest-VolumesSnapshotListTestJSON-1751633533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.ff4b78bd-a201-426c-af64-0e442b277a0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.03e2a9c8-817a-4b68-8215-97cbed40bf61 1G" returned: 0 in 0.631s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1566c632-316a-4515-8de9-086f4d616458 tempest-VolumesSnapshotListTestJSON-1751633533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.ff4b78bd-a201-426c-af64-0e442b277a0b -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.03e2a9c8-817a-4b68-8215-97cbed40bf61 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:03 devstack sudo[97676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.ff4b78bd-a201-426c-af64-0e442b277a0b -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.03e2a9c8-817a-4b68-8215-97cbed40bf61 Aug 31 15:22:03 devstack sudo[97676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:04 devstack sudo[97676]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1566c632-316a-4515-8de9-086f4d616458 tempest-VolumesSnapshotListTestJSON-1751633533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.ff4b78bd-a201-426c-af64-0e442b277a0b -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.03e2a9c8-817a-4b68-8215-97cbed40bf61" returned: 0 in 0.481s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:04 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-1566c632-316a-4515-8de9-086f4d616458 tempest-VolumesSnapshotListTestJSON-1751633533 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.03e2a9c8-817a-4b68-8215-97cbed40bf61 is being set with open permissions: ugo+rw Aug 31 15:22:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1566c632-316a-4515-8de9-086f4d616458 tempest-VolumesSnapshotListTestJSON-1751633533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.03e2a9c8-817a-4b68-8215-97cbed40bf61 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:04 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-28ebd245-0d79-4875-9d86-f83d0695e00d tempest-VolumesTransfersV355Test-1365375252 None] Acquiring lock "cinder-96a52a4c-27cf-4498-8b56-09d9a804b58f-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:22:04 devstack sudo[97682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.03e2a9c8-817a-4b68-8215-97cbed40bf61 Aug 31 15:22:04 devstack sudo[97682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:04 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-28ebd245-0d79-4875-9d86-f83d0695e00d tempest-VolumesTransfersV355Test-1365375252 None] Lock "cinder-96a52a4c-27cf-4498-8b56-09d9a804b58f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:22:04 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-28ebd245-0d79-4875-9d86-f83d0695e00d tempest-VolumesTransfersV355Test-1365375252 None] Acquiring lock "cinder-quobyte-96a52a4c-27cf-4498-8b56-09d9a804b58f" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:22:04 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-28ebd245-0d79-4875-9d86-f83d0695e00d tempest-VolumesTransfersV355Test-1365375252 None] Lock "cinder-quobyte-96a52a4c-27cf-4498-8b56-09d9a804b58f" acquired by "delete_volume" :: waited 0.025s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:22:04 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ed6bc1-28ea-45ec-a9a7-9703283e7780]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:22:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-28ebd245-0d79-4875-9d86-f83d0695e00d tempest-VolumesTransfersV355Test-1365375252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-96a52a4c-27cf-4498-8b56-09d9a804b58f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:04 devstack sudo[97684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-96a52a4c-27cf-4498-8b56-09d9a804b58f Aug 31 15:22:04 devstack sudo[97684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:04 devstack sudo[97682]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1566c632-316a-4515-8de9-086f4d616458 tempest-VolumesSnapshotListTestJSON-1751633533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.03e2a9c8-817a-4b68-8215-97cbed40bf61" returned: 0 in 0.446s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1566c632-316a-4515-8de9-086f4d616458 tempest-VolumesSnapshotListTestJSON-1751633533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.178s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:22:04 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-1566c632-316a-4515-8de9-086f4d616458 tempest-VolumesSnapshotListTestJSON-1751633533 None] Create snapshot completed successfully Aug 31 15:22:04 devstack sudo[97684]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-28ebd245-0d79-4875-9d86-f83d0695e00d tempest-VolumesTransfersV355Test-1365375252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-96a52a4c-27cf-4498-8b56-09d9a804b58f" returned: 0 in 0.485s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-28ebd245-0d79-4875-9d86-f83d0695e00d tempest-VolumesTransfersV355Test-1365375252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-96a52a4c-27cf-4498-8b56-09d9a804b58f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:04 devstack sudo[97690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-96a52a4c-27cf-4498-8b56-09d9a804b58f Aug 31 15:22:04 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:05 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-28ebd245-0d79-4875-9d86-f83d0695e00d tempest-VolumesTransfersV355Test-1365375252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-96a52a4c-27cf-4498-8b56-09d9a804b58f" returned: 0 in 0.299s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:05 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-28ebd245-0d79-4875-9d86-f83d0695e00d tempest-VolumesTransfersV355Test-1365375252 None] Lock "cinder-quobyte-96a52a4c-27cf-4498-8b56-09d9a804b58f" released by "delete_volume" :: held 0.867s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:22:05 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-28ebd245-0d79-4875-9d86-f83d0695e00d tempest-VolumesTransfersV355Test-1365375252 None] Created reservations ['7583624d-5f2d-4a85-a58e-942e5cf9a645', '46bb39f4-fe27-4cd3-901d-8eebb04bc093', 'f715a37d-c2b6-419a-bd85-0aff0fbf044e', 'd8e28dd2-d661-42a5-9a53-75331e41b736'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:22:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-28ebd245-0d79-4875-9d86-f83d0695e00d tempest-VolumesTransfersV355Test-1365375252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:22:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-28ebd245-0d79-4875-9d86-f83d0695e00d tempest-VolumesTransfersV355Test-1365375252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:22:05 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-28ebd245-0d79-4875-9d86-f83d0695e00d tempest-VolumesTransfersV355Test-1365375252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:22:05 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-28ebd245-0d79-4875-9d86-f83d0695e00d tempest-VolumesTransfersV355Test-1365375252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:22:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-28ebd245-0d79-4875-9d86-f83d0695e00d tempest-VolumesTransfersV355Test-1365375252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:22:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-28ebd245-0d79-4875-9d86-f83d0695e00d tempest-VolumesTransfersV355Test-1365375252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:05 devstack sudo[97693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:22:05 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:05 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-28ebd245-0d79-4875-9d86-f83d0695e00d tempest-VolumesTransfersV355Test-1365375252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.405s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:05 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-28ebd245-0d79-4875-9d86-f83d0695e00d tempest-VolumesTransfersV355Test-1365375252 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:22:05 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-28ebd245-0d79-4875-9d86-f83d0695e00d tempest-VolumesTransfersV355Test-1365375252 None] Deleted volume successfully. Aug 31 15:22:05 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-28ebd245-0d79-4875-9d86-f83d0695e00d tempest-VolumesTransfersV355Test-1365375252 None] Lock "cinder-96a52a4c-27cf-4498-8b56-09d9a804b58f-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:22:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f681f22c-d104-4b89-ae3d-950431156f86 tempest-VolumesSnapshotListTestJSON-1751633533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:22:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f681f22c-d104-4b89-ae3d-950431156f86 tempest-VolumesSnapshotListTestJSON-1751633533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:22:05 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-f681f22c-d104-4b89-ae3d-950431156f86 tempest-VolumesSnapshotListTestJSON-1751633533 None] Creating offline snapshot c3f4e800-daef-48c2-be70-730f4ce0810b of volume 3e17a60c-7628-4996-9772-c5c7b7a7b90f {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:22:06 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a050f3a0-2e07-47d1-ab08-dbe700afcde3]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:22:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f681f22c-d104-4b89-ae3d-950431156f86 tempest-VolumesSnapshotListTestJSON-1751633533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.03e2a9c8-817a-4b68-8215-97cbed40bf61 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:06 devstack sudo[97696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.03e2a9c8-817a-4b68-8215-97cbed40bf61 Aug 31 15:22:06 devstack sudo[97696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:06 devstack sudo[97696]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f681f22c-d104-4b89-ae3d-950431156f86 tempest-VolumesSnapshotListTestJSON-1751633533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.03e2a9c8-817a-4b68-8215-97cbed40bf61" returned: 0 in 0.655s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:06 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-f681f22c-d104-4b89-ae3d-950431156f86 tempest-VolumesSnapshotListTestJSON-1751633533 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:22:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f681f22c-d104-4b89-ae3d-950431156f86 tempest-VolumesSnapshotListTestJSON-1751633533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.03e2a9c8-817a-4b68-8215-97cbed40bf61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.c3f4e800-daef-48c2-be70-730f4ce0810b 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:06 devstack sudo[97701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.03e2a9c8-817a-4b68-8215-97cbed40bf61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.c3f4e800-daef-48c2-be70-730f4ce0810b 1G Aug 31 15:22:06 devstack sudo[97701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:07 devstack sudo[97701]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f681f22c-d104-4b89-ae3d-950431156f86 tempest-VolumesSnapshotListTestJSON-1751633533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.03e2a9c8-817a-4b68-8215-97cbed40bf61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.c3f4e800-daef-48c2-be70-730f4ce0810b 1G" returned: 0 in 0.672s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f681f22c-d104-4b89-ae3d-950431156f86 tempest-VolumesSnapshotListTestJSON-1751633533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.03e2a9c8-817a-4b68-8215-97cbed40bf61 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.c3f4e800-daef-48c2-be70-730f4ce0810b {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:07 devstack sudo[97708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.03e2a9c8-817a-4b68-8215-97cbed40bf61 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.c3f4e800-daef-48c2-be70-730f4ce0810b Aug 31 15:22:07 devstack sudo[97708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:07 devstack sudo[97708]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f681f22c-d104-4b89-ae3d-950431156f86 tempest-VolumesSnapshotListTestJSON-1751633533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.03e2a9c8-817a-4b68-8215-97cbed40bf61 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.c3f4e800-daef-48c2-be70-730f4ce0810b" returned: 0 in 0.444s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:07 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-f681f22c-d104-4b89-ae3d-950431156f86 tempest-VolumesSnapshotListTestJSON-1751633533 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.c3f4e800-daef-48c2-be70-730f4ce0810b is being set with open permissions: ugo+rw Aug 31 15:22:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f681f22c-d104-4b89-ae3d-950431156f86 tempest-VolumesSnapshotListTestJSON-1751633533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.c3f4e800-daef-48c2-be70-730f4ce0810b {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:07 devstack sudo[97713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.c3f4e800-daef-48c2-be70-730f4ce0810b Aug 31 15:22:07 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:08 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f681f22c-d104-4b89-ae3d-950431156f86 tempest-VolumesSnapshotListTestJSON-1751633533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.c3f4e800-daef-48c2-be70-730f4ce0810b" returned: 0 in 0.338s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f681f22c-d104-4b89-ae3d-950431156f86 tempest-VolumesSnapshotListTestJSON-1751633533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.264s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:22:08 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-f681f22c-d104-4b89-ae3d-950431156f86 tempest-VolumesSnapshotListTestJSON-1751633533 None] Create snapshot completed successfully Aug 31 15:22:10 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5a25ccf4-338c-4a72-9d08-cfc9fc413259 tempest-VolumesSnapshotListTestJSON-1751633533 None] Acquiring lock "cinder-c3f4e800-daef-48c2-be70-730f4ce0810b-delete_snapshot" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:22:10 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5a25ccf4-338c-4a72-9d08-cfc9fc413259 tempest-VolumesSnapshotListTestJSON-1751633533 None] Lock "cinder-c3f4e800-daef-48c2-be70-730f4ce0810b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:22:10 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5a25ccf4-338c-4a72-9d08-cfc9fc413259 tempest-VolumesSnapshotListTestJSON-1751633533 None] Acquiring lock "cinder-quobyte-3e17a60c-7628-4996-9772-c5c7b7a7b90f" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:22:10 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5a25ccf4-338c-4a72-9d08-cfc9fc413259 tempest-VolumesSnapshotListTestJSON-1751633533 None] Lock "cinder-quobyte-3e17a60c-7628-4996-9772-c5c7b7a7b90f" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:22:10 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5a25ccf4-338c-4a72-9d08-cfc9fc413259 tempest-VolumesSnapshotListTestJSON-1751633533 None] Acquiring lock "cinder-quobyte-c3f4e800-daef-48c2-be70-730f4ce0810b" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:22:10 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5a25ccf4-338c-4a72-9d08-cfc9fc413259 tempest-VolumesSnapshotListTestJSON-1751633533 None] Lock "cinder-quobyte-c3f4e800-daef-48c2-be70-730f4ce0810b" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:22:10 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-5a25ccf4-338c-4a72-9d08-cfc9fc413259 tempest-VolumesSnapshotListTestJSON-1751633533 None] Deleting offline snapshot c3f4e800-daef-48c2-be70-730f4ce0810b of volume 3e17a60c-7628-4996-9772-c5c7b7a7b90f {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:22:10 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-5a25ccf4-338c-4a72-9d08-cfc9fc413259 tempest-VolumesSnapshotListTestJSON-1751633533 None] snapshot_file for this snap is: volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.c3f4e800-daef-48c2-be70-730f4ce0810b {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:22:10 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d872f68d-5dac-4b87-9fb0-f5982e197e18]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:22:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5a25ccf4-338c-4a72-9d08-cfc9fc413259 tempest-VolumesSnapshotListTestJSON-1751633533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.c3f4e800-daef-48c2-be70-730f4ce0810b {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:10 devstack sudo[97717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.c3f4e800-daef-48c2-be70-730f4ce0810b Aug 31 15:22:10 devstack sudo[97717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:10 devstack sudo[97717]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5a25ccf4-338c-4a72-9d08-cfc9fc413259 tempest-VolumesSnapshotListTestJSON-1751633533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.c3f4e800-daef-48c2-be70-730f4ce0810b" returned: 0 in 0.459s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:10 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-5a25ccf4-338c-4a72-9d08-cfc9fc413259 tempest-VolumesSnapshotListTestJSON-1751633533 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:22:10 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cef977-954f-485c-8d81-d5fa669fad1a]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:22:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5a25ccf4-338c-4a72-9d08-cfc9fc413259 tempest-VolumesSnapshotListTestJSON-1751633533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.03e2a9c8-817a-4b68-8215-97cbed40bf61 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:11 devstack sudo[97722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.03e2a9c8-817a-4b68-8215-97cbed40bf61 Aug 31 15:22:11 devstack sudo[97722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:11 devstack sudo[97722]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5a25ccf4-338c-4a72-9d08-cfc9fc413259 tempest-VolumesSnapshotListTestJSON-1751633533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.03e2a9c8-817a-4b68-8215-97cbed40bf61" returned: 0 in 0.500s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:11 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-5a25ccf4-338c-4a72-9d08-cfc9fc413259 tempest-VolumesSnapshotListTestJSON-1751633533 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:22:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5a25ccf4-338c-4a72-9d08-cfc9fc413259 tempest-VolumesSnapshotListTestJSON-1751633533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.c3f4e800-daef-48c2-be70-730f4ce0810b {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:11 devstack sudo[97729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.c3f4e800-daef-48c2-be70-730f4ce0810b Aug 31 15:22:11 devstack sudo[97729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:11 devstack sudo[97729]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5a25ccf4-338c-4a72-9d08-cfc9fc413259 tempest-VolumesSnapshotListTestJSON-1751633533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.c3f4e800-daef-48c2-be70-730f4ce0810b" returned: 0 in 0.579s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5a25ccf4-338c-4a72-9d08-cfc9fc413259 tempest-VolumesSnapshotListTestJSON-1751633533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.c3f4e800-daef-48c2-be70-730f4ce0810b {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:12 devstack sudo[97736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.c3f4e800-daef-48c2-be70-730f4ce0810b Aug 31 15:22:12 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:12 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5a25ccf4-338c-4a72-9d08-cfc9fc413259 tempest-VolumesSnapshotListTestJSON-1751633533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.c3f4e800-daef-48c2-be70-730f4ce0810b" returned: 0 in 0.291s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:12 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5a25ccf4-338c-4a72-9d08-cfc9fc413259 tempest-VolumesSnapshotListTestJSON-1751633533 None] Lock "cinder-quobyte-c3f4e800-daef-48c2-be70-730f4ce0810b" released by "_delete_snapshot" :: held 2.003s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:22:12 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5a25ccf4-338c-4a72-9d08-cfc9fc413259 tempest-VolumesSnapshotListTestJSON-1751633533 None] Lock "cinder-quobyte-3e17a60c-7628-4996-9772-c5c7b7a7b90f" released by "delete_snapshot" :: held 2.042s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:22:12 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-5a25ccf4-338c-4a72-9d08-cfc9fc413259 tempest-VolumesSnapshotListTestJSON-1751633533 None] Created reservations ['3ea91481-e30c-41b1-b6c6-906d15d4755f', 'ff50f470-038a-43a7-82a3-aa9abc722fab', 'c18daba8-3f19-4835-af21-c327a2b1b8db', '9b0dbef4-95ab-4811-905e-0afdf9890dff'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:22:12 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-5a25ccf4-338c-4a72-9d08-cfc9fc413259 tempest-VolumesSnapshotListTestJSON-1751633533 None] Delete snapshot completed successfully. Aug 31 15:22:12 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5a25ccf4-338c-4a72-9d08-cfc9fc413259 tempest-VolumesSnapshotListTestJSON-1751633533 None] Lock "cinder-c3f4e800-daef-48c2-be70-730f4ce0810b-delete_snapshot" released by "delete_snapshot" :: held 2.323s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:22:13 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-766629ef-cae1-47e2-b077-b1e82456bcf4 tempest-VolumesSnapshotListTestJSON-1751633533 None] Acquiring lock "cinder-03e2a9c8-817a-4b68-8215-97cbed40bf61-delete_snapshot" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:22:13 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-766629ef-cae1-47e2-b077-b1e82456bcf4 tempest-VolumesSnapshotListTestJSON-1751633533 None] Lock "cinder-03e2a9c8-817a-4b68-8215-97cbed40bf61-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:22:13 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-766629ef-cae1-47e2-b077-b1e82456bcf4 tempest-VolumesSnapshotListTestJSON-1751633533 None] Acquiring lock "cinder-quobyte-3e17a60c-7628-4996-9772-c5c7b7a7b90f" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:22:13 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-766629ef-cae1-47e2-b077-b1e82456bcf4 tempest-VolumesSnapshotListTestJSON-1751633533 None] Lock "cinder-quobyte-3e17a60c-7628-4996-9772-c5c7b7a7b90f" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:22:13 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-766629ef-cae1-47e2-b077-b1e82456bcf4 tempest-VolumesSnapshotListTestJSON-1751633533 None] Acquiring lock "cinder-quobyte-03e2a9c8-817a-4b68-8215-97cbed40bf61" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:22:13 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-766629ef-cae1-47e2-b077-b1e82456bcf4 tempest-VolumesSnapshotListTestJSON-1751633533 None] Lock "cinder-quobyte-03e2a9c8-817a-4b68-8215-97cbed40bf61" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:22:13 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-766629ef-cae1-47e2-b077-b1e82456bcf4 tempest-VolumesSnapshotListTestJSON-1751633533 None] Deleting offline snapshot 03e2a9c8-817a-4b68-8215-97cbed40bf61 of volume 3e17a60c-7628-4996-9772-c5c7b7a7b90f {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:22:13 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-766629ef-cae1-47e2-b077-b1e82456bcf4 tempest-VolumesSnapshotListTestJSON-1751633533 None] snapshot_file for this snap is: volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.03e2a9c8-817a-4b68-8215-97cbed40bf61 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:22:13 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ca8773-6a32-41d9-8e4d-363a9481d9ff]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:22:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-766629ef-cae1-47e2-b077-b1e82456bcf4 tempest-VolumesSnapshotListTestJSON-1751633533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.03e2a9c8-817a-4b68-8215-97cbed40bf61 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:13 devstack sudo[97765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.03e2a9c8-817a-4b68-8215-97cbed40bf61 Aug 31 15:22:13 devstack sudo[97765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:14 devstack sudo[97765]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-766629ef-cae1-47e2-b077-b1e82456bcf4 tempest-VolumesSnapshotListTestJSON-1751633533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.03e2a9c8-817a-4b68-8215-97cbed40bf61" returned: 0 in 0.537s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:14 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-766629ef-cae1-47e2-b077-b1e82456bcf4 tempest-VolumesSnapshotListTestJSON-1751633533 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:22:14 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c7d54b-0313-4774-85be-de40053d58d7]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:22:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-766629ef-cae1-47e2-b077-b1e82456bcf4 tempest-VolumesSnapshotListTestJSON-1751633533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.ff4b78bd-a201-426c-af64-0e442b277a0b {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:14 devstack sudo[97770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.ff4b78bd-a201-426c-af64-0e442b277a0b Aug 31 15:22:14 devstack sudo[97770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:14 devstack sudo[97770]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-766629ef-cae1-47e2-b077-b1e82456bcf4 tempest-VolumesSnapshotListTestJSON-1751633533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.ff4b78bd-a201-426c-af64-0e442b277a0b" returned: 0 in 0.602s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:14 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-766629ef-cae1-47e2-b077-b1e82456bcf4 tempest-VolumesSnapshotListTestJSON-1751633533 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:22:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-766629ef-cae1-47e2-b077-b1e82456bcf4 tempest-VolumesSnapshotListTestJSON-1751633533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.03e2a9c8-817a-4b68-8215-97cbed40bf61 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:15 devstack sudo[97775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.03e2a9c8-817a-4b68-8215-97cbed40bf61 Aug 31 15:22:15 devstack sudo[97775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:15 devstack sudo[97775]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-766629ef-cae1-47e2-b077-b1e82456bcf4 tempest-VolumesSnapshotListTestJSON-1751633533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.03e2a9c8-817a-4b68-8215-97cbed40bf61" returned: 0 in 0.562s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-766629ef-cae1-47e2-b077-b1e82456bcf4 tempest-VolumesSnapshotListTestJSON-1751633533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.03e2a9c8-817a-4b68-8215-97cbed40bf61 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:15 devstack sudo[97781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.03e2a9c8-817a-4b68-8215-97cbed40bf61 Aug 31 15:22:15 devstack sudo[97781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:15 devstack sudo[97781]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-766629ef-cae1-47e2-b077-b1e82456bcf4 tempest-VolumesSnapshotListTestJSON-1751633533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.03e2a9c8-817a-4b68-8215-97cbed40bf61" returned: 0 in 0.336s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:15 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-766629ef-cae1-47e2-b077-b1e82456bcf4 tempest-VolumesSnapshotListTestJSON-1751633533 None] Lock "cinder-quobyte-03e2a9c8-817a-4b68-8215-97cbed40bf61" released by "_delete_snapshot" :: held 2.197s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:22:15 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-766629ef-cae1-47e2-b077-b1e82456bcf4 tempest-VolumesSnapshotListTestJSON-1751633533 None] Lock "cinder-quobyte-3e17a60c-7628-4996-9772-c5c7b7a7b90f" released by "delete_snapshot" :: held 2.245s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:22:15 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:22:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Flow 'volume_create_manager' (ead9657a-3aa6-455c-863d-4e9028ec2a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:22:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b16e29d0-fd53-4d25-a016-ddd01180c371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:22:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b16e29d0-fd53-4d25-a016-ddd01180c371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1612223878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30c4396d-1686-47e9-a12b-2f4835804fb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e30b21bd2ebc41c6934ae1c1489b77a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:22:16Z,use_quota=True,user_id='27e5b99ab85343838f0d668fcf772a14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:22:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e9016e7-c36c-4bd3-a3a0-332844cbe6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:22:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e9016e7-c36c-4bd3-a3a0-332844cbe6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:22:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c58425e4-8d84-4ccc-b49b-de549ea4afbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:22:16 devstack cinder-volume[86000]: DEBUG cinder.image.glance [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Creating Keystone auth plugin from conf {{(pid=86000) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 31 15:22:16 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-766629ef-cae1-47e2-b077-b1e82456bcf4 tempest-VolumesSnapshotListTestJSON-1751633533 None] Created reservations ['167a3022-be53-4fba-a5f6-e425fb30bb73', 'b023f80f-dcc0-4cfc-bf61-c0491e942530', '874dfb27-ca3b-44c9-8ce4-d5c3d8457b95', 'f95d60f4-68c0-4680-b314-c42eb3c034fa'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:22:16 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-766629ef-cae1-47e2-b077-b1e82456bcf4 tempest-VolumesSnapshotListTestJSON-1751633533 None] Delete snapshot completed successfully. Aug 31 15:22:16 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-766629ef-cae1-47e2-b077-b1e82456bcf4 tempest-VolumesSnapshotListTestJSON-1751633533 None] Lock "cinder-03e2a9c8-817a-4b68-8215-97cbed40bf61-delete_snapshot" released by "delete_snapshot" :: held 2.532s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:22:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c58425e4-8d84-4ccc-b49b-de549ea4afbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '30c4396d-1686-47e9-a12b-2f4835804fb8', 'volume_name': 'volume-30c4396d-1686-47e9-a12b-2f4835804fb8', 'volume_size': 1, 'image_id': '20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '567fd89339ed4743bca5bfab8ec3766d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'created_at': datetime.datetime(2026, 8, 31, 13, 6, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 13, 6, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20bdf4f4-1731-4a30-8e37-8e698c01bf5d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:22:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82bf6bff-22e6-4cc5-92bb-82b77c1bfad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:22:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82bf6bff-22e6-4cc5-92bb-82b77c1bfad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:22:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (588347ed-4ddc-4871-ba42-884a53bf2773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:22:16 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Volume 30c4396d-1686-47e9-a12b-2f4835804fb8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-30c4396d-1686-47e9-a12b-2f4835804fb8', 'volume_size': 1, 'image_id': '20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '567fd89339ed4743bca5bfab8ec3766d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'created_at': datetime.datetime(2026, 8, 31, 13, 6, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 13, 6, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20bdf4f4-1731-4a30-8e37-8e698c01bf5d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 31 15:22:16 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Trying to clone 30c4396d-1686-47e9-a12b-2f4835804fb8 from image 20bdf4f4-1731-4a30-8e37-8e698c01bf5d at location (None, [{'url': 'file:///opt/stack/data/glance/images/20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'metadata': {}}]). {{(pid=86000) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 31 15:22:16 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_zjc7kr7tdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86000) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 31 15:22:16 devstack cinder-volume[86000]: INFO cinder.image.image_utils [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Image download 20.69 MB at 20.69 MB/s Aug 31 15:22:16 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab86048-49eb-4947-a986-6f9db5d8a8a1]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:22:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_zjc7kr7tdevstack@QuobyteHD {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:16 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-fafbb315-09ea-48d8-9e70-7e29ccc9571a tempest-VolumesSnapshotListTestJSON-1751633533 None] Acquiring lock "cinder-ff4b78bd-a201-426c-af64-0e442b277a0b-delete_snapshot" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:22:17 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-fafbb315-09ea-48d8-9e70-7e29ccc9571a tempest-VolumesSnapshotListTestJSON-1751633533 None] Lock "cinder-ff4b78bd-a201-426c-af64-0e442b277a0b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:22:17 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-fafbb315-09ea-48d8-9e70-7e29ccc9571a tempest-VolumesSnapshotListTestJSON-1751633533 None] Acquiring lock "cinder-quobyte-3e17a60c-7628-4996-9772-c5c7b7a7b90f" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:22:17 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-fafbb315-09ea-48d8-9e70-7e29ccc9571a tempest-VolumesSnapshotListTestJSON-1751633533 None] Lock "cinder-quobyte-3e17a60c-7628-4996-9772-c5c7b7a7b90f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:22:17 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-fafbb315-09ea-48d8-9e70-7e29ccc9571a tempest-VolumesSnapshotListTestJSON-1751633533 None] Acquiring lock "cinder-quobyte-ff4b78bd-a201-426c-af64-0e442b277a0b" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:22:17 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-fafbb315-09ea-48d8-9e70-7e29ccc9571a tempest-VolumesSnapshotListTestJSON-1751633533 None] Lock "cinder-quobyte-ff4b78bd-a201-426c-af64-0e442b277a0b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:22:17 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-fafbb315-09ea-48d8-9e70-7e29ccc9571a tempest-VolumesSnapshotListTestJSON-1751633533 None] Deleting offline snapshot ff4b78bd-a201-426c-af64-0e442b277a0b of volume 3e17a60c-7628-4996-9772-c5c7b7a7b90f {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:22:17 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-fafbb315-09ea-48d8-9e70-7e29ccc9571a tempest-VolumesSnapshotListTestJSON-1751633533 None] snapshot_file for this snap is: volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.ff4b78bd-a201-426c-af64-0e442b277a0b {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:22:17 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[814f6087-422d-4a8d-a83e-799851595f3c]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:22:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-fafbb315-09ea-48d8-9e70-7e29ccc9571a tempest-VolumesSnapshotListTestJSON-1751633533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.ff4b78bd-a201-426c-af64-0e442b277a0b {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:17 devstack sudo[97785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_zjc7kr7tdevstack@QuobyteHD Aug 31 15:22:17 devstack sudo[97785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:17 devstack sudo[97786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.ff4b78bd-a201-426c-af64-0e442b277a0b Aug 31 15:22:17 devstack sudo[97786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:17 devstack sudo[97785]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_zjc7kr7tdevstack@QuobyteHD" returned: 0 in 0.485s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:17 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Temporary image 20bdf4f4-1731-4a30-8e37-8e698c01bf5d is fetched for user 27e5b99ab85343838f0d668fcf772a14. {{(pid=86000) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 31 15:22:17 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccb807e-17ac-4709-9fd6-e5e287587348]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:22:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_zjc7kr7tdevstack@QuobyteHD {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:17 devstack sudo[97786]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-fafbb315-09ea-48d8-9e70-7e29ccc9571a tempest-VolumesSnapshotListTestJSON-1751633533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.ff4b78bd-a201-426c-af64-0e442b277a0b" returned: 0 in 0.543s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:17 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-fafbb315-09ea-48d8-9e70-7e29ccc9571a tempest-VolumesSnapshotListTestJSON-1751633533 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:22:17 devstack sudo[97794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_zjc7kr7tdevstack@QuobyteHD Aug 31 15:22:17 devstack sudo[97794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:17 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4a1a91-3625-48b7-9c90-135051249ed3]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:22:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-fafbb315-09ea-48d8-9e70-7e29ccc9571a tempest-VolumesSnapshotListTestJSON-1751633533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:17 devstack sudo[97797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f Aug 31 15:22:17 devstack sudo[97797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:17 devstack sudo[97794]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_zjc7kr7tdevstack@QuobyteHD" returned: 0 in 0.388s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:22:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:22:17 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1612223878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30c4396d-1686-47e9-a12b-2f4835804fb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e30b21bd2ebc41c6934ae1c1489b77a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:22:16Z,use_quota=True,user_id='27e5b99ab85343838f0d668fcf772a14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:22:17 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Creating volume 30c4396d-1686-47e9-a12b-2f4835804fb8 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:22:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:22:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:22:17 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:22:17 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:22:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:22:17 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:22:17 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:22:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-30c4396d-1686-47e9-a12b-2f4835804fb8 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:17 devstack sudo[97802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-30c4396d-1686-47e9-a12b-2f4835804fb8 1073741824 Aug 31 15:22:17 devstack sudo[97802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:18 devstack sudo[97797]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-fafbb315-09ea-48d8-9e70-7e29ccc9571a tempest-VolumesSnapshotListTestJSON-1751633533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f" returned: 0 in 0.422s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-fafbb315-09ea-48d8-9e70-7e29ccc9571a tempest-VolumesSnapshotListTestJSON-1751633533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.ff4b78bd-a201-426c-af64-0e442b277a0b {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:18 devstack sudo[97807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.ff4b78bd-a201-426c-af64-0e442b277a0b Aug 31 15:22:18 devstack sudo[97807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:18 devstack sudo[97802]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-30c4396d-1686-47e9-a12b-2f4835804fb8 1073741824" returned: 0 in 0.463s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-30c4396d-1686-47e9-a12b-2f4835804fb8 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:18 devstack sudo[97815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-30c4396d-1686-47e9-a12b-2f4835804fb8 Aug 31 15:22:18 devstack sudo[97815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:18 devstack sudo[97807]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-fafbb315-09ea-48d8-9e70-7e29ccc9571a tempest-VolumesSnapshotListTestJSON-1751633533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.ff4b78bd-a201-426c-af64-0e442b277a0b" returned: 0 in 0.442s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-fafbb315-09ea-48d8-9e70-7e29ccc9571a tempest-VolumesSnapshotListTestJSON-1751633533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.ff4b78bd-a201-426c-af64-0e442b277a0b {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:18 devstack sudo[97818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.ff4b78bd-a201-426c-af64-0e442b277a0b Aug 31 15:22:18 devstack sudo[97818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:18 devstack sudo[97815]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-30c4396d-1686-47e9-a12b-2f4835804fb8" returned: 0 in 0.341s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:18 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:22:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:22:18 devstack cinder-volume[86000]: DEBUG cinder.volume.volume_utils [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Attempting download of 20bdf4f4-1731-4a30-8e37-8e698c01bf5d ((None, [{'url': 'file:///opt/stack/data/glance/images/20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'metadata': {}}])) to volume 30c4396d-1686-47e9-a12b-2f4835804fb8. {{(pid=86000) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 31 15:22:18 devstack sudo[97818]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-fafbb315-09ea-48d8-9e70-7e29ccc9571a tempest-VolumesSnapshotListTestJSON-1751633533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f.ff4b78bd-a201-426c-af64-0e442b277a0b" returned: 0 in 0.319s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:18 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b302ae7-2c4f-492c-8a4a-04d71af8b5a4]: (4, 'raw') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:22:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_kimh1cmu {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:19 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-fafbb315-09ea-48d8-9e70-7e29ccc9571a tempest-VolumesSnapshotListTestJSON-1751633533 None] Lock "cinder-quobyte-ff4b78bd-a201-426c-af64-0e442b277a0b" released by "_delete_snapshot" :: held 1.943s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:22:19 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-fafbb315-09ea-48d8-9e70-7e29ccc9571a tempest-VolumesSnapshotListTestJSON-1751633533 None] Lock "cinder-quobyte-3e17a60c-7628-4996-9772-c5c7b7a7b90f" released by "delete_snapshot" :: held 1.973s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:22:19 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-fafbb315-09ea-48d8-9e70-7e29ccc9571a tempest-VolumesSnapshotListTestJSON-1751633533 None] Created reservations ['6ae718e0-650c-402b-8055-77da72046449', 'f1aadd74-3d03-45ce-9b96-03c2555ef90d', '74ce41fe-b48a-47cf-bb56-88e2837697cd', '03d9cb24-63a8-4cec-a176-680c6b8a4a05'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:22:19 devstack sudo[97860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_kimh1cmu Aug 31 15:22:19 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:19 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-fafbb315-09ea-48d8-9e70-7e29ccc9571a tempest-VolumesSnapshotListTestJSON-1751633533 None] Delete snapshot completed successfully. Aug 31 15:22:19 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-fafbb315-09ea-48d8-9e70-7e29ccc9571a tempest-VolumesSnapshotListTestJSON-1751633533 None] Lock "cinder-ff4b78bd-a201-426c-af64-0e442b277a0b-delete_snapshot" released by "delete_snapshot" :: held 2.180s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:22:19 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_kimh1cmu" returned: 0 in 0.388s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_kimh1cmu {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:19 devstack sudo[97866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_kimh1cmu Aug 31 15:22:19 devstack sudo[97866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:19 devstack sudo[97866]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_kimh1cmu" returned: 1 in 0.351s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_kimh1cmu' failed. Not Retrying. {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 31 15:22:19 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9298d7d7-7c3b-44de-84e6-05303600ab37]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:22:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_zjc7kr7tdevstack@QuobyteHD {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:19 devstack sudo[97871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_zjc7kr7tdevstack@QuobyteHD Aug 31 15:22:19 devstack sudo[97871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:20 devstack sudo[97871]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_zjc7kr7tdevstack@QuobyteHD" returned: 0 in 0.381s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:20 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] 20bdf4f4-1731-4a30-8e37-8e698c01bf5d was qcow2, converting to qcow2 {{(pid=86000) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 31 15:22:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_zjc7kr7tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-30c4396d-1686-47e9-a12b-2f4835804fb8 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:20 devstack sudo[97876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_zjc7kr7tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-30c4396d-1686-47e9-a12b-2f4835804fb8 Aug 31 15:22:20 devstack sudo[97876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:20 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-f7e99260-a5db-4ad3-8166-3890d1e7c8ba tempest-VolumesSnapshotListTestJSON-1751633533 None] Acquiring lock "cinder-3e17a60c-7628-4996-9772-c5c7b7a7b90f-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:22:20 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-f7e99260-a5db-4ad3-8166-3890d1e7c8ba tempest-VolumesSnapshotListTestJSON-1751633533 None] Lock "cinder-3e17a60c-7628-4996-9772-c5c7b7a7b90f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:22:20 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-f7e99260-a5db-4ad3-8166-3890d1e7c8ba tempest-VolumesSnapshotListTestJSON-1751633533 None] Acquiring lock "cinder-quobyte-3e17a60c-7628-4996-9772-c5c7b7a7b90f" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:22:20 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-f7e99260-a5db-4ad3-8166-3890d1e7c8ba tempest-VolumesSnapshotListTestJSON-1751633533 None] Lock "cinder-quobyte-3e17a60c-7628-4996-9772-c5c7b7a7b90f" acquired by "delete_volume" :: waited 0.018s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:22:20 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8230baa4-0e9b-411e-8a63-7f38c20c5df2]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:22:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f7e99260-a5db-4ad3-8166-3890d1e7c8ba tempest-VolumesSnapshotListTestJSON-1751633533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:20 devstack sudo[97881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f Aug 31 15:22:20 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:20 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f7e99260-a5db-4ad3-8166-3890d1e7c8ba tempest-VolumesSnapshotListTestJSON-1751633533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f" returned: 0 in 0.493s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f7e99260-a5db-4ad3-8166-3890d1e7c8ba tempest-VolumesSnapshotListTestJSON-1751633533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:21 devstack sudo[97889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f Aug 31 15:22:21 devstack sudo[97889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:21 devstack sudo[97889]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f7e99260-a5db-4ad3-8166-3890d1e7c8ba tempest-VolumesSnapshotListTestJSON-1751633533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3e17a60c-7628-4996-9772-c5c7b7a7b90f" returned: 0 in 0.710s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:21 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-f7e99260-a5db-4ad3-8166-3890d1e7c8ba tempest-VolumesSnapshotListTestJSON-1751633533 None] Lock "cinder-quobyte-3e17a60c-7628-4996-9772-c5c7b7a7b90f" released by "delete_volume" :: held 1.272s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:22:21 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-f7e99260-a5db-4ad3-8166-3890d1e7c8ba tempest-VolumesSnapshotListTestJSON-1751633533 None] Created reservations ['0d119ff8-edb2-4170-b51b-9fcd9c8830a4', '50db6b46-b975-42e9-989c-f2ee70cbc4fe', '397a716d-055a-40ff-b546-2c38378f8aee', '78be610e-906d-4648-9c49-604d245bb127'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:22:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f7e99260-a5db-4ad3-8166-3890d1e7c8ba tempest-VolumesSnapshotListTestJSON-1751633533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:22:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f7e99260-a5db-4ad3-8166-3890d1e7c8ba tempest-VolumesSnapshotListTestJSON-1751633533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:22:21 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f7e99260-a5db-4ad3-8166-3890d1e7c8ba tempest-VolumesSnapshotListTestJSON-1751633533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:22:21 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f7e99260-a5db-4ad3-8166-3890d1e7c8ba tempest-VolumesSnapshotListTestJSON-1751633533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:22:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f7e99260-a5db-4ad3-8166-3890d1e7c8ba tempest-VolumesSnapshotListTestJSON-1751633533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:22:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f7e99260-a5db-4ad3-8166-3890d1e7c8ba tempest-VolumesSnapshotListTestJSON-1751633533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:21 devstack sudo[97914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:22:21 devstack sudo[97914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:22 devstack sudo[97914]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f7e99260-a5db-4ad3-8166-3890d1e7c8ba tempest-VolumesSnapshotListTestJSON-1751633533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.466s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:22 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-f7e99260-a5db-4ad3-8166-3890d1e7c8ba tempest-VolumesSnapshotListTestJSON-1751633533 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:22:22 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-f7e99260-a5db-4ad3-8166-3890d1e7c8ba tempest-VolumesSnapshotListTestJSON-1751633533 None] Deleted volume successfully. Aug 31 15:22:22 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-f7e99260-a5db-4ad3-8166-3890d1e7c8ba tempest-VolumesSnapshotListTestJSON-1751633533 None] Lock "cinder-3e17a60c-7628-4996-9772-c5c7b7a7b90f-delete_volume" released by "delete_volume" :: held 2.079s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:22:22 devstack sudo[97876]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_zjc7kr7tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-30c4396d-1686-47e9-a12b-2f4835804fb8" returned: 0 in 2.774s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:22 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_zjc7kr7tdevstack@QuobyteHD, size 112.00 MB, duration 2.78 sec, destination /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-30c4396d-1686-47e9-a12b-2f4835804fb8 {{(pid=86000) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 31 15:22:22 devstack cinder-volume[86000]: INFO cinder.image.image_utils [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Converted 112.00 MB image at 40.36 MB/s Aug 31 15:22:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-30c4396d-1686-47e9-a12b-2f4835804fb8 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:22 devstack sudo[97924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-30c4396d-1686-47e9-a12b-2f4835804fb8 1G Aug 31 15:22:22 devstack sudo[97924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:23 devstack sudo[97924]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-30c4396d-1686-47e9-a12b-2f4835804fb8 1G" returned: 0 in 0.385s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:23 devstack cinder-volume[86000]: DEBUG cinder.volume.volume_utils [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Downloaded image 20bdf4f4-1731-4a30-8e37-8e698c01bf5d ((None, [{'url': 'file:///opt/stack/data/glance/images/20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'metadata': {}}])) to volume 30c4396d-1686-47e9-a12b-2f4835804fb8 successfully. {{(pid=86000) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 31 15:22:23 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Temporary image 20bdf4f4-1731-4a30-8e37-8e698c01bf5d for user 27e5b99ab85343838f0d668fcf772a14 is deleted. {{(pid=86000) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 31 15:22:23 devstack cinder-volume[86000]: DEBUG cinder.volume.volume_utils [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Marking volume 30c4396d-1686-47e9-a12b-2f4835804fb8 as bootable. {{(pid=86000) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 31 15:22:23 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Copying metadata from image 20bdf4f4-1731-4a30-8e37-8e698c01bf5d to 30c4396d-1686-47e9-a12b-2f4835804fb8. {{(pid=86000) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 31 15:22:23 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Creating volume glance metadata for volume 30c4396d-1686-47e9-a12b-2f4835804fb8 backed by image 20bdf4f4-1731-4a30-8e37-8e698c01bf5d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86000) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 31 15:22:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (588347ed-4ddc-4871-ba42-884a53bf2773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30c4396d-1686-47e9-a12b-2f4835804fb8', 'volume_size': 1, 'image_id': '20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '567fd89339ed4743bca5bfab8ec3766d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'created_at': datetime.datetime(2026, 8, 31, 13, 6, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 13, 6, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20bdf4f4-1731-4a30-8e37-8e698c01bf5d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:22:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9adf39a2-8b72-4d9d-a7b9-097b70a7e438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:22:23 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Volume volume-30c4396d-1686-47e9-a12b-2f4835804fb8 (30c4396d-1686-47e9-a12b-2f4835804fb8): created successfully Aug 31 15:22:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9adf39a2-8b72-4d9d-a7b9-097b70a7e438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:22:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Flow 'volume_create_manager' (ead9657a-3aa6-455c-863d-4e9028ec2a7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:22:23 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-0153a799-de1c-4326-98fe-5cd2d429171d tempest-VolumesExtendTest-978818700 None] Created volume successfully. Aug 31 15:22:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-84c4e58f-ac80-4c91-a07a-551f34b2ff38 tempest-VolumesExtendTest-978818700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:22:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-84c4e58f-ac80-4c91-a07a-551f34b2ff38 tempest-VolumesExtendTest-978818700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.005s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:22:23 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[39be6e35-0c6c-4fe0-8927-b0acced2b640]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:22:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-84c4e58f-ac80-4c91-a07a-551f34b2ff38 tempest-VolumesExtendTest-978818700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-30c4396d-1686-47e9-a12b-2f4835804fb8 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:23 devstack sudo[97937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-30c4396d-1686-47e9-a12b-2f4835804fb8 Aug 31 15:22:23 devstack sudo[97937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:24 devstack sudo[97937]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-84c4e58f-ac80-4c91-a07a-551f34b2ff38 tempest-VolumesExtendTest-978818700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-30c4396d-1686-47e9-a12b-2f4835804fb8" returned: 0 in 0.477s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-84c4e58f-ac80-4c91-a07a-551f34b2ff38 tempest-VolumesExtendTest-978818700 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-30c4396d-1686-47e9-a12b-2f4835804fb8 2G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-84c4e58f-ac80-4c91-a07a-551f34b2ff38 tempest-VolumesExtendTest-978818700 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-30c4396d-1686-47e9-a12b-2f4835804fb8 2G" returned: 0 in 0.211s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-84c4e58f-ac80-4c91-a07a-551f34b2ff38 tempest-VolumesExtendTest-978818700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.723s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:22:24 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-84c4e58f-ac80-4c91-a07a-551f34b2ff38 tempest-VolumesExtendTest-978818700 None] Extend volume completed successfully. Aug 31 15:22:25 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-074a72fa-c015-4eab-903a-b47b44faaaf9 tempest-VolumesExtendTest-978818700 None] Acquiring lock "cinder-30c4396d-1686-47e9-a12b-2f4835804fb8-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:22:25 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-074a72fa-c015-4eab-903a-b47b44faaaf9 tempest-VolumesExtendTest-978818700 None] Lock "cinder-30c4396d-1686-47e9-a12b-2f4835804fb8-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:22:25 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-074a72fa-c015-4eab-903a-b47b44faaaf9 tempest-VolumesExtendTest-978818700 None] Acquiring lock "cinder-quobyte-30c4396d-1686-47e9-a12b-2f4835804fb8" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:22:25 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-074a72fa-c015-4eab-903a-b47b44faaaf9 tempest-VolumesExtendTest-978818700 None] Lock "cinder-quobyte-30c4396d-1686-47e9-a12b-2f4835804fb8" acquired by "delete_volume" :: waited 0.027s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:22:25 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ba59ac-9ce8-4797-b15f-9be8a2adbc70]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:22:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-074a72fa-c015-4eab-903a-b47b44faaaf9 tempest-VolumesExtendTest-978818700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-30c4396d-1686-47e9-a12b-2f4835804fb8 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:26 devstack sudo[98027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-30c4396d-1686-47e9-a12b-2f4835804fb8 Aug 31 15:22:26 devstack sudo[98027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:26 devstack sudo[98027]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-074a72fa-c015-4eab-903a-b47b44faaaf9 tempest-VolumesExtendTest-978818700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-30c4396d-1686-47e9-a12b-2f4835804fb8" returned: 0 in 0.919s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-074a72fa-c015-4eab-903a-b47b44faaaf9 tempest-VolumesExtendTest-978818700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-30c4396d-1686-47e9-a12b-2f4835804fb8 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:26 devstack sudo[98040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-30c4396d-1686-47e9-a12b-2f4835804fb8 Aug 31 15:22:26 devstack sudo[98040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:27 devstack sudo[98040]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-074a72fa-c015-4eab-903a-b47b44faaaf9 tempest-VolumesExtendTest-978818700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-30c4396d-1686-47e9-a12b-2f4835804fb8" returned: 0 in 0.684s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:27 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-074a72fa-c015-4eab-903a-b47b44faaaf9 tempest-VolumesExtendTest-978818700 None] Lock "cinder-quobyte-30c4396d-1686-47e9-a12b-2f4835804fb8" released by "delete_volume" :: held 1.768s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:22:27 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-074a72fa-c015-4eab-903a-b47b44faaaf9 tempest-VolumesExtendTest-978818700 None] Created reservations ['4e011a5d-e4db-4c3d-8b1e-f788a8903dff', '2fec40ac-1fdc-41c5-8fca-82c22a9fd710', 'e95cfa36-80d6-4d45-8d13-6eb252b5ae08', 'fac65843-da93-4939-abec-47ee5d9f0e98'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:22:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-074a72fa-c015-4eab-903a-b47b44faaaf9 tempest-VolumesExtendTest-978818700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:22:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-074a72fa-c015-4eab-903a-b47b44faaaf9 tempest-VolumesExtendTest-978818700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:22:27 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-074a72fa-c015-4eab-903a-b47b44faaaf9 tempest-VolumesExtendTest-978818700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:22:27 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-074a72fa-c015-4eab-903a-b47b44faaaf9 tempest-VolumesExtendTest-978818700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:22:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-074a72fa-c015-4eab-903a-b47b44faaaf9 tempest-VolumesExtendTest-978818700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:22:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-074a72fa-c015-4eab-903a-b47b44faaaf9 tempest-VolumesExtendTest-978818700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:27 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:22:27 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:28 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-074a72fa-c015-4eab-903a-b47b44faaaf9 tempest-VolumesExtendTest-978818700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.490s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:28 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-074a72fa-c015-4eab-903a-b47b44faaaf9 tempest-VolumesExtendTest-978818700 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:22:28 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-074a72fa-c015-4eab-903a-b47b44faaaf9 tempest-VolumesExtendTest-978818700 None] Deleted volume successfully. Aug 31 15:22:28 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-074a72fa-c015-4eab-903a-b47b44faaaf9 tempest-VolumesExtendTest-978818700 None] Lock "cinder-30c4396d-1686-47e9-a12b-2f4835804fb8-delete_volume" released by "delete_volume" :: held 2.797s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:22:28 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc26ab66-d204-487f-9dfe-7dcc7c5a056f tempest-VolumesExtendTest-978818700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:22:28 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dc26ab66-d204-487f-9dfe-7dcc7c5a056f tempest-VolumesExtendTest-978818700 None] Flow 'volume_create_manager' (40cd0552-f5a6-458e-8eb1-bfb38fe6dbd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:22:28 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dc26ab66-d204-487f-9dfe-7dcc7c5a056f tempest-VolumesExtendTest-978818700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (587a1f7d-1b4c-4db5-bf81-d0b8d29f25aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:22:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dc26ab66-d204-487f-9dfe-7dcc7c5a056f tempest-VolumesExtendTest-978818700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (587a1f7d-1b4c-4db5-bf81-d0b8d29f25aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-846207106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da4317c5-4c25-437a-9aa5-05ac8663d740,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e30b21bd2ebc41c6934ae1c1489b77a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:22:29Z,use_quota=True,user_id='27e5b99ab85343838f0d668fcf772a14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:22:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dc26ab66-d204-487f-9dfe-7dcc7c5a056f tempest-VolumesExtendTest-978818700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7406773-97a3-44a3-b5a4-d6c2a2803d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:22:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dc26ab66-d204-487f-9dfe-7dcc7c5a056f tempest-VolumesExtendTest-978818700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7406773-97a3-44a3-b5a4-d6c2a2803d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:22:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dc26ab66-d204-487f-9dfe-7dcc7c5a056f tempest-VolumesExtendTest-978818700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0af60ca-4d68-4e46-beca-214b15ab5174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:22:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dc26ab66-d204-487f-9dfe-7dcc7c5a056f tempest-VolumesExtendTest-978818700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0af60ca-4d68-4e46-beca-214b15ab5174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da4317c5-4c25-437a-9aa5-05ac8663d740', 'volume_name': 'volume-da4317c5-4c25-437a-9aa5-05ac8663d740', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:22:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dc26ab66-d204-487f-9dfe-7dcc7c5a056f tempest-VolumesExtendTest-978818700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef9d6961-cdd5-4fa4-b2b7-c855713c72ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:22:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dc26ab66-d204-487f-9dfe-7dcc7c5a056f tempest-VolumesExtendTest-978818700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef9d6961-cdd5-4fa4-b2b7-c855713c72ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:22:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dc26ab66-d204-487f-9dfe-7dcc7c5a056f tempest-VolumesExtendTest-978818700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30239add-9c8a-4a2b-a983-bca385aa73b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:22:29 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-dc26ab66-d204-487f-9dfe-7dcc7c5a056f tempest-VolumesExtendTest-978818700 None] Volume da4317c5-4c25-437a-9aa5-05ac8663d740: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da4317c5-4c25-437a-9aa5-05ac8663d740', 'volume_size': 1} Aug 31 15:22:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-dc26ab66-d204-487f-9dfe-7dcc7c5a056f tempest-VolumesExtendTest-978818700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:22:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-dc26ab66-d204-487f-9dfe-7dcc7c5a056f tempest-VolumesExtendTest-978818700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:22:29 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-dc26ab66-d204-487f-9dfe-7dcc7c5a056f tempest-VolumesExtendTest-978818700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-846207106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da4317c5-4c25-437a-9aa5-05ac8663d740,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e30b21bd2ebc41c6934ae1c1489b77a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:22:29Z,use_quota=True,user_id='27e5b99ab85343838f0d668fcf772a14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:22:29 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-dc26ab66-d204-487f-9dfe-7dcc7c5a056f tempest-VolumesExtendTest-978818700 None] Creating volume da4317c5-4c25-437a-9aa5-05ac8663d740 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:22:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-dc26ab66-d204-487f-9dfe-7dcc7c5a056f tempest-VolumesExtendTest-978818700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:22:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-dc26ab66-d204-487f-9dfe-7dcc7c5a056f tempest-VolumesExtendTest-978818700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:22:29 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-dc26ab66-d204-487f-9dfe-7dcc7c5a056f tempest-VolumesExtendTest-978818700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:22:29 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-dc26ab66-d204-487f-9dfe-7dcc7c5a056f tempest-VolumesExtendTest-978818700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:22:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-dc26ab66-d204-487f-9dfe-7dcc7c5a056f tempest-VolumesExtendTest-978818700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:22:29 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-dc26ab66-d204-487f-9dfe-7dcc7c5a056f tempest-VolumesExtendTest-978818700 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:22:29 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-dc26ab66-d204-487f-9dfe-7dcc7c5a056f tempest-VolumesExtendTest-978818700 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:22:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-dc26ab66-d204-487f-9dfe-7dcc7c5a056f tempest-VolumesExtendTest-978818700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:29 devstack sudo[98048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740 1073741824 Aug 31 15:22:29 devstack sudo[98048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:29 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:SELECT=117,cinder:UPDATE=113,cinder:INSERT=44,cinder:DELETE=11 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:22:29 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:SELECT=102,cinder:UPDATE=127,cinder:INSERT=38,cinder:DELETE=9 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:22:29 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b33d8f9-8292-4e49-8388-8a4e72219a7a tempest-VolumesActionsTest-708297345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:22:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-2b33d8f9-8292-4e49-8388-8a4e72219a7a tempest-VolumesActionsTest-708297345 None] Flow 'volume_create_manager' (9da40555-f164-48ce-8c49-18196ea5441f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:22:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-2b33d8f9-8292-4e49-8388-8a4e72219a7a tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b41e6e8-9f9c-4c73-8400-0c3f35f1ebbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:22:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-2b33d8f9-8292-4e49-8388-8a4e72219a7a tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b41e6e8-9f9c-4c73-8400-0c3f35f1ebbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1646347295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=130a3cfc-3545-4fc3-8924-389a98f29fb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='330f65e7fa454901ad7aa0d1e12dffad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:22:30Z,use_quota=True,user_id='d581dbe42c6f484ca29e2108b2fd0d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:22:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-2b33d8f9-8292-4e49-8388-8a4e72219a7a tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2f76f13-263d-4760-b025-389f03e94b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:22:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-2b33d8f9-8292-4e49-8388-8a4e72219a7a tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2f76f13-263d-4760-b025-389f03e94b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:22:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-2b33d8f9-8292-4e49-8388-8a4e72219a7a tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ad963ee-14bd-4848-9016-f08dd8751f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:22:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-2b33d8f9-8292-4e49-8388-8a4e72219a7a tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ad963ee-14bd-4848-9016-f08dd8751f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '130a3cfc-3545-4fc3-8924-389a98f29fb2', 'volume_name': 'volume-130a3cfc-3545-4fc3-8924-389a98f29fb2', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:22:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-2b33d8f9-8292-4e49-8388-8a4e72219a7a tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c9c5d52-3fbb-4b1f-a099-592c302ddc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:22:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-2b33d8f9-8292-4e49-8388-8a4e72219a7a tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c9c5d52-3fbb-4b1f-a099-592c302ddc11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:22:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-2b33d8f9-8292-4e49-8388-8a4e72219a7a tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17c74e48-6716-4bf0-a7be-67e9fea202b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:22:29 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-2b33d8f9-8292-4e49-8388-8a4e72219a7a tempest-VolumesActionsTest-708297345 None] Volume 130a3cfc-3545-4fc3-8924-389a98f29fb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-130a3cfc-3545-4fc3-8924-389a98f29fb2', 'volume_size': 1} Aug 31 15:22:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-2b33d8f9-8292-4e49-8388-8a4e72219a7a tempest-VolumesActionsTest-708297345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:22:30 devstack sudo[98048]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-dc26ab66-d204-487f-9dfe-7dcc7c5a056f tempest-VolumesExtendTest-978818700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740 1073741824" returned: 0 in 0.907s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-dc26ab66-d204-487f-9dfe-7dcc7c5a056f tempest-VolumesExtendTest-978818700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:30 devstack sudo[98055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740 Aug 31 15:22:30 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:30 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-dc26ab66-d204-487f-9dfe-7dcc7c5a056f tempest-VolumesExtendTest-978818700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740" returned: 0 in 0.301s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:30 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-dc26ab66-d204-487f-9dfe-7dcc7c5a056f tempest-VolumesExtendTest-978818700 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:22:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-dc26ab66-d204-487f-9dfe-7dcc7c5a056f tempest-VolumesExtendTest-978818700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:22:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-2b33d8f9-8292-4e49-8388-8a4e72219a7a tempest-VolumesActionsTest-708297345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.493s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:22:30 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-2b33d8f9-8292-4e49-8388-8a4e72219a7a tempest-VolumesActionsTest-708297345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1646347295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=130a3cfc-3545-4fc3-8924-389a98f29fb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='330f65e7fa454901ad7aa0d1e12dffad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:22:30Z,use_quota=True,user_id='d581dbe42c6f484ca29e2108b2fd0d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:22:30 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-2b33d8f9-8292-4e49-8388-8a4e72219a7a tempest-VolumesActionsTest-708297345 None] Creating volume 130a3cfc-3545-4fc3-8924-389a98f29fb2 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:22:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-2b33d8f9-8292-4e49-8388-8a4e72219a7a tempest-VolumesActionsTest-708297345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:22:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-2b33d8f9-8292-4e49-8388-8a4e72219a7a tempest-VolumesActionsTest-708297345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:22:30 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-2b33d8f9-8292-4e49-8388-8a4e72219a7a tempest-VolumesActionsTest-708297345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:22:30 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-2b33d8f9-8292-4e49-8388-8a4e72219a7a tempest-VolumesActionsTest-708297345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:22:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-2b33d8f9-8292-4e49-8388-8a4e72219a7a tempest-VolumesActionsTest-708297345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:22:30 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-2b33d8f9-8292-4e49-8388-8a4e72219a7a tempest-VolumesActionsTest-708297345 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:22:30 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-2b33d8f9-8292-4e49-8388-8a4e72219a7a tempest-VolumesActionsTest-708297345 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:22:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2b33d8f9-8292-4e49-8388-8a4e72219a7a tempest-VolumesActionsTest-708297345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-130a3cfc-3545-4fc3-8924-389a98f29fb2 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:30 devstack sudo[98058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-130a3cfc-3545-4fc3-8924-389a98f29fb2 1073741824 Aug 31 15:22:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dc26ab66-d204-487f-9dfe-7dcc7c5a056f tempest-VolumesExtendTest-978818700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30239add-9c8a-4a2b-a983-bca385aa73b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da4317c5-4c25-437a-9aa5-05ac8663d740', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:22:30 devstack sudo[98058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dc26ab66-d204-487f-9dfe-7dcc7c5a056f tempest-VolumesExtendTest-978818700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (792540a7-6095-41d1-a66c-10c507046ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:22:30 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-dc26ab66-d204-487f-9dfe-7dcc7c5a056f tempest-VolumesExtendTest-978818700 None] Volume volume-da4317c5-4c25-437a-9aa5-05ac8663d740 (da4317c5-4c25-437a-9aa5-05ac8663d740): created successfully Aug 31 15:22:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dc26ab66-d204-487f-9dfe-7dcc7c5a056f tempest-VolumesExtendTest-978818700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (792540a7-6095-41d1-a66c-10c507046ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:22:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dc26ab66-d204-487f-9dfe-7dcc7c5a056f tempest-VolumesExtendTest-978818700 None] Flow 'volume_create_manager' (40cd0552-f5a6-458e-8eb1-bfb38fe6dbd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:22:30 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-dc26ab66-d204-487f-9dfe-7dcc7c5a056f tempest-VolumesExtendTest-978818700 None] Created volume successfully. Aug 31 15:22:30 devstack sudo[98058]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2b33d8f9-8292-4e49-8388-8a4e72219a7a tempest-VolumesActionsTest-708297345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-130a3cfc-3545-4fc3-8924-389a98f29fb2 1073741824" returned: 0 in 0.613s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2b33d8f9-8292-4e49-8388-8a4e72219a7a tempest-VolumesActionsTest-708297345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-130a3cfc-3545-4fc3-8924-389a98f29fb2 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:31 devstack sudo[98064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-130a3cfc-3545-4fc3-8924-389a98f29fb2 Aug 31 15:22:31 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8a093adb-cacf-4574-b5f4-df352bd7fe88 tempest-VolumesExtendTest-978818700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:22:31 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2b33d8f9-8292-4e49-8388-8a4e72219a7a tempest-VolumesActionsTest-708297345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-130a3cfc-3545-4fc3-8924-389a98f29fb2" returned: 0 in 0.519s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:31 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-2b33d8f9-8292-4e49-8388-8a4e72219a7a tempest-VolumesActionsTest-708297345 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:22:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-2b33d8f9-8292-4e49-8388-8a4e72219a7a tempest-VolumesActionsTest-708297345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:22:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8a093adb-cacf-4574-b5f4-df352bd7fe88 tempest-VolumesExtendTest-978818700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.153s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:22:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-2b33d8f9-8292-4e49-8388-8a4e72219a7a tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17c74e48-6716-4bf0-a7be-67e9fea202b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-130a3cfc-3545-4fc3-8924-389a98f29fb2', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:22:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-2b33d8f9-8292-4e49-8388-8a4e72219a7a tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b088f5a-04a4-40dc-b459-7281b19c7c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:22:31 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-8a093adb-cacf-4574-b5f4-df352bd7fe88 tempest-VolumesExtendTest-978818700 None] Creating offline snapshot 330a601b-3cf7-469c-9336-f91b505e41fc of volume da4317c5-4c25-437a-9aa5-05ac8663d740 {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:22:31 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-2b33d8f9-8292-4e49-8388-8a4e72219a7a tempest-VolumesActionsTest-708297345 None] Volume volume-130a3cfc-3545-4fc3-8924-389a98f29fb2 (130a3cfc-3545-4fc3-8924-389a98f29fb2): created successfully Aug 31 15:22:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-2b33d8f9-8292-4e49-8388-8a4e72219a7a tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b088f5a-04a4-40dc-b459-7281b19c7c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:22:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-2b33d8f9-8292-4e49-8388-8a4e72219a7a tempest-VolumesActionsTest-708297345 None] Flow 'volume_create_manager' (9da40555-f164-48ce-8c49-18196ea5441f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:22:31 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f1d3ea-138b-4503-a314-88e0f918db79]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:22:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8a093adb-cacf-4574-b5f4-df352bd7fe88 tempest-VolumesExtendTest-978818700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:31 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-2b33d8f9-8292-4e49-8388-8a4e72219a7a tempest-VolumesActionsTest-708297345 None] Created volume successfully. Aug 31 15:22:31 devstack sudo[98067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740 Aug 31 15:22:31 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:31 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a5c2850f-2674-4173-aced-faf52f6550e2 tempest-VolumesActionsTest-708297345 None] Acquiring lock "cinder-130a3cfc-3545-4fc3-8924-389a98f29fb2" by "attach_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:22:31 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a5c2850f-2674-4173-aced-faf52f6550e2 tempest-VolumesActionsTest-708297345 None] Lock "cinder-130a3cfc-3545-4fc3-8924-389a98f29fb2" acquired by "attach_volume" :: waited 0.034s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:22:32 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-a5c2850f-2674-4173-aced-faf52f6550e2 tempest-VolumesActionsTest-708297345 None] Attaching volume 130a3cfc-3545-4fc3-8924-389a98f29fb2 to instance 1c9f4210-ad28-46cd-b5d5-700f196bd649 at mountpoint /dev/vdb on host None. Aug 31 15:22:32 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-a5c2850f-2674-4173-aced-faf52f6550e2 tempest-VolumesActionsTest-708297345 None] Attach volume completed successfully. Aug 31 15:22:32 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a5c2850f-2674-4173-aced-faf52f6550e2 tempest-VolumesActionsTest-708297345 None] Lock "cinder-130a3cfc-3545-4fc3-8924-389a98f29fb2" released by "attach_volume" :: held 0.108s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:22:32 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8a093adb-cacf-4574-b5f4-df352bd7fe88 tempest-VolumesExtendTest-978818700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740" returned: 0 in 0.641s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8a093adb-cacf-4574-b5f4-df352bd7fe88 tempest-VolumesExtendTest-978818700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740.330a601b-3cf7-469c-9336-f91b505e41fc 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:32 devstack sudo[98072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740.330a601b-3cf7-469c-9336-f91b505e41fc 1G Aug 31 15:22:32 devstack sudo[98072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:32 devstack sudo[98072]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8a093adb-cacf-4574-b5f4-df352bd7fe88 tempest-VolumesExtendTest-978818700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740.330a601b-3cf7-469c-9336-f91b505e41fc 1G" returned: 0 in 0.643s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8a093adb-cacf-4574-b5f4-df352bd7fe88 tempest-VolumesExtendTest-978818700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da4317c5-4c25-437a-9aa5-05ac8663d740 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740.330a601b-3cf7-469c-9336-f91b505e41fc {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:33 devstack sudo[98079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da4317c5-4c25-437a-9aa5-05ac8663d740 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740.330a601b-3cf7-469c-9336-f91b505e41fc Aug 31 15:22:33 devstack sudo[98079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:33 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-d940d91e-a566-4ce0-850c-144f18930d9a tempest-VolumesActionsTest-1524955045 None] Terminate volume connection completed successfully. Aug 31 15:22:33 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-d940d91e-a566-4ce0-850c-144f18930d9a tempest-VolumesActionsTest-1524955045 None] Acquiring lock "cinder-130a3cfc-3545-4fc3-8924-389a98f29fb2-detach_volume" by "detach_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:22:33 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-d940d91e-a566-4ce0-850c-144f18930d9a tempest-VolumesActionsTest-1524955045 None] Lock "cinder-130a3cfc-3545-4fc3-8924-389a98f29fb2-detach_volume" acquired by "detach_volume" :: waited 0.049s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:22:33 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-d940d91e-a566-4ce0-850c-144f18930d9a tempest-VolumesActionsTest-1524955045 None] Detaching volume 130a3cfc-3545-4fc3-8924-389a98f29fb2 from instance 1c9f4210-ad28-46cd-b5d5-700f196bd649. Aug 31 15:22:33 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-d940d91e-a566-4ce0-850c-144f18930d9a tempest-VolumesActionsTest-1524955045 None] Detach volume completed successfully. Aug 31 15:22:33 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-d940d91e-a566-4ce0-850c-144f18930d9a tempest-VolumesActionsTest-1524955045 None] Lock "cinder-130a3cfc-3545-4fc3-8924-389a98f29fb2-detach_volume" released by "detach_volume" :: held 0.169s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:22:33 devstack sudo[98079]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8a093adb-cacf-4574-b5f4-df352bd7fe88 tempest-VolumesExtendTest-978818700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da4317c5-4c25-437a-9aa5-05ac8663d740 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740.330a601b-3cf7-469c-9336-f91b505e41fc" returned: 0 in 0.658s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:33 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-8a093adb-cacf-4574-b5f4-df352bd7fe88 tempest-VolumesExtendTest-978818700 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740.330a601b-3cf7-469c-9336-f91b505e41fc is being set with open permissions: ugo+rw Aug 31 15:22:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8a093adb-cacf-4574-b5f4-df352bd7fe88 tempest-VolumesExtendTest-978818700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740.330a601b-3cf7-469c-9336-f91b505e41fc {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:33 devstack sudo[98085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740.330a601b-3cf7-469c-9336-f91b505e41fc Aug 31 15:22:33 devstack sudo[98085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:33 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-56df70b1-0b54-4207-b33f-dd7a46404798 tempest-VolumesActionsTest-708297345 None] Acquiring lock "cinder-130a3cfc-3545-4fc3-8924-389a98f29fb2-detach_volume" by "detach_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:22:33 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-56df70b1-0b54-4207-b33f-dd7a46404798 tempest-VolumesActionsTest-708297345 None] Lock "cinder-130a3cfc-3545-4fc3-8924-389a98f29fb2-detach_volume" acquired by "detach_volume" :: waited 0.044s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:22:33 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-56df70b1-0b54-4207-b33f-dd7a46404798 tempest-VolumesActionsTest-708297345 None] Volume detach called, but volume not attached. Aug 31 15:22:33 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-56df70b1-0b54-4207-b33f-dd7a46404798 tempest-VolumesActionsTest-708297345 None] Lock "cinder-130a3cfc-3545-4fc3-8924-389a98f29fb2-detach_volume" released by "detach_volume" :: held 0.040s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:22:34 devstack sudo[98085]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8a093adb-cacf-4574-b5f4-df352bd7fe88 tempest-VolumesExtendTest-978818700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740.330a601b-3cf7-469c-9336-f91b505e41fc" returned: 0 in 0.525s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8a093adb-cacf-4574-b5f4-df352bd7fe88 tempest-VolumesExtendTest-978818700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:34 devstack sudo[98088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740.info Aug 31 15:22:34 devstack sudo[98088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:34 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-eeb5d3d9-c311-4adb-a1f5-48a495c71c7d tempest-VolumesActionsTest-708297345 None] Acquiring lock "cinder-130a3cfc-3545-4fc3-8924-389a98f29fb2-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:22:34 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-eeb5d3d9-c311-4adb-a1f5-48a495c71c7d tempest-VolumesActionsTest-708297345 None] Lock "cinder-130a3cfc-3545-4fc3-8924-389a98f29fb2-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:22:34 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-eeb5d3d9-c311-4adb-a1f5-48a495c71c7d tempest-VolumesActionsTest-708297345 None] Acquiring lock "cinder-quobyte-130a3cfc-3545-4fc3-8924-389a98f29fb2" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:22:34 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-eeb5d3d9-c311-4adb-a1f5-48a495c71c7d tempest-VolumesActionsTest-708297345 None] Lock "cinder-quobyte-130a3cfc-3545-4fc3-8924-389a98f29fb2" acquired by "delete_volume" :: waited 0.033s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:22:34 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7283ccd-9d6e-4a30-8a0c-9e3965c3be3d]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:22:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-eeb5d3d9-c311-4adb-a1f5-48a495c71c7d tempest-VolumesActionsTest-708297345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-130a3cfc-3545-4fc3-8924-389a98f29fb2 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:34 devstack sudo[98088]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8a093adb-cacf-4574-b5f4-df352bd7fe88 tempest-VolumesExtendTest-978818700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740.info" returned: 0 in 0.583s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:34 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-8a093adb-cacf-4574-b5f4-df352bd7fe88 tempest-VolumesExtendTest-978818700 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740.info is being set with open permissions: ugo+rw Aug 31 15:22:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8a093adb-cacf-4574-b5f4-df352bd7fe88 tempest-VolumesExtendTest-978818700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:34 devstack sudo[98090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-130a3cfc-3545-4fc3-8924-389a98f29fb2 Aug 31 15:22:34 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:34 devstack sudo[98092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740.info Aug 31 15:22:34 devstack sudo[98092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:35 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-eeb5d3d9-c311-4adb-a1f5-48a495c71c7d tempest-VolumesActionsTest-708297345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-130a3cfc-3545-4fc3-8924-389a98f29fb2" returned: 0 in 0.598s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-eeb5d3d9-c311-4adb-a1f5-48a495c71c7d tempest-VolumesActionsTest-708297345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-130a3cfc-3545-4fc3-8924-389a98f29fb2 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:35 devstack sudo[98099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-130a3cfc-3545-4fc3-8924-389a98f29fb2 Aug 31 15:22:35 devstack sudo[98099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:35 devstack sudo[98092]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8a093adb-cacf-4574-b5f4-df352bd7fe88 tempest-VolumesExtendTest-978818700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740.info" returned: 0 in 0.552s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8a093adb-cacf-4574-b5f4-df352bd7fe88 tempest-VolumesExtendTest-978818700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.833s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:22:35 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-8a093adb-cacf-4574-b5f4-df352bd7fe88 tempest-VolumesExtendTest-978818700 None] Create snapshot completed successfully Aug 31 15:22:35 devstack sudo[98099]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-eeb5d3d9-c311-4adb-a1f5-48a495c71c7d tempest-VolumesActionsTest-708297345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-130a3cfc-3545-4fc3-8924-389a98f29fb2" returned: 0 in 0.764s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:36 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-eeb5d3d9-c311-4adb-a1f5-48a495c71c7d tempest-VolumesActionsTest-708297345 None] Lock "cinder-quobyte-130a3cfc-3545-4fc3-8924-389a98f29fb2" released by "delete_volume" :: held 1.441s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:22:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8f5175ac-b9d3-4674-95ea-8c328322a8ec tempest-VolumesExtendTest-978818700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:22:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8f5175ac-b9d3-4674-95ea-8c328322a8ec tempest-VolumesExtendTest-978818700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:22:36 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-eeb5d3d9-c311-4adb-a1f5-48a495c71c7d tempest-VolumesActionsTest-708297345 None] Created reservations ['ffd3af8f-81d8-40f8-b47c-a8fe1e27bef5', '8367c0ce-c3c9-43d7-ac94-2088b3646003', '1da3cb2d-e10c-4b79-a5b6-f6d01c47c3ad', 'b6edebb2-c61c-411e-b57b-632b22aa1eb1'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:22:36 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae291f6-6df6-4a8d-a1d4-8c9725481b13]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:22:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8f5175ac-b9d3-4674-95ea-8c328322a8ec tempest-VolumesExtendTest-978818700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:36 devstack sudo[98108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740 Aug 31 15:22:36 devstack sudo[98108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-eeb5d3d9-c311-4adb-a1f5-48a495c71c7d tempest-VolumesActionsTest-708297345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:22:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-eeb5d3d9-c311-4adb-a1f5-48a495c71c7d tempest-VolumesActionsTest-708297345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:22:36 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-eeb5d3d9-c311-4adb-a1f5-48a495c71c7d tempest-VolumesActionsTest-708297345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:22:36 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-eeb5d3d9-c311-4adb-a1f5-48a495c71c7d tempest-VolumesActionsTest-708297345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:22:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-eeb5d3d9-c311-4adb-a1f5-48a495c71c7d tempest-VolumesActionsTest-708297345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:22:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-eeb5d3d9-c311-4adb-a1f5-48a495c71c7d tempest-VolumesActionsTest-708297345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:36 devstack sudo[98110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:22:36 devstack sudo[98110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:36 devstack sudo[98108]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8f5175ac-b9d3-4674-95ea-8c328322a8ec tempest-VolumesExtendTest-978818700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740" returned: 0 in 0.708s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8f5175ac-b9d3-4674-95ea-8c328322a8ec tempest-VolumesExtendTest-978818700 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740.330a601b-3cf7-469c-9336-f91b505e41fc 2G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:37 devstack sudo[98110]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-eeb5d3d9-c311-4adb-a1f5-48a495c71c7d tempest-VolumesActionsTest-708297345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.593s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:37 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-eeb5d3d9-c311-4adb-a1f5-48a495c71c7d tempest-VolumesActionsTest-708297345 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:22:37 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-eeb5d3d9-c311-4adb-a1f5-48a495c71c7d tempest-VolumesActionsTest-708297345 None] Deleted volume successfully. Aug 31 15:22:37 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-eeb5d3d9-c311-4adb-a1f5-48a495c71c7d tempest-VolumesActionsTest-708297345 None] Lock "cinder-130a3cfc-3545-4fc3-8924-389a98f29fb2-delete_volume" released by "delete_volume" :: held 2.698s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:22:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8f5175ac-b9d3-4674-95ea-8c328322a8ec tempest-VolumesExtendTest-978818700 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740.330a601b-3cf7-469c-9336-f91b505e41fc 2G" returned: 0 in 0.354s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8f5175ac-b9d3-4674-95ea-8c328322a8ec tempest-VolumesExtendTest-978818700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.172s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:22:37 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-8f5175ac-b9d3-4674-95ea-8c328322a8ec tempest-VolumesExtendTest-978818700 None] Extend volume completed successfully. Aug 31 15:22:38 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7c6cc360-03bd-4629-9f99-2e5e25856b45 tempest-VolumesExtendTest-978818700 None] Acquiring lock "cinder-330a601b-3cf7-469c-9336-f91b505e41fc-delete_snapshot" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:22:38 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7c6cc360-03bd-4629-9f99-2e5e25856b45 tempest-VolumesExtendTest-978818700 None] Lock "cinder-330a601b-3cf7-469c-9336-f91b505e41fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:22:38 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7c6cc360-03bd-4629-9f99-2e5e25856b45 tempest-VolumesExtendTest-978818700 None] Acquiring lock "cinder-quobyte-da4317c5-4c25-437a-9aa5-05ac8663d740" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:22:38 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7c6cc360-03bd-4629-9f99-2e5e25856b45 tempest-VolumesExtendTest-978818700 None] Lock "cinder-quobyte-da4317c5-4c25-437a-9aa5-05ac8663d740" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:22:38 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7c6cc360-03bd-4629-9f99-2e5e25856b45 tempest-VolumesExtendTest-978818700 None] Acquiring lock "cinder-quobyte-330a601b-3cf7-469c-9336-f91b505e41fc" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:22:38 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7c6cc360-03bd-4629-9f99-2e5e25856b45 tempest-VolumesExtendTest-978818700 None] Lock "cinder-quobyte-330a601b-3cf7-469c-9336-f91b505e41fc" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:22:38 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-7c6cc360-03bd-4629-9f99-2e5e25856b45 tempest-VolumesExtendTest-978818700 None] Deleting offline snapshot 330a601b-3cf7-469c-9336-f91b505e41fc of volume da4317c5-4c25-437a-9aa5-05ac8663d740 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:22:38 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-7c6cc360-03bd-4629-9f99-2e5e25856b45 tempest-VolumesExtendTest-978818700 None] snapshot_file for this snap is: volume-da4317c5-4c25-437a-9aa5-05ac8663d740.330a601b-3cf7-469c-9336-f91b505e41fc {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:22:38 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3781a64-c20e-4685-b6ed-5ce5e7beb3bd]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:22:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7c6cc360-03bd-4629-9f99-2e5e25856b45 tempest-VolumesExtendTest-978818700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740.330a601b-3cf7-469c-9336-f91b505e41fc {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:39 devstack sudo[98141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740.330a601b-3cf7-469c-9336-f91b505e41fc Aug 31 15:22:39 devstack sudo[98141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:39 devstack sudo[98141]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7c6cc360-03bd-4629-9f99-2e5e25856b45 tempest-VolumesExtendTest-978818700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740.330a601b-3cf7-469c-9336-f91b505e41fc" returned: 0 in 0.518s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:39 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-7c6cc360-03bd-4629-9f99-2e5e25856b45 tempest-VolumesExtendTest-978818700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da4317c5-4c25-437a-9aa5-05ac8663d740(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:22:39 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[566b64a6-4747-41fa-a2d9-dcd6c2c32d98]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:22:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7c6cc360-03bd-4629-9f99-2e5e25856b45 tempest-VolumesExtendTest-978818700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:39 devstack sudo[98146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740 Aug 31 15:22:39 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:39 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7c6cc360-03bd-4629-9f99-2e5e25856b45 tempest-VolumesExtendTest-978818700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740" returned: 0 in 0.370s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7c6cc360-03bd-4629-9f99-2e5e25856b45 tempest-VolumesExtendTest-978818700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740.330a601b-3cf7-469c-9336-f91b505e41fc {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:39 devstack sudo[98152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740.330a601b-3cf7-469c-9336-f91b505e41fc Aug 31 15:22:39 devstack sudo[98152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:40 devstack sudo[98152]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7c6cc360-03bd-4629-9f99-2e5e25856b45 tempest-VolumesExtendTest-978818700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740.330a601b-3cf7-469c-9336-f91b505e41fc" returned: 0 in 0.582s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7c6cc360-03bd-4629-9f99-2e5e25856b45 tempest-VolumesExtendTest-978818700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740.330a601b-3cf7-469c-9336-f91b505e41fc {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:40 devstack sudo[98157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740.330a601b-3cf7-469c-9336-f91b505e41fc Aug 31 15:22:40 devstack sudo[98157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:40 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbbca23a-b930-4069-8780-abd073b9a9ef tempest-VolumesActionsTest-708297345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:22:40 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-bbbca23a-b930-4069-8780-abd073b9a9ef tempest-VolumesActionsTest-708297345 None] Flow 'volume_create_manager' (2e34657c-2cae-4d18-b31c-cf8dfe49ba2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:22:40 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-bbbca23a-b930-4069-8780-abd073b9a9ef tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7a8fc73-5c51-4345-a749-38c872d0b2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:22:40 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-bbbca23a-b930-4069-8780-abd073b9a9ef tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7a8fc73-5c51-4345-a749-38c872d0b2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-323544491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cd82748-8d23-439d-abf0-8221bf883131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='330f65e7fa454901ad7aa0d1e12dffad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:22:41Z,use_quota=True,user_id='d581dbe42c6f484ca29e2108b2fd0d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:22:40 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-bbbca23a-b930-4069-8780-abd073b9a9ef tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f241dbd-2f8f-4901-b6e4-b2bbb1d6221f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:22:40 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-bbbca23a-b930-4069-8780-abd073b9a9ef tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f241dbd-2f8f-4901-b6e4-b2bbb1d6221f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:22:40 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-bbbca23a-b930-4069-8780-abd073b9a9ef tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e0db9b2-9c96-4c60-900a-c5670b0e93f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:22:40 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-bbbca23a-b930-4069-8780-abd073b9a9ef tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e0db9b2-9c96-4c60-900a-c5670b0e93f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cd82748-8d23-439d-abf0-8221bf883131', 'volume_name': 'volume-9cd82748-8d23-439d-abf0-8221bf883131', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:22:40 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-bbbca23a-b930-4069-8780-abd073b9a9ef tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f7b2d11-3bff-41b6-a979-d3dd237010ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:22:40 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-bbbca23a-b930-4069-8780-abd073b9a9ef tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f7b2d11-3bff-41b6-a979-d3dd237010ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:22:40 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-bbbca23a-b930-4069-8780-abd073b9a9ef tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4ce6292-eab4-40c9-9bf7-15c8d1453058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:22:40 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-bbbca23a-b930-4069-8780-abd073b9a9ef tempest-VolumesActionsTest-708297345 None] Volume 9cd82748-8d23-439d-abf0-8221bf883131: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cd82748-8d23-439d-abf0-8221bf883131', 'volume_size': 1} Aug 31 15:22:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bbbca23a-b930-4069-8780-abd073b9a9ef tempest-VolumesActionsTest-708297345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:22:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bbbca23a-b930-4069-8780-abd073b9a9ef tempest-VolumesActionsTest-708297345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:22:40 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-bbbca23a-b930-4069-8780-abd073b9a9ef tempest-VolumesActionsTest-708297345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-323544491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cd82748-8d23-439d-abf0-8221bf883131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='330f65e7fa454901ad7aa0d1e12dffad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:22:41Z,use_quota=True,user_id='d581dbe42c6f484ca29e2108b2fd0d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:22:40 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-bbbca23a-b930-4069-8780-abd073b9a9ef tempest-VolumesActionsTest-708297345 None] Creating volume 9cd82748-8d23-439d-abf0-8221bf883131 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:22:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bbbca23a-b930-4069-8780-abd073b9a9ef tempest-VolumesActionsTest-708297345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:22:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bbbca23a-b930-4069-8780-abd073b9a9ef tempest-VolumesActionsTest-708297345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:22:40 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-bbbca23a-b930-4069-8780-abd073b9a9ef tempest-VolumesActionsTest-708297345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:22:40 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-bbbca23a-b930-4069-8780-abd073b9a9ef tempest-VolumesActionsTest-708297345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:22:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bbbca23a-b930-4069-8780-abd073b9a9ef tempest-VolumesActionsTest-708297345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:22:40 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-bbbca23a-b930-4069-8780-abd073b9a9ef tempest-VolumesActionsTest-708297345 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:22:40 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-bbbca23a-b930-4069-8780-abd073b9a9ef tempest-VolumesActionsTest-708297345 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:22:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bbbca23a-b930-4069-8780-abd073b9a9ef tempest-VolumesActionsTest-708297345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9cd82748-8d23-439d-abf0-8221bf883131 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:40 devstack sudo[98157]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7c6cc360-03bd-4629-9f99-2e5e25856b45 tempest-VolumesExtendTest-978818700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740.330a601b-3cf7-469c-9336-f91b505e41fc" returned: 0 in 0.549s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:41 devstack sudo[98160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9cd82748-8d23-439d-abf0-8221bf883131 1073741824 Aug 31 15:22:41 devstack sudo[98160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:41 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7c6cc360-03bd-4629-9f99-2e5e25856b45 tempest-VolumesExtendTest-978818700 None] Lock "cinder-quobyte-330a601b-3cf7-469c-9336-f91b505e41fc" released by "_delete_snapshot" :: held 2.181s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:22:41 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7c6cc360-03bd-4629-9f99-2e5e25856b45 tempest-VolumesExtendTest-978818700 None] Lock "cinder-quobyte-da4317c5-4c25-437a-9aa5-05ac8663d740" released by "delete_snapshot" :: held 2.231s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:22:41 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-7c6cc360-03bd-4629-9f99-2e5e25856b45 tempest-VolumesExtendTest-978818700 None] Created reservations ['a45effc8-e7d3-4743-ad3c-517f1625a633', 'bd3c8e9d-e8ab-431a-8d03-a62730daacb5', '00f0a1f5-dae5-42c8-a36d-2ba31ccdad04', 'd06f9708-db8f-4d60-b2f0-9744ca39d0bc'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:22:41 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-7c6cc360-03bd-4629-9f99-2e5e25856b45 tempest-VolumesExtendTest-978818700 None] Delete snapshot completed successfully. Aug 31 15:22:41 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7c6cc360-03bd-4629-9f99-2e5e25856b45 tempest-VolumesExtendTest-978818700 None] Lock "cinder-330a601b-3cf7-469c-9336-f91b505e41fc-delete_snapshot" released by "delete_snapshot" :: held 2.433s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:22:41 devstack sudo[98160]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bbbca23a-b930-4069-8780-abd073b9a9ef tempest-VolumesActionsTest-708297345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9cd82748-8d23-439d-abf0-8221bf883131 1073741824" returned: 0 in 0.588s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bbbca23a-b930-4069-8780-abd073b9a9ef tempest-VolumesActionsTest-708297345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9cd82748-8d23-439d-abf0-8221bf883131 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:41 devstack sudo[98172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9cd82748-8d23-439d-abf0-8221bf883131 Aug 31 15:22:41 devstack sudo[98172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:41 devstack sudo[98172]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bbbca23a-b930-4069-8780-abd073b9a9ef tempest-VolumesActionsTest-708297345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9cd82748-8d23-439d-abf0-8221bf883131" returned: 0 in 0.288s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:41 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-bbbca23a-b930-4069-8780-abd073b9a9ef tempest-VolumesActionsTest-708297345 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:22:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bbbca23a-b930-4069-8780-abd073b9a9ef tempest-VolumesActionsTest-708297345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:22:41 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-bbbca23a-b930-4069-8780-abd073b9a9ef tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4ce6292-eab4-40c9-9bf7-15c8d1453058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cd82748-8d23-439d-abf0-8221bf883131', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:22:41 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-bbbca23a-b930-4069-8780-abd073b9a9ef tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2673fee8-99fc-4dde-8418-6b7a54e4b47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:22:41 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-bbbca23a-b930-4069-8780-abd073b9a9ef tempest-VolumesActionsTest-708297345 None] Volume volume-9cd82748-8d23-439d-abf0-8221bf883131 (9cd82748-8d23-439d-abf0-8221bf883131): created successfully Aug 31 15:22:41 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-bbbca23a-b930-4069-8780-abd073b9a9ef tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2673fee8-99fc-4dde-8418-6b7a54e4b47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:22:41 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-bbbca23a-b930-4069-8780-abd073b9a9ef tempest-VolumesActionsTest-708297345 None] Flow 'volume_create_manager' (2e34657c-2cae-4d18-b31c-cf8dfe49ba2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:22:41 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-bbbca23a-b930-4069-8780-abd073b9a9ef tempest-VolumesActionsTest-708297345 None] Created volume successfully. Aug 31 15:22:42 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-d62623a2-c13b-4b3a-832d-0fb748d91270 tempest-VolumesExtendTest-978818700 None] Acquiring lock "cinder-da4317c5-4c25-437a-9aa5-05ac8663d740-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:22:42 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-d62623a2-c13b-4b3a-832d-0fb748d91270 tempest-VolumesExtendTest-978818700 None] Lock "cinder-da4317c5-4c25-437a-9aa5-05ac8663d740-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:22:42 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-d62623a2-c13b-4b3a-832d-0fb748d91270 tempest-VolumesExtendTest-978818700 None] Acquiring lock "cinder-quobyte-da4317c5-4c25-437a-9aa5-05ac8663d740" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:22:42 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-d62623a2-c13b-4b3a-832d-0fb748d91270 tempest-VolumesExtendTest-978818700 None] Lock "cinder-quobyte-da4317c5-4c25-437a-9aa5-05ac8663d740" acquired by "delete_volume" :: waited 0.016s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:22:42 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45dddac-61fb-434f-a11d-7ba723a95ed4]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:22:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d62623a2-c13b-4b3a-832d-0fb748d91270 tempest-VolumesExtendTest-978818700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:42 devstack sudo[98175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740 Aug 31 15:22:42 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:42 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d62623a2-c13b-4b3a-832d-0fb748d91270 tempest-VolumesExtendTest-978818700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740" returned: 0 in 0.405s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d62623a2-c13b-4b3a-832d-0fb748d91270 tempest-VolumesExtendTest-978818700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:42 devstack sudo[98180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740 Aug 31 15:22:42 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:42 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d62623a2-c13b-4b3a-832d-0fb748d91270 tempest-VolumesExtendTest-978818700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-da4317c5-4c25-437a-9aa5-05ac8663d740" returned: 0 in 0.297s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:42 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-d62623a2-c13b-4b3a-832d-0fb748d91270 tempest-VolumesExtendTest-978818700 None] Lock "cinder-quobyte-da4317c5-4c25-437a-9aa5-05ac8663d740" released by "delete_volume" :: held 0.764s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:22:43 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-d62623a2-c13b-4b3a-832d-0fb748d91270 tempest-VolumesExtendTest-978818700 None] Created reservations ['32d00216-17c4-471b-a4ca-f9887161fc9f', 'a7b856bb-fd69-42ba-9a26-be3787f3b14b', '41f2fc12-b79f-4da9-9784-a3594bbca6de', 'c70394fe-a091-4021-9060-b52768bd0356'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:22:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-d62623a2-c13b-4b3a-832d-0fb748d91270 tempest-VolumesExtendTest-978818700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:22:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-d62623a2-c13b-4b3a-832d-0fb748d91270 tempest-VolumesExtendTest-978818700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:22:43 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-d62623a2-c13b-4b3a-832d-0fb748d91270 tempest-VolumesExtendTest-978818700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:22:43 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-d62623a2-c13b-4b3a-832d-0fb748d91270 tempest-VolumesExtendTest-978818700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:22:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-d62623a2-c13b-4b3a-832d-0fb748d91270 tempest-VolumesExtendTest-978818700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:22:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d62623a2-c13b-4b3a-832d-0fb748d91270 tempest-VolumesExtendTest-978818700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:43 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-493e7efc-952d-4084-bd5d-6646a89e8b23 tempest-VolumesActionsTest-1524955045 None] Acquiring lock "cinder-9cd82748-8d23-439d-abf0-8221bf883131-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:22:43 devstack sudo[98183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:22:43 devstack sudo[98183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:43 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-493e7efc-952d-4084-bd5d-6646a89e8b23 tempest-VolumesActionsTest-1524955045 None] Lock "cinder-9cd82748-8d23-439d-abf0-8221bf883131-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:22:43 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-493e7efc-952d-4084-bd5d-6646a89e8b23 tempest-VolumesActionsTest-1524955045 None] Acquiring lock "cinder-quobyte-9cd82748-8d23-439d-abf0-8221bf883131" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:22:43 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-493e7efc-952d-4084-bd5d-6646a89e8b23 tempest-VolumesActionsTest-1524955045 None] Lock "cinder-quobyte-9cd82748-8d23-439d-abf0-8221bf883131" acquired by "delete_volume" :: waited 0.044s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:22:43 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[288f9dde-6cb7-414d-93ba-2a81d2332528]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:22:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-493e7efc-952d-4084-bd5d-6646a89e8b23 tempest-VolumesActionsTest-1524955045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9cd82748-8d23-439d-abf0-8221bf883131 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:43 devstack sudo[98186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9cd82748-8d23-439d-abf0-8221bf883131 Aug 31 15:22:43 devstack sudo[98186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:43 devstack sudo[98183]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d62623a2-c13b-4b3a-832d-0fb748d91270 tempest-VolumesExtendTest-978818700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.426s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:43 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-d62623a2-c13b-4b3a-832d-0fb748d91270 tempest-VolumesExtendTest-978818700 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:22:43 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-d62623a2-c13b-4b3a-832d-0fb748d91270 tempest-VolumesExtendTest-978818700 None] Deleted volume successfully. Aug 31 15:22:43 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-d62623a2-c13b-4b3a-832d-0fb748d91270 tempest-VolumesExtendTest-978818700 None] Lock "cinder-da4317c5-4c25-437a-9aa5-05ac8663d740-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:22:43 devstack sudo[98186]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-493e7efc-952d-4084-bd5d-6646a89e8b23 tempest-VolumesActionsTest-1524955045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9cd82748-8d23-439d-abf0-8221bf883131" returned: 0 in 0.565s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-493e7efc-952d-4084-bd5d-6646a89e8b23 tempest-VolumesActionsTest-1524955045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9cd82748-8d23-439d-abf0-8221bf883131 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:43 devstack sudo[98193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9cd82748-8d23-439d-abf0-8221bf883131 Aug 31 15:22:43 devstack sudo[98193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:44 devstack sudo[98193]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-493e7efc-952d-4084-bd5d-6646a89e8b23 tempest-VolumesActionsTest-1524955045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9cd82748-8d23-439d-abf0-8221bf883131" returned: 0 in 0.313s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:44 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-493e7efc-952d-4084-bd5d-6646a89e8b23 tempest-VolumesActionsTest-1524955045 None] Lock "cinder-quobyte-9cd82748-8d23-439d-abf0-8221bf883131" released by "delete_volume" :: held 0.940s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:22:44 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-493e7efc-952d-4084-bd5d-6646a89e8b23 tempest-VolumesActionsTest-1524955045 None] Created reservations ['fc3e4aed-0f9a-4591-968c-ddf1414e2cc9', '085287ff-e1b6-41f8-a3ca-5c3554bdeb7c', '68ccf23a-cf85-436e-8e74-a9992e2d2375', '381d95d1-e042-4002-8a78-0adf0504d26e'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:22:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-493e7efc-952d-4084-bd5d-6646a89e8b23 tempest-VolumesActionsTest-1524955045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:22:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-493e7efc-952d-4084-bd5d-6646a89e8b23 tempest-VolumesActionsTest-1524955045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:22:44 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-493e7efc-952d-4084-bd5d-6646a89e8b23 tempest-VolumesActionsTest-1524955045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:22:44 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-493e7efc-952d-4084-bd5d-6646a89e8b23 tempest-VolumesActionsTest-1524955045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:22:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-493e7efc-952d-4084-bd5d-6646a89e8b23 tempest-VolumesActionsTest-1524955045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:22:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-493e7efc-952d-4084-bd5d-6646a89e8b23 tempest-VolumesActionsTest-1524955045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:44 devstack sudo[98196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:22:44 devstack sudo[98196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:44 devstack sudo[98196]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-493e7efc-952d-4084-bd5d-6646a89e8b23 tempest-VolumesActionsTest-1524955045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.283s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:44 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-493e7efc-952d-4084-bd5d-6646a89e8b23 tempest-VolumesActionsTest-1524955045 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:22:44 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-493e7efc-952d-4084-bd5d-6646a89e8b23 tempest-VolumesActionsTest-1524955045 None] Deleted volume successfully. Aug 31 15:22:44 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-493e7efc-952d-4084-bd5d-6646a89e8b23 tempest-VolumesActionsTest-1524955045 None] Lock "cinder-9cd82748-8d23-439d-abf0-8221bf883131-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:22:45 devstack cinder-volume[86000]: DEBUG oslo_service.periodic_task [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86000) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:22:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:22:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:22:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:22:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:22:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:22:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:45 devstack sudo[98199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:22:45 devstack sudo[98199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:45 devstack sudo[98199]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.307s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:45 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:22:45 devstack cinder-volume[86000]: DEBUG oslo_service.periodic_task [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running periodic task VolumeManager._thread_info {{(pid=86000) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:22:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] thread count: 28 {{(pid=86000) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 31 15:22:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] thread info: [<_MainThread(MainThread, started 137631281086592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86000) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 31 15:22:46 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-44f94376-0e80-4bdf-98e4-c231b064025e tempest-VolumesActionsTest-708297345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:22:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-44f94376-0e80-4bdf-98e4-c231b064025e tempest-VolumesActionsTest-708297345 None] Flow 'volume_create_manager' (40b1920e-0a9c-4da4-86a8-866b48b82d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:22:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-44f94376-0e80-4bdf-98e4-c231b064025e tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (860738f7-e05c-401a-ac86-d6fd36cfce33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:22:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-44f94376-0e80-4bdf-98e4-c231b064025e tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (860738f7-e05c-401a-ac86-d6fd36cfce33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-833758596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1fb43e5-10d5-46cc-bb12-ec2603af4227,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='330f65e7fa454901ad7aa0d1e12dffad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:22:46Z,use_quota=True,user_id='d581dbe42c6f484ca29e2108b2fd0d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:22:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-44f94376-0e80-4bdf-98e4-c231b064025e tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfccefb9-90dc-4cab-b2da-71c75d93a78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:22:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-44f94376-0e80-4bdf-98e4-c231b064025e tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfccefb9-90dc-4cab-b2da-71c75d93a78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:22:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-44f94376-0e80-4bdf-98e4-c231b064025e tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5d2fb94-71ee-4f2a-b792-4adbcc6ceba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:22:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-44f94376-0e80-4bdf-98e4-c231b064025e tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5d2fb94-71ee-4f2a-b792-4adbcc6ceba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1fb43e5-10d5-46cc-bb12-ec2603af4227', 'volume_name': 'volume-f1fb43e5-10d5-46cc-bb12-ec2603af4227', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:22:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-44f94376-0e80-4bdf-98e4-c231b064025e tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e698dbda-3e1f-4ebf-9d7b-5876749dc621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:22:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-44f94376-0e80-4bdf-98e4-c231b064025e tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e698dbda-3e1f-4ebf-9d7b-5876749dc621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:22:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-44f94376-0e80-4bdf-98e4-c231b064025e tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40222e83-ad76-4820-a214-a73e222936a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:22:46 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-44f94376-0e80-4bdf-98e4-c231b064025e tempest-VolumesActionsTest-708297345 None] Volume f1fb43e5-10d5-46cc-bb12-ec2603af4227: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1fb43e5-10d5-46cc-bb12-ec2603af4227', 'volume_size': 1} Aug 31 15:22:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-44f94376-0e80-4bdf-98e4-c231b064025e tempest-VolumesActionsTest-708297345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:22:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-44f94376-0e80-4bdf-98e4-c231b064025e tempest-VolumesActionsTest-708297345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:22:46 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-44f94376-0e80-4bdf-98e4-c231b064025e tempest-VolumesActionsTest-708297345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-833758596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1fb43e5-10d5-46cc-bb12-ec2603af4227,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='330f65e7fa454901ad7aa0d1e12dffad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:22:46Z,use_quota=True,user_id='d581dbe42c6f484ca29e2108b2fd0d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:22:46 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-44f94376-0e80-4bdf-98e4-c231b064025e tempest-VolumesActionsTest-708297345 None] Creating volume f1fb43e5-10d5-46cc-bb12-ec2603af4227 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:22:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-44f94376-0e80-4bdf-98e4-c231b064025e tempest-VolumesActionsTest-708297345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:22:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-44f94376-0e80-4bdf-98e4-c231b064025e tempest-VolumesActionsTest-708297345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:22:46 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-44f94376-0e80-4bdf-98e4-c231b064025e tempest-VolumesActionsTest-708297345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:22:46 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-44f94376-0e80-4bdf-98e4-c231b064025e tempest-VolumesActionsTest-708297345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:22:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-44f94376-0e80-4bdf-98e4-c231b064025e tempest-VolumesActionsTest-708297345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:22:46 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-44f94376-0e80-4bdf-98e4-c231b064025e tempest-VolumesActionsTest-708297345 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:22:46 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-44f94376-0e80-4bdf-98e4-c231b064025e tempest-VolumesActionsTest-708297345 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:22:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-44f94376-0e80-4bdf-98e4-c231b064025e tempest-VolumesActionsTest-708297345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f1fb43e5-10d5-46cc-bb12-ec2603af4227 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:46 devstack sudo[98202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f1fb43e5-10d5-46cc-bb12-ec2603af4227 1073741824 Aug 31 15:22:46 devstack sudo[98202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:46 devstack sudo[98202]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-44f94376-0e80-4bdf-98e4-c231b064025e tempest-VolumesActionsTest-708297345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f1fb43e5-10d5-46cc-bb12-ec2603af4227 1073741824" returned: 0 in 0.560s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-44f94376-0e80-4bdf-98e4-c231b064025e tempest-VolumesActionsTest-708297345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f1fb43e5-10d5-46cc-bb12-ec2603af4227 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:46 devstack sudo[98207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f1fb43e5-10d5-46cc-bb12-ec2603af4227 Aug 31 15:22:46 devstack sudo[98207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:47 devstack sudo[98207]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-44f94376-0e80-4bdf-98e4-c231b064025e tempest-VolumesActionsTest-708297345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f1fb43e5-10d5-46cc-bb12-ec2603af4227" returned: 0 in 0.292s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:47 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-44f94376-0e80-4bdf-98e4-c231b064025e tempest-VolumesActionsTest-708297345 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:22:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-44f94376-0e80-4bdf-98e4-c231b064025e tempest-VolumesActionsTest-708297345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:22:47 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-44f94376-0e80-4bdf-98e4-c231b064025e tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40222e83-ad76-4820-a214-a73e222936a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1fb43e5-10d5-46cc-bb12-ec2603af4227', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:22:47 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-44f94376-0e80-4bdf-98e4-c231b064025e tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6d175df-afdc-4830-8b36-9bbd097ed945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:22:47 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-44f94376-0e80-4bdf-98e4-c231b064025e tempest-VolumesActionsTest-708297345 None] Volume volume-f1fb43e5-10d5-46cc-bb12-ec2603af4227 (f1fb43e5-10d5-46cc-bb12-ec2603af4227): created successfully Aug 31 15:22:47 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-44f94376-0e80-4bdf-98e4-c231b064025e tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6d175df-afdc-4830-8b36-9bbd097ed945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:22:47 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-44f94376-0e80-4bdf-98e4-c231b064025e tempest-VolumesActionsTest-708297345 None] Flow 'volume_create_manager' (40b1920e-0a9c-4da4-86a8-866b48b82d09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:22:47 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-44f94376-0e80-4bdf-98e4-c231b064025e tempest-VolumesActionsTest-708297345 None] Created volume successfully. Aug 31 15:22:48 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-30fb1a42-49fe-478e-9309-7fd5956f47df tempest-VolumesActionsTest-1524955045 None] Acquiring lock "cinder-f1fb43e5-10d5-46cc-bb12-ec2603af4227-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:22:48 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-30fb1a42-49fe-478e-9309-7fd5956f47df tempest-VolumesActionsTest-1524955045 None] Lock "cinder-f1fb43e5-10d5-46cc-bb12-ec2603af4227-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:22:48 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-30fb1a42-49fe-478e-9309-7fd5956f47df tempest-VolumesActionsTest-1524955045 None] Acquiring lock "cinder-quobyte-f1fb43e5-10d5-46cc-bb12-ec2603af4227" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:22:48 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-30fb1a42-49fe-478e-9309-7fd5956f47df tempest-VolumesActionsTest-1524955045 None] Lock "cinder-quobyte-f1fb43e5-10d5-46cc-bb12-ec2603af4227" acquired by "delete_volume" :: waited 0.031s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:22:48 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8473d8ed-8386-4d29-8a7c-b0323eacd260]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:22:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-30fb1a42-49fe-478e-9309-7fd5956f47df tempest-VolumesActionsTest-1524955045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f1fb43e5-10d5-46cc-bb12-ec2603af4227 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:48 devstack sudo[98214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f1fb43e5-10d5-46cc-bb12-ec2603af4227 Aug 31 15:22:48 devstack sudo[98214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:49 devstack sudo[98214]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-30fb1a42-49fe-478e-9309-7fd5956f47df tempest-VolumesActionsTest-1524955045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f1fb43e5-10d5-46cc-bb12-ec2603af4227" returned: 0 in 0.491s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-30fb1a42-49fe-478e-9309-7fd5956f47df tempest-VolumesActionsTest-1524955045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f1fb43e5-10d5-46cc-bb12-ec2603af4227 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:49 devstack sudo[98219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f1fb43e5-10d5-46cc-bb12-ec2603af4227 Aug 31 15:22:49 devstack sudo[98219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:49 devstack sudo[98219]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-30fb1a42-49fe-478e-9309-7fd5956f47df tempest-VolumesActionsTest-1524955045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f1fb43e5-10d5-46cc-bb12-ec2603af4227" returned: 0 in 0.343s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:49 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-30fb1a42-49fe-478e-9309-7fd5956f47df tempest-VolumesActionsTest-1524955045 None] Lock "cinder-quobyte-f1fb43e5-10d5-46cc-bb12-ec2603af4227" released by "delete_volume" :: held 0.892s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:22:49 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-30fb1a42-49fe-478e-9309-7fd5956f47df tempest-VolumesActionsTest-1524955045 None] Created reservations ['49a4a223-16ac-46dc-a968-ae851e8baf76', '32e0473b-d667-4e29-8334-3582d65f4d1e', 'ae94f479-400d-474d-b841-99e08e94fb5a', '77fef329-e171-46cb-8b90-d67c1654eb3b'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:22:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-30fb1a42-49fe-478e-9309-7fd5956f47df tempest-VolumesActionsTest-1524955045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:22:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-30fb1a42-49fe-478e-9309-7fd5956f47df tempest-VolumesActionsTest-1524955045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:22:49 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-30fb1a42-49fe-478e-9309-7fd5956f47df tempest-VolumesActionsTest-1524955045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:22:49 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-30fb1a42-49fe-478e-9309-7fd5956f47df tempest-VolumesActionsTest-1524955045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:22:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-30fb1a42-49fe-478e-9309-7fd5956f47df tempest-VolumesActionsTest-1524955045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:22:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-30fb1a42-49fe-478e-9309-7fd5956f47df tempest-VolumesActionsTest-1524955045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:49 devstack sudo[98224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:22:49 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:49 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-30fb1a42-49fe-478e-9309-7fd5956f47df tempest-VolumesActionsTest-1524955045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.301s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:49 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-30fb1a42-49fe-478e-9309-7fd5956f47df tempest-VolumesActionsTest-1524955045 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:22:49 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-30fb1a42-49fe-478e-9309-7fd5956f47df tempest-VolumesActionsTest-1524955045 None] Deleted volume successfully. Aug 31 15:22:49 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-30fb1a42-49fe-478e-9309-7fd5956f47df tempest-VolumesActionsTest-1524955045 None] Lock "cinder-f1fb43e5-10d5-46cc-bb12-ec2603af4227-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:22:50 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-8026f3c0-2b41-44bf-9e4c-0cbb805154f4 tempest-VolumesActionsTest-708297345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:22:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8026f3c0-2b41-44bf-9e4c-0cbb805154f4 tempest-VolumesActionsTest-708297345 None] Flow 'volume_create_manager' (135a0c3d-894d-447b-9d77-cee09c191c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:22:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8026f3c0-2b41-44bf-9e4c-0cbb805154f4 tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0847891f-293f-47d0-beac-089927961ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:22:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8026f3c0-2b41-44bf-9e4c-0cbb805154f4 tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0847891f-293f-47d0-beac-089927961ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-383113632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7498cdb3-0f9b-4f41-b4a1-e3f65f0018b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='330f65e7fa454901ad7aa0d1e12dffad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:22:50Z,use_quota=True,user_id='d581dbe42c6f484ca29e2108b2fd0d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:22:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8026f3c0-2b41-44bf-9e4c-0cbb805154f4 tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b09073b-6dbd-4e8c-96ff-f96cf93abf2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:22:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8026f3c0-2b41-44bf-9e4c-0cbb805154f4 tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b09073b-6dbd-4e8c-96ff-f96cf93abf2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:22:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8026f3c0-2b41-44bf-9e4c-0cbb805154f4 tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47479583-b795-4a4b-8dc6-220a11745a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:22:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8026f3c0-2b41-44bf-9e4c-0cbb805154f4 tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47479583-b795-4a4b-8dc6-220a11745a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7498cdb3-0f9b-4f41-b4a1-e3f65f0018b6', 'volume_name': 'volume-7498cdb3-0f9b-4f41-b4a1-e3f65f0018b6', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:22:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8026f3c0-2b41-44bf-9e4c-0cbb805154f4 tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (690553f1-1e92-40da-a5e8-efbfe15734ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:22:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8026f3c0-2b41-44bf-9e4c-0cbb805154f4 tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (690553f1-1e92-40da-a5e8-efbfe15734ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:22:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8026f3c0-2b41-44bf-9e4c-0cbb805154f4 tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec506faa-663e-4a4c-93ce-0563091f0f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:22:50 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-8026f3c0-2b41-44bf-9e4c-0cbb805154f4 tempest-VolumesActionsTest-708297345 None] Volume 7498cdb3-0f9b-4f41-b4a1-e3f65f0018b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7498cdb3-0f9b-4f41-b4a1-e3f65f0018b6', 'volume_size': 1} Aug 31 15:22:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8026f3c0-2b41-44bf-9e4c-0cbb805154f4 tempest-VolumesActionsTest-708297345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:22:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8026f3c0-2b41-44bf-9e4c-0cbb805154f4 tempest-VolumesActionsTest-708297345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:22:50 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-8026f3c0-2b41-44bf-9e4c-0cbb805154f4 tempest-VolumesActionsTest-708297345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-383113632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7498cdb3-0f9b-4f41-b4a1-e3f65f0018b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='330f65e7fa454901ad7aa0d1e12dffad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:22:50Z,use_quota=True,user_id='d581dbe42c6f484ca29e2108b2fd0d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:22:50 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-8026f3c0-2b41-44bf-9e4c-0cbb805154f4 tempest-VolumesActionsTest-708297345 None] Creating volume 7498cdb3-0f9b-4f41-b4a1-e3f65f0018b6 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:22:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8026f3c0-2b41-44bf-9e4c-0cbb805154f4 tempest-VolumesActionsTest-708297345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:22:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8026f3c0-2b41-44bf-9e4c-0cbb805154f4 tempest-VolumesActionsTest-708297345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:22:50 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-8026f3c0-2b41-44bf-9e4c-0cbb805154f4 tempest-VolumesActionsTest-708297345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:22:50 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-8026f3c0-2b41-44bf-9e4c-0cbb805154f4 tempest-VolumesActionsTest-708297345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:22:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8026f3c0-2b41-44bf-9e4c-0cbb805154f4 tempest-VolumesActionsTest-708297345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:22:50 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-8026f3c0-2b41-44bf-9e4c-0cbb805154f4 tempest-VolumesActionsTest-708297345 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:22:50 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-8026f3c0-2b41-44bf-9e4c-0cbb805154f4 tempest-VolumesActionsTest-708297345 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:22:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8026f3c0-2b41-44bf-9e4c-0cbb805154f4 tempest-VolumesActionsTest-708297345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7498cdb3-0f9b-4f41-b4a1-e3f65f0018b6 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:50 devstack sudo[98228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7498cdb3-0f9b-4f41-b4a1-e3f65f0018b6 1073741824 Aug 31 15:22:50 devstack sudo[98228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:51 devstack sudo[98228]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8026f3c0-2b41-44bf-9e4c-0cbb805154f4 tempest-VolumesActionsTest-708297345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7498cdb3-0f9b-4f41-b4a1-e3f65f0018b6 1073741824" returned: 0 in 0.603s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8026f3c0-2b41-44bf-9e4c-0cbb805154f4 tempest-VolumesActionsTest-708297345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7498cdb3-0f9b-4f41-b4a1-e3f65f0018b6 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:51 devstack sudo[98233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7498cdb3-0f9b-4f41-b4a1-e3f65f0018b6 Aug 31 15:22:51 devstack sudo[98233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:51 devstack sudo[98233]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8026f3c0-2b41-44bf-9e4c-0cbb805154f4 tempest-VolumesActionsTest-708297345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7498cdb3-0f9b-4f41-b4a1-e3f65f0018b6" returned: 0 in 0.368s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:51 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-8026f3c0-2b41-44bf-9e4c-0cbb805154f4 tempest-VolumesActionsTest-708297345 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:22:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8026f3c0-2b41-44bf-9e4c-0cbb805154f4 tempest-VolumesActionsTest-708297345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:22:51 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8026f3c0-2b41-44bf-9e4c-0cbb805154f4 tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec506faa-663e-4a4c-93ce-0563091f0f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7498cdb3-0f9b-4f41-b4a1-e3f65f0018b6', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:22:51 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8026f3c0-2b41-44bf-9e4c-0cbb805154f4 tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80b086dc-2a0e-43e5-b94e-0e997752d68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:22:51 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-8026f3c0-2b41-44bf-9e4c-0cbb805154f4 tempest-VolumesActionsTest-708297345 None] Volume volume-7498cdb3-0f9b-4f41-b4a1-e3f65f0018b6 (7498cdb3-0f9b-4f41-b4a1-e3f65f0018b6): created successfully Aug 31 15:22:51 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8026f3c0-2b41-44bf-9e4c-0cbb805154f4 tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80b086dc-2a0e-43e5-b94e-0e997752d68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:22:51 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8026f3c0-2b41-44bf-9e4c-0cbb805154f4 tempest-VolumesActionsTest-708297345 None] Flow 'volume_create_manager' (135a0c3d-894d-447b-9d77-cee09c191c96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:22:51 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-8026f3c0-2b41-44bf-9e4c-0cbb805154f4 tempest-VolumesActionsTest-708297345 None] Created volume successfully. Aug 31 15:22:52 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6f1822ac-2ced-4a22-9e59-def190943ed0 tempest-VolumesActionsTest-1524955045 None] Acquiring lock "cinder-7498cdb3-0f9b-4f41-b4a1-e3f65f0018b6-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:22:52 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6f1822ac-2ced-4a22-9e59-def190943ed0 tempest-VolumesActionsTest-1524955045 None] Lock "cinder-7498cdb3-0f9b-4f41-b4a1-e3f65f0018b6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:22:52 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6f1822ac-2ced-4a22-9e59-def190943ed0 tempest-VolumesActionsTest-1524955045 None] Acquiring lock "cinder-quobyte-7498cdb3-0f9b-4f41-b4a1-e3f65f0018b6" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:22:52 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6f1822ac-2ced-4a22-9e59-def190943ed0 tempest-VolumesActionsTest-1524955045 None] Lock "cinder-quobyte-7498cdb3-0f9b-4f41-b4a1-e3f65f0018b6" acquired by "delete_volume" :: waited 0.025s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:22:52 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c1fb98-9a26-433c-acfd-0cdfdcdf7ceb]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:22:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6f1822ac-2ced-4a22-9e59-def190943ed0 tempest-VolumesActionsTest-1524955045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7498cdb3-0f9b-4f41-b4a1-e3f65f0018b6 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:53 devstack sudo[98236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7498cdb3-0f9b-4f41-b4a1-e3f65f0018b6 Aug 31 15:22:53 devstack sudo[98236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:53 devstack sudo[98236]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6f1822ac-2ced-4a22-9e59-def190943ed0 tempest-VolumesActionsTest-1524955045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7498cdb3-0f9b-4f41-b4a1-e3f65f0018b6" returned: 0 in 0.407s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6f1822ac-2ced-4a22-9e59-def190943ed0 tempest-VolumesActionsTest-1524955045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7498cdb3-0f9b-4f41-b4a1-e3f65f0018b6 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:53 devstack sudo[98241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7498cdb3-0f9b-4f41-b4a1-e3f65f0018b6 Aug 31 15:22:53 devstack sudo[98241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:53 devstack sudo[98241]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6f1822ac-2ced-4a22-9e59-def190943ed0 tempest-VolumesActionsTest-1524955045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7498cdb3-0f9b-4f41-b4a1-e3f65f0018b6" returned: 0 in 0.326s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:53 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6f1822ac-2ced-4a22-9e59-def190943ed0 tempest-VolumesActionsTest-1524955045 None] Lock "cinder-quobyte-7498cdb3-0f9b-4f41-b4a1-e3f65f0018b6" released by "delete_volume" :: held 0.785s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:22:53 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-6f1822ac-2ced-4a22-9e59-def190943ed0 tempest-VolumesActionsTest-1524955045 None] Created reservations ['32ae386a-9683-475f-900c-d1ae406bfd69', '50073f70-3105-461a-a4a3-91be547bd8df', '1760f923-b198-4a27-8ab9-c3c629ff9c35', 'cd12a6ad-ce2b-4a44-bec2-9887afa589a7'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:22:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6f1822ac-2ced-4a22-9e59-def190943ed0 tempest-VolumesActionsTest-1524955045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:22:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6f1822ac-2ced-4a22-9e59-def190943ed0 tempest-VolumesActionsTest-1524955045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:22:53 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6f1822ac-2ced-4a22-9e59-def190943ed0 tempest-VolumesActionsTest-1524955045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:22:53 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6f1822ac-2ced-4a22-9e59-def190943ed0 tempest-VolumesActionsTest-1524955045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:22:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6f1822ac-2ced-4a22-9e59-def190943ed0 tempest-VolumesActionsTest-1524955045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:22:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6f1822ac-2ced-4a22-9e59-def190943ed0 tempest-VolumesActionsTest-1524955045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:53 devstack sudo[98244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:22:53 devstack sudo[98244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:54 devstack sudo[98244]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6f1822ac-2ced-4a22-9e59-def190943ed0 tempest-VolumesActionsTest-1524955045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.301s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:54 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-6f1822ac-2ced-4a22-9e59-def190943ed0 tempest-VolumesActionsTest-1524955045 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:22:54 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-6f1822ac-2ced-4a22-9e59-def190943ed0 tempest-VolumesActionsTest-1524955045 None] Deleted volume successfully. Aug 31 15:22:54 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6f1822ac-2ced-4a22-9e59-def190943ed0 tempest-VolumesActionsTest-1524955045 None] Lock "cinder-7498cdb3-0f9b-4f41-b4a1-e3f65f0018b6-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:22:54 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-9680c9c0-6b0e-409d-9ec5-96fad511f0ab tempest-VolumesActionsTest-708297345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:22:54 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9680c9c0-6b0e-409d-9ec5-96fad511f0ab tempest-VolumesActionsTest-708297345 None] Flow 'volume_create_manager' (e24f08ef-22cc-40db-a1f8-c0f582d6afc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:22:54 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9680c9c0-6b0e-409d-9ec5-96fad511f0ab tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e91e0e1e-8c98-4dca-b4d3-827185cd0d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:22:54 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9680c9c0-6b0e-409d-9ec5-96fad511f0ab tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e91e0e1e-8c98-4dca-b4d3-827185cd0d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1188493405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb795bac-7359-4157-9443-de2c1940724e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='330f65e7fa454901ad7aa0d1e12dffad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:22:55Z,use_quota=True,user_id='d581dbe42c6f484ca29e2108b2fd0d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:22:54 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9680c9c0-6b0e-409d-9ec5-96fad511f0ab tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c7aed30-5b22-435f-8e41-3ec5bff244a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:22:54 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9680c9c0-6b0e-409d-9ec5-96fad511f0ab tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c7aed30-5b22-435f-8e41-3ec5bff244a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:22:54 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9680c9c0-6b0e-409d-9ec5-96fad511f0ab tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad22bed3-ba78-4aec-ab2e-134717a3bc35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:22:54 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9680c9c0-6b0e-409d-9ec5-96fad511f0ab tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad22bed3-ba78-4aec-ab2e-134717a3bc35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb795bac-7359-4157-9443-de2c1940724e', 'volume_name': 'volume-bb795bac-7359-4157-9443-de2c1940724e', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:22:54 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9680c9c0-6b0e-409d-9ec5-96fad511f0ab tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d5567dc-e767-4923-9b33-20574e93de5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:22:54 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9680c9c0-6b0e-409d-9ec5-96fad511f0ab tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d5567dc-e767-4923-9b33-20574e93de5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:22:54 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9680c9c0-6b0e-409d-9ec5-96fad511f0ab tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe150cb3-c1ae-495c-ae23-f1fd1bd15484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:22:54 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-9680c9c0-6b0e-409d-9ec5-96fad511f0ab tempest-VolumesActionsTest-708297345 None] Volume bb795bac-7359-4157-9443-de2c1940724e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb795bac-7359-4157-9443-de2c1940724e', 'volume_size': 1} Aug 31 15:22:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9680c9c0-6b0e-409d-9ec5-96fad511f0ab tempest-VolumesActionsTest-708297345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:22:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9680c9c0-6b0e-409d-9ec5-96fad511f0ab tempest-VolumesActionsTest-708297345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:22:54 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-9680c9c0-6b0e-409d-9ec5-96fad511f0ab tempest-VolumesActionsTest-708297345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1188493405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb795bac-7359-4157-9443-de2c1940724e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='330f65e7fa454901ad7aa0d1e12dffad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:22:55Z,use_quota=True,user_id='d581dbe42c6f484ca29e2108b2fd0d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:22:54 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-9680c9c0-6b0e-409d-9ec5-96fad511f0ab tempest-VolumesActionsTest-708297345 None] Creating volume bb795bac-7359-4157-9443-de2c1940724e {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:22:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9680c9c0-6b0e-409d-9ec5-96fad511f0ab tempest-VolumesActionsTest-708297345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:22:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9680c9c0-6b0e-409d-9ec5-96fad511f0ab tempest-VolumesActionsTest-708297345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:22:54 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-9680c9c0-6b0e-409d-9ec5-96fad511f0ab tempest-VolumesActionsTest-708297345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:22:54 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-9680c9c0-6b0e-409d-9ec5-96fad511f0ab tempest-VolumesActionsTest-708297345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:22:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9680c9c0-6b0e-409d-9ec5-96fad511f0ab tempest-VolumesActionsTest-708297345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:22:54 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-9680c9c0-6b0e-409d-9ec5-96fad511f0ab tempest-VolumesActionsTest-708297345 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:22:54 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-9680c9c0-6b0e-409d-9ec5-96fad511f0ab tempest-VolumesActionsTest-708297345 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:22:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9680c9c0-6b0e-409d-9ec5-96fad511f0ab tempest-VolumesActionsTest-708297345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bb795bac-7359-4157-9443-de2c1940724e 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:54 devstack sudo[98247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bb795bac-7359-4157-9443-de2c1940724e 1073741824 Aug 31 15:22:54 devstack sudo[98247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:55 devstack sudo[98247]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9680c9c0-6b0e-409d-9ec5-96fad511f0ab tempest-VolumesActionsTest-708297345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bb795bac-7359-4157-9443-de2c1940724e 1073741824" returned: 0 in 0.588s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9680c9c0-6b0e-409d-9ec5-96fad511f0ab tempest-VolumesActionsTest-708297345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bb795bac-7359-4157-9443-de2c1940724e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:55 devstack sudo[98255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bb795bac-7359-4157-9443-de2c1940724e Aug 31 15:22:55 devstack sudo[98255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:55 devstack sudo[98255]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9680c9c0-6b0e-409d-9ec5-96fad511f0ab tempest-VolumesActionsTest-708297345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bb795bac-7359-4157-9443-de2c1940724e" returned: 0 in 0.415s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:55 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-9680c9c0-6b0e-409d-9ec5-96fad511f0ab tempest-VolumesActionsTest-708297345 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:22:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9680c9c0-6b0e-409d-9ec5-96fad511f0ab tempest-VolumesActionsTest-708297345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:22:55 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9680c9c0-6b0e-409d-9ec5-96fad511f0ab tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe150cb3-c1ae-495c-ae23-f1fd1bd15484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb795bac-7359-4157-9443-de2c1940724e', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:22:55 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9680c9c0-6b0e-409d-9ec5-96fad511f0ab tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb500f50-1209-4792-b067-3a1127ba20f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:22:55 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-9680c9c0-6b0e-409d-9ec5-96fad511f0ab tempest-VolumesActionsTest-708297345 None] Volume volume-bb795bac-7359-4157-9443-de2c1940724e (bb795bac-7359-4157-9443-de2c1940724e): created successfully Aug 31 15:22:55 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9680c9c0-6b0e-409d-9ec5-96fad511f0ab tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb500f50-1209-4792-b067-3a1127ba20f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:22:55 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9680c9c0-6b0e-409d-9ec5-96fad511f0ab tempest-VolumesActionsTest-708297345 None] Flow 'volume_create_manager' (e24f08ef-22cc-40db-a1f8-c0f582d6afc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:22:55 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-9680c9c0-6b0e-409d-9ec5-96fad511f0ab tempest-VolumesActionsTest-708297345 None] Created volume successfully. Aug 31 15:22:56 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-4753f82c-2474-482a-9657-ea0dd12eafe6 req-6cf98035-8209-4921-83bb-198619fdc9b0 tempest-TestMinimumBasicScenario-1400906245 None] Terminate volume connection completed successfully. Aug 31 15:22:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-4753f82c-2474-482a-9657-ea0dd12eafe6 req-6cf98035-8209-4921-83bb-198619fdc9b0 tempest-TestMinimumBasicScenario-1400906245 None] Deleting attachment 82b7983c-86d9-4387-83c1-b809a99b9fec. {{(pid=86000) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 31 15:22:57 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-f685de74-2e26-431a-b927-242ffd84c64e tempest-TestMinimumBasicScenario-1400906245 None] Acquiring lock "cinder-d50ea58a-fa72-4c4a-b6ad-82c115f473aa-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:22:57 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-f685de74-2e26-431a-b927-242ffd84c64e tempest-TestMinimumBasicScenario-1400906245 None] Lock "cinder-d50ea58a-fa72-4c4a-b6ad-82c115f473aa-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:22:57 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-bae75955-a6e6-4814-a4f0-c0e9b90ee7d1 tempest-VolumesActionsTest-1524955045 None] Acquiring lock "cinder-bb795bac-7359-4157-9443-de2c1940724e-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:22:57 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-bae75955-a6e6-4814-a4f0-c0e9b90ee7d1 tempest-VolumesActionsTest-1524955045 None] Lock "cinder-bb795bac-7359-4157-9443-de2c1940724e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:22:57 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-f685de74-2e26-431a-b927-242ffd84c64e tempest-TestMinimumBasicScenario-1400906245 None] Acquiring lock "cinder-quobyte-d50ea58a-fa72-4c4a-b6ad-82c115f473aa" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:22:57 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-f685de74-2e26-431a-b927-242ffd84c64e tempest-TestMinimumBasicScenario-1400906245 None] Lock "cinder-quobyte-d50ea58a-fa72-4c4a-b6ad-82c115f473aa" acquired by "delete_volume" :: waited 0.026s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:22:57 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[700fa78d-79bb-4bae-b016-d40451d814e4]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:22:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f685de74-2e26-431a-b927-242ffd84c64e tempest-TestMinimumBasicScenario-1400906245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d50ea58a-fa72-4c4a-b6ad-82c115f473aa {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:57 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-bae75955-a6e6-4814-a4f0-c0e9b90ee7d1 tempest-VolumesActionsTest-1524955045 None] Acquiring lock "cinder-quobyte-bb795bac-7359-4157-9443-de2c1940724e" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:22:57 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-bae75955-a6e6-4814-a4f0-c0e9b90ee7d1 tempest-VolumesActionsTest-1524955045 None] Lock "cinder-quobyte-bb795bac-7359-4157-9443-de2c1940724e" acquired by "delete_volume" :: waited 0.028s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:22:57 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[64772fcd-3465-46a3-975a-fedd1008ebae]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:22:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bae75955-a6e6-4814-a4f0-c0e9b90ee7d1 tempest-VolumesActionsTest-1524955045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bb795bac-7359-4157-9443-de2c1940724e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:57 devstack sudo[98261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d50ea58a-fa72-4c4a-b6ad-82c115f473aa Aug 31 15:22:57 devstack sudo[98261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:57 devstack sudo[98262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bb795bac-7359-4157-9443-de2c1940724e Aug 31 15:22:57 devstack sudo[98262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:57 devstack sudo[98261]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f685de74-2e26-431a-b927-242ffd84c64e tempest-TestMinimumBasicScenario-1400906245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d50ea58a-fa72-4c4a-b6ad-82c115f473aa" returned: 0 in 0.511s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f685de74-2e26-431a-b927-242ffd84c64e tempest-TestMinimumBasicScenario-1400906245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d50ea58a-fa72-4c4a-b6ad-82c115f473aa {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:57 devstack sudo[98262]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bae75955-a6e6-4814-a4f0-c0e9b90ee7d1 tempest-VolumesActionsTest-1524955045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bb795bac-7359-4157-9443-de2c1940724e" returned: 0 in 0.448s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bae75955-a6e6-4814-a4f0-c0e9b90ee7d1 tempest-VolumesActionsTest-1524955045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bb795bac-7359-4157-9443-de2c1940724e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:57 devstack sudo[98271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d50ea58a-fa72-4c4a-b6ad-82c115f473aa Aug 31 15:22:57 devstack sudo[98271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:57 devstack sudo[98273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bb795bac-7359-4157-9443-de2c1940724e Aug 31 15:22:57 devstack sudo[98273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:58 devstack sudo[98271]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f685de74-2e26-431a-b927-242ffd84c64e tempest-TestMinimumBasicScenario-1400906245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d50ea58a-fa72-4c4a-b6ad-82c115f473aa" returned: 0 in 0.315s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:58 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-f685de74-2e26-431a-b927-242ffd84c64e tempest-TestMinimumBasicScenario-1400906245 None] Lock "cinder-quobyte-d50ea58a-fa72-4c4a-b6ad-82c115f473aa" released by "delete_volume" :: held 0.877s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:22:58 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-f685de74-2e26-431a-b927-242ffd84c64e tempest-TestMinimumBasicScenario-1400906245 None] Created reservations ['75cbca6a-cc83-47d2-94cd-28ed81ca6709', 'ccb1a6f8-65e7-450b-a53e-590826c1592b', '866b9f2f-29dc-4bd1-9e8a-0f65426342c9', 'b7460a33-6ad9-4697-8cba-632f1ab08099'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:22:58 devstack sudo[98273]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bae75955-a6e6-4814-a4f0-c0e9b90ee7d1 tempest-VolumesActionsTest-1524955045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bb795bac-7359-4157-9443-de2c1940724e" returned: 0 in 0.388s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:58 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-bae75955-a6e6-4814-a4f0-c0e9b90ee7d1 tempest-VolumesActionsTest-1524955045 None] Lock "cinder-quobyte-bb795bac-7359-4157-9443-de2c1940724e" released by "delete_volume" :: held 0.912s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:22:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f685de74-2e26-431a-b927-242ffd84c64e tempest-TestMinimumBasicScenario-1400906245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:22:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f685de74-2e26-431a-b927-242ffd84c64e tempest-TestMinimumBasicScenario-1400906245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:22:58 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f685de74-2e26-431a-b927-242ffd84c64e tempest-TestMinimumBasicScenario-1400906245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:22:58 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f685de74-2e26-431a-b927-242ffd84c64e tempest-TestMinimumBasicScenario-1400906245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:22:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f685de74-2e26-431a-b927-242ffd84c64e tempest-TestMinimumBasicScenario-1400906245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:22:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f685de74-2e26-431a-b927-242ffd84c64e tempest-TestMinimumBasicScenario-1400906245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:58 devstack sudo[98277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:22:58 devstack sudo[98277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:58 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-bae75955-a6e6-4814-a4f0-c0e9b90ee7d1 tempest-VolumesActionsTest-1524955045 None] Created reservations ['ef611fc9-c825-4900-99db-ec5834c8a5a7', '5d05ee17-1f4b-4ef9-9545-59e55d3af3a7', '932fa361-5f8b-4245-892b-9d66f6aca944', '8c6b3f76-69f1-491f-b01c-8069840f0330'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:22:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bae75955-a6e6-4814-a4f0-c0e9b90ee7d1 tempest-VolumesActionsTest-1524955045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:22:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bae75955-a6e6-4814-a4f0-c0e9b90ee7d1 tempest-VolumesActionsTest-1524955045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:22:58 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-bae75955-a6e6-4814-a4f0-c0e9b90ee7d1 tempest-VolumesActionsTest-1524955045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:22:58 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-bae75955-a6e6-4814-a4f0-c0e9b90ee7d1 tempest-VolumesActionsTest-1524955045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:22:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bae75955-a6e6-4814-a4f0-c0e9b90ee7d1 tempest-VolumesActionsTest-1524955045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:22:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bae75955-a6e6-4814-a4f0-c0e9b90ee7d1 tempest-VolumesActionsTest-1524955045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:22:58 devstack sudo[98279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:22:58 devstack sudo[98279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:22:58 devstack sudo[98277]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f685de74-2e26-431a-b927-242ffd84c64e tempest-TestMinimumBasicScenario-1400906245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.331s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:58 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-f685de74-2e26-431a-b927-242ffd84c64e tempest-TestMinimumBasicScenario-1400906245 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:22:58 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-f685de74-2e26-431a-b927-242ffd84c64e tempest-TestMinimumBasicScenario-1400906245 None] Deleted volume successfully. Aug 31 15:22:58 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-f685de74-2e26-431a-b927-242ffd84c64e tempest-TestMinimumBasicScenario-1400906245 None] Lock "cinder-d50ea58a-fa72-4c4a-b6ad-82c115f473aa-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:22:58 devstack sudo[98279]: pam_unix(sudo:session): session closed for user root Aug 31 15:22:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bae75955-a6e6-4814-a4f0-c0e9b90ee7d1 tempest-VolumesActionsTest-1524955045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.308s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:22:58 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-bae75955-a6e6-4814-a4f0-c0e9b90ee7d1 tempest-VolumesActionsTest-1524955045 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:22:58 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-bae75955-a6e6-4814-a4f0-c0e9b90ee7d1 tempest-VolumesActionsTest-1524955045 None] Deleted volume successfully. Aug 31 15:22:58 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-bae75955-a6e6-4814-a4f0-c0e9b90ee7d1 tempest-VolumesActionsTest-1524955045 None] Lock "cinder-bb795bac-7359-4157-9443-de2c1940724e-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:23:00 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7efbdc5-a6c1-4f7f-8967-040138042ff1 tempest-VolumesActionsTest-708297345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:23:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b7efbdc5-a6c1-4f7f-8967-040138042ff1 tempest-VolumesActionsTest-708297345 None] Flow 'volume_create_manager' (77db6e3b-a3d8-487e-b424-b41e3c91eff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:23:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b7efbdc5-a6c1-4f7f-8967-040138042ff1 tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faf8cea0-9ab9-4ba0-ab13-081e8d2f7347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:23:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b7efbdc5-a6c1-4f7f-8967-040138042ff1 tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faf8cea0-9ab9-4ba0-ab13-081e8d2f7347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:23:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-124214946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd1793d-0bb0-4daa-a2b2-0ae41f41fecb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='330f65e7fa454901ad7aa0d1e12dffad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:23:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:23:00Z,use_quota=True,user_id='d581dbe42c6f484ca29e2108b2fd0d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:23:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b7efbdc5-a6c1-4f7f-8967-040138042ff1 tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c6de6f3-1716-4efb-a17d-7590c8ad4a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:23:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b7efbdc5-a6c1-4f7f-8967-040138042ff1 tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c6de6f3-1716-4efb-a17d-7590c8ad4a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:23:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b7efbdc5-a6c1-4f7f-8967-040138042ff1 tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17b7e74e-ffda-415d-b8f8-b62c6b624fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:23:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b7efbdc5-a6c1-4f7f-8967-040138042ff1 tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17b7e74e-ffda-415d-b8f8-b62c6b624fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bd1793d-0bb0-4daa-a2b2-0ae41f41fecb', 'volume_name': 'volume-6bd1793d-0bb0-4daa-a2b2-0ae41f41fecb', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:23:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b7efbdc5-a6c1-4f7f-8967-040138042ff1 tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00fda851-66a3-4827-ad86-9722d4c7d6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:23:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b7efbdc5-a6c1-4f7f-8967-040138042ff1 tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00fda851-66a3-4827-ad86-9722d4c7d6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:23:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b7efbdc5-a6c1-4f7f-8967-040138042ff1 tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5adf5519-1eeb-4fa9-8a22-ff2dea240da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:23:00 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-b7efbdc5-a6c1-4f7f-8967-040138042ff1 tempest-VolumesActionsTest-708297345 None] Volume 6bd1793d-0bb0-4daa-a2b2-0ae41f41fecb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bd1793d-0bb0-4daa-a2b2-0ae41f41fecb', 'volume_size': 1} Aug 31 15:23:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b7efbdc5-a6c1-4f7f-8967-040138042ff1 tempest-VolumesActionsTest-708297345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:23:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b7efbdc5-a6c1-4f7f-8967-040138042ff1 tempest-VolumesActionsTest-708297345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:23:00 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-b7efbdc5-a6c1-4f7f-8967-040138042ff1 tempest-VolumesActionsTest-708297345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:23:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-124214946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd1793d-0bb0-4daa-a2b2-0ae41f41fecb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='330f65e7fa454901ad7aa0d1e12dffad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:23:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:23:00Z,use_quota=True,user_id='d581dbe42c6f484ca29e2108b2fd0d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:23:00 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-b7efbdc5-a6c1-4f7f-8967-040138042ff1 tempest-VolumesActionsTest-708297345 None] Creating volume 6bd1793d-0bb0-4daa-a2b2-0ae41f41fecb {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:23:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b7efbdc5-a6c1-4f7f-8967-040138042ff1 tempest-VolumesActionsTest-708297345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:23:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b7efbdc5-a6c1-4f7f-8967-040138042ff1 tempest-VolumesActionsTest-708297345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:23:00 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-b7efbdc5-a6c1-4f7f-8967-040138042ff1 tempest-VolumesActionsTest-708297345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:23:00 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-b7efbdc5-a6c1-4f7f-8967-040138042ff1 tempest-VolumesActionsTest-708297345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:23:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b7efbdc5-a6c1-4f7f-8967-040138042ff1 tempest-VolumesActionsTest-708297345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:23:00 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-b7efbdc5-a6c1-4f7f-8967-040138042ff1 tempest-VolumesActionsTest-708297345 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:23:00 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-b7efbdc5-a6c1-4f7f-8967-040138042ff1 tempest-VolumesActionsTest-708297345 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:23:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b7efbdc5-a6c1-4f7f-8967-040138042ff1 tempest-VolumesActionsTest-708297345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6bd1793d-0bb0-4daa-a2b2-0ae41f41fecb 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:23:00 devstack sudo[98305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6bd1793d-0bb0-4daa-a2b2-0ae41f41fecb 1073741824 Aug 31 15:23:00 devstack sudo[98305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:23:01 devstack sudo[98305]: pam_unix(sudo:session): session closed for user root Aug 31 15:23:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b7efbdc5-a6c1-4f7f-8967-040138042ff1 tempest-VolumesActionsTest-708297345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6bd1793d-0bb0-4daa-a2b2-0ae41f41fecb 1073741824" returned: 0 in 0.544s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:23:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b7efbdc5-a6c1-4f7f-8967-040138042ff1 tempest-VolumesActionsTest-708297345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6bd1793d-0bb0-4daa-a2b2-0ae41f41fecb {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:23:01 devstack sudo[98311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6bd1793d-0bb0-4daa-a2b2-0ae41f41fecb Aug 31 15:23:01 devstack sudo[98311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:23:01 devstack sudo[98311]: pam_unix(sudo:session): session closed for user root Aug 31 15:23:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b7efbdc5-a6c1-4f7f-8967-040138042ff1 tempest-VolumesActionsTest-708297345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6bd1793d-0bb0-4daa-a2b2-0ae41f41fecb" returned: 0 in 0.324s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:23:01 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-b7efbdc5-a6c1-4f7f-8967-040138042ff1 tempest-VolumesActionsTest-708297345 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:23:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b7efbdc5-a6c1-4f7f-8967-040138042ff1 tempest-VolumesActionsTest-708297345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:23:01 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b7efbdc5-a6c1-4f7f-8967-040138042ff1 tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5adf5519-1eeb-4fa9-8a22-ff2dea240da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bd1793d-0bb0-4daa-a2b2-0ae41f41fecb', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:23:01 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b7efbdc5-a6c1-4f7f-8967-040138042ff1 tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (301c333c-cdb0-4bf0-8c4b-8536b66dbec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:23:01 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-b7efbdc5-a6c1-4f7f-8967-040138042ff1 tempest-VolumesActionsTest-708297345 None] Volume volume-6bd1793d-0bb0-4daa-a2b2-0ae41f41fecb (6bd1793d-0bb0-4daa-a2b2-0ae41f41fecb): created successfully Aug 31 15:23:01 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b7efbdc5-a6c1-4f7f-8967-040138042ff1 tempest-VolumesActionsTest-708297345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (301c333c-cdb0-4bf0-8c4b-8536b66dbec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:23:01 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b7efbdc5-a6c1-4f7f-8967-040138042ff1 tempest-VolumesActionsTest-708297345 None] Flow 'volume_create_manager' (77db6e3b-a3d8-487e-b424-b41e3c91eff3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:23:01 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-b7efbdc5-a6c1-4f7f-8967-040138042ff1 tempest-VolumesActionsTest-708297345 None] Created volume successfully. Aug 31 15:23:03 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7596faf7-cb4a-4638-a420-0c4fab167c53 tempest-VolumesActionsTest-708297345 None] Acquiring lock "cinder-6bd1793d-0bb0-4daa-a2b2-0ae41f41fecb-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:23:03 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7596faf7-cb4a-4638-a420-0c4fab167c53 tempest-VolumesActionsTest-708297345 None] Lock "cinder-6bd1793d-0bb0-4daa-a2b2-0ae41f41fecb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:23:03 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7596faf7-cb4a-4638-a420-0c4fab167c53 tempest-VolumesActionsTest-708297345 None] Acquiring lock "cinder-quobyte-6bd1793d-0bb0-4daa-a2b2-0ae41f41fecb" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:23:03 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7596faf7-cb4a-4638-a420-0c4fab167c53 tempest-VolumesActionsTest-708297345 None] Lock "cinder-quobyte-6bd1793d-0bb0-4daa-a2b2-0ae41f41fecb" acquired by "delete_volume" :: waited 0.015s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:23:03 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be10d4d-a06c-4a2a-91eb-b66e7e22cb1c]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:23:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7596faf7-cb4a-4638-a420-0c4fab167c53 tempest-VolumesActionsTest-708297345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6bd1793d-0bb0-4daa-a2b2-0ae41f41fecb {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:23:03 devstack sudo[98316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6bd1793d-0bb0-4daa-a2b2-0ae41f41fecb Aug 31 15:23:03 devstack sudo[98316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:23:04 devstack sudo[98316]: pam_unix(sudo:session): session closed for user root Aug 31 15:23:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7596faf7-cb4a-4638-a420-0c4fab167c53 tempest-VolumesActionsTest-708297345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6bd1793d-0bb0-4daa-a2b2-0ae41f41fecb" returned: 0 in 0.709s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:23:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7596faf7-cb4a-4638-a420-0c4fab167c53 tempest-VolumesActionsTest-708297345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6bd1793d-0bb0-4daa-a2b2-0ae41f41fecb {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:23:04 devstack sudo[98322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6bd1793d-0bb0-4daa-a2b2-0ae41f41fecb Aug 31 15:23:04 devstack sudo[98322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:23:04 devstack sudo[98322]: pam_unix(sudo:session): session closed for user root Aug 31 15:23:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7596faf7-cb4a-4638-a420-0c4fab167c53 tempest-VolumesActionsTest-708297345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6bd1793d-0bb0-4daa-a2b2-0ae41f41fecb" returned: 0 in 0.447s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:23:04 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7596faf7-cb4a-4638-a420-0c4fab167c53 tempest-VolumesActionsTest-708297345 None] Lock "cinder-quobyte-6bd1793d-0bb0-4daa-a2b2-0ae41f41fecb" released by "delete_volume" :: held 1.228s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:23:04 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-7596faf7-cb4a-4638-a420-0c4fab167c53 tempest-VolumesActionsTest-708297345 None] Created reservations ['776ef24c-976e-4d46-86ad-8d81fe7f2a32', '54e1bc56-a462-4425-a516-06e2b5d3225d', '51ff2469-e616-4598-ac1f-1db22b0c25a6', '181a13cb-cc94-4795-8679-9e21e681d73c'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:23:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7596faf7-cb4a-4638-a420-0c4fab167c53 tempest-VolumesActionsTest-708297345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:23:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7596faf7-cb4a-4638-a420-0c4fab167c53 tempest-VolumesActionsTest-708297345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:23:04 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-7596faf7-cb4a-4638-a420-0c4fab167c53 tempest-VolumesActionsTest-708297345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:23:04 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-7596faf7-cb4a-4638-a420-0c4fab167c53 tempest-VolumesActionsTest-708297345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:23:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7596faf7-cb4a-4638-a420-0c4fab167c53 tempest-VolumesActionsTest-708297345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:23:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7596faf7-cb4a-4638-a420-0c4fab167c53 tempest-VolumesActionsTest-708297345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:23:04 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec34aa9a-aa0a-430f-9cf1-26835be242bc tempest-TestStampPattern-603172502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:23:04 devstack sudo[98325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:23:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ec34aa9a-aa0a-430f-9cf1-26835be242bc tempest-TestStampPattern-603172502 None] Flow 'volume_create_manager' (a0177c0f-c7b5-4b07-8593-e04bc84762be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:23:04 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:23:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ec34aa9a-aa0a-430f-9cf1-26835be242bc tempest-TestStampPattern-603172502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (293104b5-c34f-4622-8d93-eb091b75d655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:23:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ec34aa9a-aa0a-430f-9cf1-26835be242bc tempest-TestStampPattern-603172502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (293104b5-c34f-4622-8d93-eb091b75d655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-313712774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07bcb2f9-6d26-412e-b676-6aed3a938bde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d7b60fd3c7a4d8a9259deb8af83242b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:23:05Z,use_quota=True,user_id='8ce70d649f59489da2fc780006b7458c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:23:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ec34aa9a-aa0a-430f-9cf1-26835be242bc tempest-TestStampPattern-603172502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40cf5049-5ed6-47b4-b990-4b0cf4b75930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:23:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ec34aa9a-aa0a-430f-9cf1-26835be242bc tempest-TestStampPattern-603172502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40cf5049-5ed6-47b4-b990-4b0cf4b75930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:23:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ec34aa9a-aa0a-430f-9cf1-26835be242bc tempest-TestStampPattern-603172502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fee5bbf-a854-4109-ab33-a0568de5032c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:23:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ec34aa9a-aa0a-430f-9cf1-26835be242bc tempest-TestStampPattern-603172502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fee5bbf-a854-4109-ab33-a0568de5032c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07bcb2f9-6d26-412e-b676-6aed3a938bde', 'volume_name': 'volume-07bcb2f9-6d26-412e-b676-6aed3a938bde', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:23:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ec34aa9a-aa0a-430f-9cf1-26835be242bc tempest-TestStampPattern-603172502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e53800f-96f1-411d-831f-bd3a91101c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:23:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ec34aa9a-aa0a-430f-9cf1-26835be242bc tempest-TestStampPattern-603172502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e53800f-96f1-411d-831f-bd3a91101c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:23:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ec34aa9a-aa0a-430f-9cf1-26835be242bc tempest-TestStampPattern-603172502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (854d65e6-0468-4c06-96cc-10a9c3d0720a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:23:04 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-ec34aa9a-aa0a-430f-9cf1-26835be242bc tempest-TestStampPattern-603172502 None] Volume 07bcb2f9-6d26-412e-b676-6aed3a938bde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07bcb2f9-6d26-412e-b676-6aed3a938bde', 'volume_size': 1} Aug 31 15:23:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ec34aa9a-aa0a-430f-9cf1-26835be242bc tempest-TestStampPattern-603172502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:23:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ec34aa9a-aa0a-430f-9cf1-26835be242bc tempest-TestStampPattern-603172502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:23:04 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-ec34aa9a-aa0a-430f-9cf1-26835be242bc tempest-TestStampPattern-603172502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-313712774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07bcb2f9-6d26-412e-b676-6aed3a938bde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d7b60fd3c7a4d8a9259deb8af83242b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:23:05Z,use_quota=True,user_id='8ce70d649f59489da2fc780006b7458c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:23:04 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-ec34aa9a-aa0a-430f-9cf1-26835be242bc tempest-TestStampPattern-603172502 None] Creating volume 07bcb2f9-6d26-412e-b676-6aed3a938bde {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:23:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ec34aa9a-aa0a-430f-9cf1-26835be242bc tempest-TestStampPattern-603172502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:23:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ec34aa9a-aa0a-430f-9cf1-26835be242bc tempest-TestStampPattern-603172502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:23:04 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-ec34aa9a-aa0a-430f-9cf1-26835be242bc tempest-TestStampPattern-603172502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:23:04 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-ec34aa9a-aa0a-430f-9cf1-26835be242bc tempest-TestStampPattern-603172502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:23:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ec34aa9a-aa0a-430f-9cf1-26835be242bc tempest-TestStampPattern-603172502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:23:04 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-ec34aa9a-aa0a-430f-9cf1-26835be242bc tempest-TestStampPattern-603172502 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:23:04 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-ec34aa9a-aa0a-430f-9cf1-26835be242bc tempest-TestStampPattern-603172502 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:23:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ec34aa9a-aa0a-430f-9cf1-26835be242bc tempest-TestStampPattern-603172502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:23:04 devstack sudo[98327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde 1073741824 Aug 31 15:23:04 devstack sudo[98327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:23:05 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root Aug 31 15:23:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7596faf7-cb4a-4638-a420-0c4fab167c53 tempest-VolumesActionsTest-708297345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.306s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:23:05 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-7596faf7-cb4a-4638-a420-0c4fab167c53 tempest-VolumesActionsTest-708297345 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:23:05 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-7596faf7-cb4a-4638-a420-0c4fab167c53 tempest-VolumesActionsTest-708297345 None] Deleted volume successfully. Aug 31 15:23:05 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7596faf7-cb4a-4638-a420-0c4fab167c53 tempest-VolumesActionsTest-708297345 None] Lock "cinder-6bd1793d-0bb0-4daa-a2b2-0ae41f41fecb-delete_volume" released by "delete_volume" :: held 1.930s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:23:05 devstack sudo[98327]: pam_unix(sudo:session): session closed for user root Aug 31 15:23:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ec34aa9a-aa0a-430f-9cf1-26835be242bc tempest-TestStampPattern-603172502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde 1073741824" returned: 0 in 0.603s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:23:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ec34aa9a-aa0a-430f-9cf1-26835be242bc tempest-TestStampPattern-603172502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:23:05 devstack sudo[98335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde Aug 31 15:23:05 devstack sudo[98335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:23:05 devstack sudo[98335]: pam_unix(sudo:session): session closed for user root Aug 31 15:23:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ec34aa9a-aa0a-430f-9cf1-26835be242bc tempest-TestStampPattern-603172502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde" returned: 0 in 0.320s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:23:05 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-ec34aa9a-aa0a-430f-9cf1-26835be242bc tempest-TestStampPattern-603172502 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:23:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ec34aa9a-aa0a-430f-9cf1-26835be242bc tempest-TestStampPattern-603172502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:23:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ec34aa9a-aa0a-430f-9cf1-26835be242bc tempest-TestStampPattern-603172502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (854d65e6-0468-4c06-96cc-10a9c3d0720a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07bcb2f9-6d26-412e-b676-6aed3a938bde', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:23:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ec34aa9a-aa0a-430f-9cf1-26835be242bc tempest-TestStampPattern-603172502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c42f0799-b098-4e99-840c-58e235897572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:23:05 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-ec34aa9a-aa0a-430f-9cf1-26835be242bc tempest-TestStampPattern-603172502 None] Volume volume-07bcb2f9-6d26-412e-b676-6aed3a938bde (07bcb2f9-6d26-412e-b676-6aed3a938bde): created successfully Aug 31 15:23:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ec34aa9a-aa0a-430f-9cf1-26835be242bc tempest-TestStampPattern-603172502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c42f0799-b098-4e99-840c-58e235897572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:23:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ec34aa9a-aa0a-430f-9cf1-26835be242bc tempest-TestStampPattern-603172502 None] Flow 'volume_create_manager' (a0177c0f-c7b5-4b07-8593-e04bc84762be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:23:05 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-ec34aa9a-aa0a-430f-9cf1-26835be242bc tempest-TestStampPattern-603172502 None] Created volume successfully. Aug 31 15:23:15 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:SELECT=72,cinder:UPDATE=98,cinder:DELETE=8,cinder:INSERT=17 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:23:15 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:SELECT=75,cinder:UPDATE=102,cinder:INSERT=30,cinder:DELETE=9 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:23:22 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-acfbbb73-355e-4914-a523-e28bc193052e tempest-TestInstancesWithCinderVolumes-1668180206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:23:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-acfbbb73-355e-4914-a523-e28bc193052e tempest-TestInstancesWithCinderVolumes-1668180206 None] Flow 'volume_create_manager' (06d45f2e-2543-4f75-98f1-c594aa8a9f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:23:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-acfbbb73-355e-4914-a523-e28bc193052e tempest-TestInstancesWithCinderVolumes-1668180206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83ce6aac-ec30-4e29-ba8f-82cf801e5924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:23:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-acfbbb73-355e-4914-a523-e28bc193052e tempest-TestInstancesWithCinderVolumes-1668180206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83ce6aac-ec30-4e29-ba8f-82cf801e5924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-655174817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e27c5b47-0d09-4a58-bd88-41a34033e923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4218ccd92c445ffa63c942d7c7bc6f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:23:22Z,use_quota=True,user_id='5372329a985e410f8e4ce6017d8a6d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b1c99bb-8aa3-4695-9d44-9d32b4ec35a0),volume_type_id=3b1c99bb-8aa3-4695-9d44-9d32b4ec35a0)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:23:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-acfbbb73-355e-4914-a523-e28bc193052e tempest-TestInstancesWithCinderVolumes-1668180206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (438dc469-ebac-40ed-97b5-8f669e84cfe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:23:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-acfbbb73-355e-4914-a523-e28bc193052e tempest-TestInstancesWithCinderVolumes-1668180206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (438dc469-ebac-40ed-97b5-8f669e84cfe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:23:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-acfbbb73-355e-4914-a523-e28bc193052e tempest-TestInstancesWithCinderVolumes-1668180206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a6d551-e520-4980-88ca-b44414f78a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:23:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-acfbbb73-355e-4914-a523-e28bc193052e tempest-TestInstancesWithCinderVolumes-1668180206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a6d551-e520-4980-88ca-b44414f78a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e27c5b47-0d09-4a58-bd88-41a34033e923', 'volume_name': 'volume-e27c5b47-0d09-4a58-bd88-41a34033e923', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:23:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-acfbbb73-355e-4914-a523-e28bc193052e tempest-TestInstancesWithCinderVolumes-1668180206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf0ccf52-044b-4f90-8fd0-cadb0764f625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:23:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-acfbbb73-355e-4914-a523-e28bc193052e tempest-TestInstancesWithCinderVolumes-1668180206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf0ccf52-044b-4f90-8fd0-cadb0764f625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:23:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-acfbbb73-355e-4914-a523-e28bc193052e tempest-TestInstancesWithCinderVolumes-1668180206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b679b7e-740b-4e77-8252-4793ceaf23f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:23:22 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-acfbbb73-355e-4914-a523-e28bc193052e tempest-TestInstancesWithCinderVolumes-1668180206 None] Volume e27c5b47-0d09-4a58-bd88-41a34033e923: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e27c5b47-0d09-4a58-bd88-41a34033e923', 'volume_size': 1} Aug 31 15:23:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-acfbbb73-355e-4914-a523-e28bc193052e tempest-TestInstancesWithCinderVolumes-1668180206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:23:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-acfbbb73-355e-4914-a523-e28bc193052e tempest-TestInstancesWithCinderVolumes-1668180206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:23:22 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-acfbbb73-355e-4914-a523-e28bc193052e tempest-TestInstancesWithCinderVolumes-1668180206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-655174817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e27c5b47-0d09-4a58-bd88-41a34033e923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4218ccd92c445ffa63c942d7c7bc6f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:23:22Z,use_quota=True,user_id='5372329a985e410f8e4ce6017d8a6d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b1c99bb-8aa3-4695-9d44-9d32b4ec35a0),volume_type_id=3b1c99bb-8aa3-4695-9d44-9d32b4ec35a0)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:23:22 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-acfbbb73-355e-4914-a523-e28bc193052e tempest-TestInstancesWithCinderVolumes-1668180206 None] Creating volume e27c5b47-0d09-4a58-bd88-41a34033e923 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:23:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-acfbbb73-355e-4914-a523-e28bc193052e tempest-TestInstancesWithCinderVolumes-1668180206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:23:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-acfbbb73-355e-4914-a523-e28bc193052e tempest-TestInstancesWithCinderVolumes-1668180206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:23:22 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-acfbbb73-355e-4914-a523-e28bc193052e tempest-TestInstancesWithCinderVolumes-1668180206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:23:22 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-acfbbb73-355e-4914-a523-e28bc193052e tempest-TestInstancesWithCinderVolumes-1668180206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:23:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-acfbbb73-355e-4914-a523-e28bc193052e tempest-TestInstancesWithCinderVolumes-1668180206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:23:22 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-acfbbb73-355e-4914-a523-e28bc193052e tempest-TestInstancesWithCinderVolumes-1668180206 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:23:22 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-acfbbb73-355e-4914-a523-e28bc193052e tempest-TestInstancesWithCinderVolumes-1668180206 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:23:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-acfbbb73-355e-4914-a523-e28bc193052e tempest-TestInstancesWithCinderVolumes-1668180206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e27c5b47-0d09-4a58-bd88-41a34033e923 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:23:22 devstack sudo[98406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e27c5b47-0d09-4a58-bd88-41a34033e923 1073741824 Aug 31 15:23:22 devstack sudo[98406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:23:22 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fabbef9-0ca8-4bde-8126-e397db2b93ae tempest-TestInstancesWithCinderVolumes-1668180206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:23:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8fabbef9-0ca8-4bde-8126-e397db2b93ae tempest-TestInstancesWithCinderVolumes-1668180206 None] Flow 'volume_create_manager' (cb5bb78d-4411-4543-b8e6-a09ee9194c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:23:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8fabbef9-0ca8-4bde-8126-e397db2b93ae tempest-TestInstancesWithCinderVolumes-1668180206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (382ad796-6157-4a30-b286-a60ebbe956a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:23:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8fabbef9-0ca8-4bde-8126-e397db2b93ae tempest-TestInstancesWithCinderVolumes-1668180206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (382ad796-6157-4a30-b286-a60ebbe956a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-747912782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9d6128b-8945-47aa-9eff-7bfa48f35ed2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4218ccd92c445ffa63c942d7c7bc6f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:23:23Z,use_quota=True,user_id='5372329a985e410f8e4ce6017d8a6d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4bf390-b70e-47fd-a72b-606ac5f0775b),volume_type_id=ea4bf390-b70e-47fd-a72b-606ac5f0775b)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:23:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8fabbef9-0ca8-4bde-8126-e397db2b93ae tempest-TestInstancesWithCinderVolumes-1668180206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f10b7ef-c488-4827-8a63-b0139b6d76e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:23:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8fabbef9-0ca8-4bde-8126-e397db2b93ae tempest-TestInstancesWithCinderVolumes-1668180206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f10b7ef-c488-4827-8a63-b0139b6d76e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:23:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8fabbef9-0ca8-4bde-8126-e397db2b93ae tempest-TestInstancesWithCinderVolumes-1668180206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e40acf60-dc6e-4189-9759-e7991788afcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:23:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8fabbef9-0ca8-4bde-8126-e397db2b93ae tempest-TestInstancesWithCinderVolumes-1668180206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e40acf60-dc6e-4189-9759-e7991788afcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9d6128b-8945-47aa-9eff-7bfa48f35ed2', 'volume_name': 'volume-d9d6128b-8945-47aa-9eff-7bfa48f35ed2', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:23:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8fabbef9-0ca8-4bde-8126-e397db2b93ae tempest-TestInstancesWithCinderVolumes-1668180206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f305c9b0-777a-410b-b73a-694610916cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:23:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8fabbef9-0ca8-4bde-8126-e397db2b93ae tempest-TestInstancesWithCinderVolumes-1668180206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f305c9b0-777a-410b-b73a-694610916cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:23:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8fabbef9-0ca8-4bde-8126-e397db2b93ae tempest-TestInstancesWithCinderVolumes-1668180206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9165bfc4-3636-461e-bf62-c3009a5c0d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:23:22 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-8fabbef9-0ca8-4bde-8126-e397db2b93ae tempest-TestInstancesWithCinderVolumes-1668180206 None] Volume d9d6128b-8945-47aa-9eff-7bfa48f35ed2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9d6128b-8945-47aa-9eff-7bfa48f35ed2', 'volume_size': 1} Aug 31 15:23:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8fabbef9-0ca8-4bde-8126-e397db2b93ae tempest-TestInstancesWithCinderVolumes-1668180206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:23:23 devstack sudo[98406]: pam_unix(sudo:session): session closed for user root Aug 31 15:23:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-acfbbb73-355e-4914-a523-e28bc193052e tempest-TestInstancesWithCinderVolumes-1668180206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e27c5b47-0d09-4a58-bd88-41a34033e923 1073741824" returned: 0 in 0.811s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:23:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-acfbbb73-355e-4914-a523-e28bc193052e tempest-TestInstancesWithCinderVolumes-1668180206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e27c5b47-0d09-4a58-bd88-41a34033e923 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:23:23 devstack sudo[98414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e27c5b47-0d09-4a58-bd88-41a34033e923 Aug 31 15:23:23 devstack sudo[98414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:23:23 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:23:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Flow 'volume_create_manager' (30725d24-dfa2-4e39-ade0-beb54a272f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:23:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5798980-53e3-4ea8-8d11-23ffec12ab0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:23:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5798980-53e3-4ea8-8d11-23ffec12ab0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-276490173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d63da34f-7901-41c2-a934-61ea0ad82633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4218ccd92c445ffa63c942d7c7bc6f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:23:23Z,use_quota=True,user_id='5372329a985e410f8e4ce6017d8a6d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f17ba66-93ae-498a-997d-353343b6c1b4),volume_type_id=6f17ba66-93ae-498a-997d-353343b6c1b4)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:23:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdd9f09a-c486-4553-99e6-4b76f3e8b0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:23:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdd9f09a-c486-4553-99e6-4b76f3e8b0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:23:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a1901b4-65a7-43db-acbb-ae887c8238c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:23:23 devstack cinder-volume[86000]: DEBUG cinder.image.glance [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Creating Keystone auth plugin from conf {{(pid=86000) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 31 15:23:23 devstack sudo[98414]: pam_unix(sudo:session): session closed for user root Aug 31 15:23:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-acfbbb73-355e-4914-a523-e28bc193052e tempest-TestInstancesWithCinderVolumes-1668180206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e27c5b47-0d09-4a58-bd88-41a34033e923" returned: 0 in 0.679s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:23:23 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-acfbbb73-355e-4914-a523-e28bc193052e tempest-TestInstancesWithCinderVolumes-1668180206 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:23:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-acfbbb73-355e-4914-a523-e28bc193052e tempest-TestInstancesWithCinderVolumes-1668180206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:23:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8fabbef9-0ca8-4bde-8126-e397db2b93ae tempest-TestInstancesWithCinderVolumes-1668180206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.031s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:23:23 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-8fabbef9-0ca8-4bde-8126-e397db2b93ae tempest-TestInstancesWithCinderVolumes-1668180206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-747912782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9d6128b-8945-47aa-9eff-7bfa48f35ed2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4218ccd92c445ffa63c942d7c7bc6f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:23:23Z,use_quota=True,user_id='5372329a985e410f8e4ce6017d8a6d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea4bf390-b70e-47fd-a72b-606ac5f0775b),volume_type_id=ea4bf390-b70e-47fd-a72b-606ac5f0775b)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:23:23 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-8fabbef9-0ca8-4bde-8126-e397db2b93ae tempest-TestInstancesWithCinderVolumes-1668180206 None] Creating volume d9d6128b-8945-47aa-9eff-7bfa48f35ed2 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:23:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8fabbef9-0ca8-4bde-8126-e397db2b93ae tempest-TestInstancesWithCinderVolumes-1668180206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:23:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8fabbef9-0ca8-4bde-8126-e397db2b93ae tempest-TestInstancesWithCinderVolumes-1668180206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:23:23 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-8fabbef9-0ca8-4bde-8126-e397db2b93ae tempest-TestInstancesWithCinderVolumes-1668180206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:23:23 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-8fabbef9-0ca8-4bde-8126-e397db2b93ae tempest-TestInstancesWithCinderVolumes-1668180206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:23:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8fabbef9-0ca8-4bde-8126-e397db2b93ae tempest-TestInstancesWithCinderVolumes-1668180206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:23:23 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-8fabbef9-0ca8-4bde-8126-e397db2b93ae tempest-TestInstancesWithCinderVolumes-1668180206 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:23:23 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-8fabbef9-0ca8-4bde-8126-e397db2b93ae tempest-TestInstancesWithCinderVolumes-1668180206 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:23:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8fabbef9-0ca8-4bde-8126-e397db2b93ae tempest-TestInstancesWithCinderVolumes-1668180206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d9d6128b-8945-47aa-9eff-7bfa48f35ed2 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:23:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-acfbbb73-355e-4914-a523-e28bc193052e tempest-TestInstancesWithCinderVolumes-1668180206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b679b7e-740b-4e77-8252-4793ceaf23f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e27c5b47-0d09-4a58-bd88-41a34033e923', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:23:23 devstack sudo[98431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d9d6128b-8945-47aa-9eff-7bfa48f35ed2 1073741824 Aug 31 15:23:23 devstack sudo[98431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:23:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-acfbbb73-355e-4914-a523-e28bc193052e tempest-TestInstancesWithCinderVolumes-1668180206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45b80077-aa1e-43f7-bed3-4b4a124f32c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:23:24 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-acfbbb73-355e-4914-a523-e28bc193052e tempest-TestInstancesWithCinderVolumes-1668180206 None] Volume volume-e27c5b47-0d09-4a58-bd88-41a34033e923 (e27c5b47-0d09-4a58-bd88-41a34033e923): created successfully Aug 31 15:23:24 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-acfbbb73-355e-4914-a523-e28bc193052e tempest-TestInstancesWithCinderVolumes-1668180206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45b80077-aa1e-43f7-bed3-4b4a124f32c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:23:24 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-acfbbb73-355e-4914-a523-e28bc193052e tempest-TestInstancesWithCinderVolumes-1668180206 None] Flow 'volume_create_manager' (06d45f2e-2543-4f75-98f1-c594aa8a9f53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:23:24 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-acfbbb73-355e-4914-a523-e28bc193052e tempest-TestInstancesWithCinderVolumes-1668180206 None] Created volume successfully. Aug 31 15:23:24 devstack sudo[98431]: pam_unix(sudo:session): session closed for user root Aug 31 15:23:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8fabbef9-0ca8-4bde-8126-e397db2b93ae tempest-TestInstancesWithCinderVolumes-1668180206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d9d6128b-8945-47aa-9eff-7bfa48f35ed2 1073741824" returned: 0 in 1.021s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:23:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8fabbef9-0ca8-4bde-8126-e397db2b93ae tempest-TestInstancesWithCinderVolumes-1668180206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d9d6128b-8945-47aa-9eff-7bfa48f35ed2 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:23:25 devstack sudo[98488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d9d6128b-8945-47aa-9eff-7bfa48f35ed2 Aug 31 15:23:25 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:23:25 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a1901b4-65a7-43db-acbb-ae887c8238c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd63da34f-7901-41c2-a934-61ea0ad82633', 'volume_name': 'volume-d63da34f-7901-41c2-a934-61ea0ad82633', 'volume_size': 1, 'image_id': '2433c1cd-843c-4496-a8fc-697d03937c9d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2433c1cd-843c-4496-a8fc-697d03937c9d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1324470699', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f4218ccd92c445ffa63c942d7c7bc6f2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2433c1cd-843c-4496-a8fc-697d03937c9d', 'created_at': datetime.datetime(2026, 8, 31, 13, 23, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 13, 23, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2433c1cd-843c-4496-a8fc-697d03937c9d/file', 'properties': {}}, 'image_service': }' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:23:25 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b512f888-0e3d-463d-8da6-4dabc2a735e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:23:25 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b512f888-0e3d-463d-8da6-4dabc2a735e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:23:25 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aba4bcff-13c7-4192-93f0-a75f0c18b12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:23:25 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Volume d63da34f-7901-41c2-a934-61ea0ad82633: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d63da34f-7901-41c2-a934-61ea0ad82633', 'volume_size': 1, 'image_id': '2433c1cd-843c-4496-a8fc-697d03937c9d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2433c1cd-843c-4496-a8fc-697d03937c9d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1324470699', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f4218ccd92c445ffa63c942d7c7bc6f2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2433c1cd-843c-4496-a8fc-697d03937c9d', 'created_at': datetime.datetime(2026, 8, 31, 13, 23, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 13, 23, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2433c1cd-843c-4496-a8fc-697d03937c9d/file', 'properties': {}}, 'image_service': } Aug 31 15:23:25 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Trying to clone d63da34f-7901-41c2-a934-61ea0ad82633 from image 2433c1cd-843c-4496-a8fc-697d03937c9d at location (None, [{'url': 'file:///opt/stack/data/glance/images/2433c1cd-843c-4496-a8fc-697d03937c9d', 'metadata': {}}]). {{(pid=86000) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 31 15:23:25 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root Aug 31 15:23:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8fabbef9-0ca8-4bde-8126-e397db2b93ae tempest-TestInstancesWithCinderVolumes-1668180206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d9d6128b-8945-47aa-9eff-7bfa48f35ed2" returned: 0 in 0.456s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:23:25 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-8fabbef9-0ca8-4bde-8126-e397db2b93ae tempest-TestInstancesWithCinderVolumes-1668180206 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:23:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8fabbef9-0ca8-4bde-8126-e397db2b93ae tempest-TestInstancesWithCinderVolumes-1668180206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:23:25 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8fabbef9-0ca8-4bde-8126-e397db2b93ae tempest-TestInstancesWithCinderVolumes-1668180206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9165bfc4-3636-461e-bf62-c3009a5c0d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9d6128b-8945-47aa-9eff-7bfa48f35ed2', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:23:25 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8fabbef9-0ca8-4bde-8126-e397db2b93ae tempest-TestInstancesWithCinderVolumes-1668180206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c31740d-47f2-4675-a29d-37d513e380a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:23:25 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-8fabbef9-0ca8-4bde-8126-e397db2b93ae tempest-TestInstancesWithCinderVolumes-1668180206 None] Volume volume-d9d6128b-8945-47aa-9eff-7bfa48f35ed2 (d9d6128b-8945-47aa-9eff-7bfa48f35ed2): created successfully Aug 31 15:23:25 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8fabbef9-0ca8-4bde-8126-e397db2b93ae tempest-TestInstancesWithCinderVolumes-1668180206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c31740d-47f2-4675-a29d-37d513e380a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:23:25 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8fabbef9-0ca8-4bde-8126-e397db2b93ae tempest-TestInstancesWithCinderVolumes-1668180206 None] Flow 'volume_create_manager' (cb5bb78d-4411-4543-b8e6-a09ee9194c93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:23:25 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-8fabbef9-0ca8-4bde-8126-e397db2b93ae tempest-TestInstancesWithCinderVolumes-1668180206 None] Created volume successfully. Aug 31 15:23:30 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2433c1cd-843c-4496-a8fc-697d03937c9d_dyosfbg5devstack@QuobyteHD, size 20.69 MB, duration 5.61 sec {{(pid=86000) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 31 15:23:30 devstack cinder-volume[86000]: INFO cinder.image.image_utils [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Image download 20.69 MB at 3.69 MB/s Aug 31 15:23:30 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ae257e-a9fc-4783-8e91-5bd472cf032a]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:23:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2433c1cd-843c-4496-a8fc-697d03937c9d_dyosfbg5devstack@QuobyteHD {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:23:31 devstack sudo[98497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2433c1cd-843c-4496-a8fc-697d03937c9d_dyosfbg5devstack@QuobyteHD Aug 31 15:23:31 devstack sudo[98497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:23:31 devstack sudo[98497]: pam_unix(sudo:session): session closed for user root Aug 31 15:23:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2433c1cd-843c-4496-a8fc-697d03937c9d_dyosfbg5devstack@QuobyteHD" returned: 0 in 0.608s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:23:31 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Temporary image 2433c1cd-843c-4496-a8fc-697d03937c9d is fetched for user 5372329a985e410f8e4ce6017d8a6d6e. {{(pid=86000) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 31 15:23:31 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b31ad2-cc6a-4caa-9cdf-d0ae16f1c9a1]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:23:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2433c1cd-843c-4496-a8fc-697d03937c9d_dyosfbg5devstack@QuobyteHD {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:23:31 devstack sudo[98502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2433c1cd-843c-4496-a8fc-697d03937c9d_dyosfbg5devstack@QuobyteHD Aug 31 15:23:31 devstack sudo[98502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:23:32 devstack sudo[98502]: pam_unix(sudo:session): session closed for user root Aug 31 15:23:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2433c1cd-843c-4496-a8fc-697d03937c9d_dyosfbg5devstack@QuobyteHD" returned: 0 in 0.488s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:23:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:23:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:23:32 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-276490173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d63da34f-7901-41c2-a934-61ea0ad82633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4218ccd92c445ffa63c942d7c7bc6f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:23:23Z,use_quota=True,user_id='5372329a985e410f8e4ce6017d8a6d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f17ba66-93ae-498a-997d-353343b6c1b4),volume_type_id=6f17ba66-93ae-498a-997d-353343b6c1b4)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:23:32 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Creating volume d63da34f-7901-41c2-a934-61ea0ad82633 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:23:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:23:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:23:32 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:23:32 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:23:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:23:32 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:23:32 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:23:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d63da34f-7901-41c2-a934-61ea0ad82633 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:23:32 devstack sudo[98509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d63da34f-7901-41c2-a934-61ea0ad82633 1073741824 Aug 31 15:23:32 devstack sudo[98509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:23:32 devstack sudo[98509]: pam_unix(sudo:session): session closed for user root Aug 31 15:23:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d63da34f-7901-41c2-a934-61ea0ad82633 1073741824" returned: 0 in 0.671s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:23:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d63da34f-7901-41c2-a934-61ea0ad82633 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:23:32 devstack sudo[98516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d63da34f-7901-41c2-a934-61ea0ad82633 Aug 31 15:23:32 devstack sudo[98516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:23:33 devstack sudo[98516]: pam_unix(sudo:session): session closed for user root Aug 31 15:23:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d63da34f-7901-41c2-a934-61ea0ad82633" returned: 0 in 0.326s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:23:33 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:23:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:23:33 devstack cinder-volume[86000]: DEBUG cinder.volume.volume_utils [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Attempting download of 2433c1cd-843c-4496-a8fc-697d03937c9d ((None, [{'url': 'file:///opt/stack/data/glance/images/2433c1cd-843c-4496-a8fc-697d03937c9d', 'metadata': {}}])) to volume d63da34f-7901-41c2-a934-61ea0ad82633. {{(pid=86000) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 31 15:23:33 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69d05e6-f6bb-4f29-af1b-e3b2f158b868]: (4, 'raw') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:23:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2433c1cd-843c-4496-a8fc-697d03937c9d_tyc2q40b {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:23:33 devstack sudo[98519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2433c1cd-843c-4496-a8fc-697d03937c9d_tyc2q40b Aug 31 15:23:33 devstack sudo[98519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:23:34 devstack sudo[98519]: pam_unix(sudo:session): session closed for user root Aug 31 15:23:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2433c1cd-843c-4496-a8fc-697d03937c9d_tyc2q40b" returned: 0 in 0.688s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:23:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2433c1cd-843c-4496-a8fc-697d03937c9d_tyc2q40b {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:23:34 devstack sudo[98523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2433c1cd-843c-4496-a8fc-697d03937c9d_tyc2q40b Aug 31 15:23:34 devstack sudo[98523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:23:34 devstack sudo[98523]: pam_unix(sudo:session): session closed for user root Aug 31 15:23:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2433c1cd-843c-4496-a8fc-697d03937c9d_tyc2q40b" returned: 1 in 0.654s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:23:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2433c1cd-843c-4496-a8fc-697d03937c9d_tyc2q40b' failed. Not Retrying. {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 31 15:23:34 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0684a9c5-352f-4a40-ad20-0d875207cefb]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:23:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2433c1cd-843c-4496-a8fc-697d03937c9d_dyosfbg5devstack@QuobyteHD {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:23:34 devstack sudo[98527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2433c1cd-843c-4496-a8fc-697d03937c9d_dyosfbg5devstack@QuobyteHD Aug 31 15:23:34 devstack sudo[98527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:23:35 devstack sudo[98527]: pam_unix(sudo:session): session closed for user root Aug 31 15:23:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2433c1cd-843c-4496-a8fc-697d03937c9d_dyosfbg5devstack@QuobyteHD" returned: 0 in 0.565s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:23:35 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] 2433c1cd-843c-4496-a8fc-697d03937c9d was qcow2, converting to qcow2 {{(pid=86000) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 31 15:23:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2433c1cd-843c-4496-a8fc-697d03937c9d_dyosfbg5devstack@QuobyteHD /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d63da34f-7901-41c2-a934-61ea0ad82633 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:23:35 devstack sudo[98532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2433c1cd-843c-4496-a8fc-697d03937c9d_dyosfbg5devstack@QuobyteHD /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d63da34f-7901-41c2-a934-61ea0ad82633 Aug 31 15:23:35 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:23:37 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-e123ea14-891b-4148-b4aa-1ae87531f203 tempest-VolumesTransfersTest-1434614232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:23:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e123ea14-891b-4148-b4aa-1ae87531f203 tempest-VolumesTransfersTest-1434614232 None] Flow 'volume_create_manager' (89a55365-1f08-4b49-ab3b-531848eb1bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:23:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e123ea14-891b-4148-b4aa-1ae87531f203 tempest-VolumesTransfersTest-1434614232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83c0a3ad-b799-4c64-9160-df60dbba5856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:23:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e123ea14-891b-4148-b4aa-1ae87531f203 tempest-VolumesTransfersTest-1434614232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83c0a3ad-b799-4c64-9160-df60dbba5856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1526773824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46c75f1d-29a4-4e3f-8e41-52b472f78479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5370cdae5c4c4933b3137d4765f29c86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:23:37Z,use_quota=True,user_id='2db87c428f65474b942342b027f16394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:23:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e123ea14-891b-4148-b4aa-1ae87531f203 tempest-VolumesTransfersTest-1434614232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66aa84db-d619-4787-bc63-d5c3acbce91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:23:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e123ea14-891b-4148-b4aa-1ae87531f203 tempest-VolumesTransfersTest-1434614232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66aa84db-d619-4787-bc63-d5c3acbce91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:23:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e123ea14-891b-4148-b4aa-1ae87531f203 tempest-VolumesTransfersTest-1434614232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac89981b-a4bd-4f28-8fbc-1213d6fb0a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:23:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e123ea14-891b-4148-b4aa-1ae87531f203 tempest-VolumesTransfersTest-1434614232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac89981b-a4bd-4f28-8fbc-1213d6fb0a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46c75f1d-29a4-4e3f-8e41-52b472f78479', 'volume_name': 'volume-46c75f1d-29a4-4e3f-8e41-52b472f78479', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:23:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e123ea14-891b-4148-b4aa-1ae87531f203 tempest-VolumesTransfersTest-1434614232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83dedaad-6fcf-46f9-9422-3cd8974b8bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:23:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e123ea14-891b-4148-b4aa-1ae87531f203 tempest-VolumesTransfersTest-1434614232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83dedaad-6fcf-46f9-9422-3cd8974b8bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:23:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e123ea14-891b-4148-b4aa-1ae87531f203 tempest-VolumesTransfersTest-1434614232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05de1e26-27b0-4f0a-a7c6-180056ae366f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:23:37 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-e123ea14-891b-4148-b4aa-1ae87531f203 tempest-VolumesTransfersTest-1434614232 None] Volume 46c75f1d-29a4-4e3f-8e41-52b472f78479: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46c75f1d-29a4-4e3f-8e41-52b472f78479', 'volume_size': 1} Aug 31 15:23:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e123ea14-891b-4148-b4aa-1ae87531f203 tempest-VolumesTransfersTest-1434614232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:23:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e123ea14-891b-4148-b4aa-1ae87531f203 tempest-VolumesTransfersTest-1434614232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:23:37 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-e123ea14-891b-4148-b4aa-1ae87531f203 tempest-VolumesTransfersTest-1434614232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1526773824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46c75f1d-29a4-4e3f-8e41-52b472f78479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5370cdae5c4c4933b3137d4765f29c86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:23:37Z,use_quota=True,user_id='2db87c428f65474b942342b027f16394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:23:37 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-e123ea14-891b-4148-b4aa-1ae87531f203 tempest-VolumesTransfersTest-1434614232 None] Creating volume 46c75f1d-29a4-4e3f-8e41-52b472f78479 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:23:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e123ea14-891b-4148-b4aa-1ae87531f203 tempest-VolumesTransfersTest-1434614232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:23:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e123ea14-891b-4148-b4aa-1ae87531f203 tempest-VolumesTransfersTest-1434614232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:23:37 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-e123ea14-891b-4148-b4aa-1ae87531f203 tempest-VolumesTransfersTest-1434614232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:23:37 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-e123ea14-891b-4148-b4aa-1ae87531f203 tempest-VolumesTransfersTest-1434614232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:23:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e123ea14-891b-4148-b4aa-1ae87531f203 tempest-VolumesTransfersTest-1434614232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:23:37 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-e123ea14-891b-4148-b4aa-1ae87531f203 tempest-VolumesTransfersTest-1434614232 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:23:37 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-e123ea14-891b-4148-b4aa-1ae87531f203 tempest-VolumesTransfersTest-1434614232 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:23:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e123ea14-891b-4148-b4aa-1ae87531f203 tempest-VolumesTransfersTest-1434614232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-46c75f1d-29a4-4e3f-8e41-52b472f78479 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:23:37 devstack sudo[98546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-46c75f1d-29a4-4e3f-8e41-52b472f78479 1073741824 Aug 31 15:23:37 devstack sudo[98546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:23:37 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root Aug 31 15:23:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2433c1cd-843c-4496-a8fc-697d03937c9d_dyosfbg5devstack@QuobyteHD /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d63da34f-7901-41c2-a934-61ea0ad82633" returned: 0 in 2.390s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:23:37 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2433c1cd-843c-4496-a8fc-697d03937c9d_dyosfbg5devstack@QuobyteHD, size 112.00 MB, duration 2.39 sec, destination /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d63da34f-7901-41c2-a934-61ea0ad82633 {{(pid=86000) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 31 15:23:37 devstack cinder-volume[86000]: INFO cinder.image.image_utils [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Converted 112.00 MB image at 46.84 MB/s Aug 31 15:23:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d63da34f-7901-41c2-a934-61ea0ad82633 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:23:37 devstack sudo[98548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d63da34f-7901-41c2-a934-61ea0ad82633 1G Aug 31 15:23:37 devstack sudo[98548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:23:38 devstack sudo[98546]: pam_unix(sudo:session): session closed for user root Aug 31 15:23:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e123ea14-891b-4148-b4aa-1ae87531f203 tempest-VolumesTransfersTest-1434614232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-46c75f1d-29a4-4e3f-8e41-52b472f78479 1073741824" returned: 0 in 0.718s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:23:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e123ea14-891b-4148-b4aa-1ae87531f203 tempest-VolumesTransfersTest-1434614232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-46c75f1d-29a4-4e3f-8e41-52b472f78479 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:23:38 devstack sudo[98577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-46c75f1d-29a4-4e3f-8e41-52b472f78479 Aug 31 15:23:38 devstack sudo[98577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:23:38 devstack sudo[98548]: pam_unix(sudo:session): session closed for user root Aug 31 15:23:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d63da34f-7901-41c2-a934-61ea0ad82633 1G" returned: 0 in 0.598s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:23:38 devstack cinder-volume[86000]: DEBUG cinder.volume.volume_utils [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Downloaded image 2433c1cd-843c-4496-a8fc-697d03937c9d ((None, [{'url': 'file:///opt/stack/data/glance/images/2433c1cd-843c-4496-a8fc-697d03937c9d', 'metadata': {}}])) to volume d63da34f-7901-41c2-a934-61ea0ad82633 successfully. {{(pid=86000) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 31 15:23:38 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Temporary image 2433c1cd-843c-4496-a8fc-697d03937c9d for user 5372329a985e410f8e4ce6017d8a6d6e is deleted. {{(pid=86000) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 31 15:23:38 devstack cinder-volume[86000]: DEBUG cinder.volume.volume_utils [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Marking volume d63da34f-7901-41c2-a934-61ea0ad82633 as bootable. {{(pid=86000) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 31 15:23:38 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Copying metadata from image 2433c1cd-843c-4496-a8fc-697d03937c9d to d63da34f-7901-41c2-a934-61ea0ad82633. {{(pid=86000) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 31 15:23:38 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Creating volume glance metadata for volume d63da34f-7901-41c2-a934-61ea0ad82633 backed by image 2433c1cd-843c-4496-a8fc-697d03937c9d with: {'image_id': '2433c1cd-843c-4496-a8fc-697d03937c9d', 'image_name': 'tempest-scenario-img--1324470699', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86000) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 31 15:23:38 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aba4bcff-13c7-4192-93f0-a75f0c18b12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d63da34f-7901-41c2-a934-61ea0ad82633', 'volume_size': 1, 'image_id': '2433c1cd-843c-4496-a8fc-697d03937c9d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2433c1cd-843c-4496-a8fc-697d03937c9d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1324470699', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f4218ccd92c445ffa63c942d7c7bc6f2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2433c1cd-843c-4496-a8fc-697d03937c9d', 'created_at': datetime.datetime(2026, 8, 31, 13, 23, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 13, 23, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2433c1cd-843c-4496-a8fc-697d03937c9d/file', 'properties': {}}, 'image_service': }' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:23:38 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c4ead28-ec50-4278-bd64-8417ac08729e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:23:38 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Volume volume-d63da34f-7901-41c2-a934-61ea0ad82633 (d63da34f-7901-41c2-a934-61ea0ad82633): created successfully Aug 31 15:23:38 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c4ead28-ec50-4278-bd64-8417ac08729e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:23:38 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Flow 'volume_create_manager' (30725d24-dfa2-4e39-ade0-beb54a272f18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:23:38 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-8d1084ca-b031-4f5f-8079-f95eaffb0d1c tempest-TestInstancesWithCinderVolumes-1668180206 None] Created volume successfully. Aug 31 15:23:38 devstack sudo[98577]: pam_unix(sudo:session): session closed for user root Aug 31 15:23:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e123ea14-891b-4148-b4aa-1ae87531f203 tempest-VolumesTransfersTest-1434614232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-46c75f1d-29a4-4e3f-8e41-52b472f78479" returned: 0 in 0.348s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:23:38 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-e123ea14-891b-4148-b4aa-1ae87531f203 tempest-VolumesTransfersTest-1434614232 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:23:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e123ea14-891b-4148-b4aa-1ae87531f203 tempest-VolumesTransfersTest-1434614232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:23:38 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e123ea14-891b-4148-b4aa-1ae87531f203 tempest-VolumesTransfersTest-1434614232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05de1e26-27b0-4f0a-a7c6-180056ae366f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46c75f1d-29a4-4e3f-8e41-52b472f78479', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:23:38 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e123ea14-891b-4148-b4aa-1ae87531f203 tempest-VolumesTransfersTest-1434614232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24078547-375a-4e94-9929-d7a430b02b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:23:38 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-e123ea14-891b-4148-b4aa-1ae87531f203 tempest-VolumesTransfersTest-1434614232 None] Volume volume-46c75f1d-29a4-4e3f-8e41-52b472f78479 (46c75f1d-29a4-4e3f-8e41-52b472f78479): created successfully Aug 31 15:23:38 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e123ea14-891b-4148-b4aa-1ae87531f203 tempest-VolumesTransfersTest-1434614232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24078547-375a-4e94-9929-d7a430b02b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:23:38 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e123ea14-891b-4148-b4aa-1ae87531f203 tempest-VolumesTransfersTest-1434614232 None] Flow 'volume_create_manager' (89a55365-1f08-4b49-ab3b-531848eb1bea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:23:38 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-e123ea14-891b-4148-b4aa-1ae87531f203 tempest-VolumesTransfersTest-1434614232 None] Created volume successfully. Aug 31 15:23:40 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-045610d5-0251-48aa-85b1-084c25d0b524 tempest-VolumesTransfersTest-2018384840 None] Transfer volume completed successfully. Aug 31 15:23:40 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7cdb44be-7dea-4737-bec6-4c57f4a7d852 tempest-VolumesTransfersTest-1536509248 None] Acquiring lock "cinder-46c75f1d-29a4-4e3f-8e41-52b472f78479-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:23:40 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7cdb44be-7dea-4737-bec6-4c57f4a7d852 tempest-VolumesTransfersTest-1536509248 None] Lock "cinder-46c75f1d-29a4-4e3f-8e41-52b472f78479-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:23:40 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7cdb44be-7dea-4737-bec6-4c57f4a7d852 tempest-VolumesTransfersTest-1536509248 None] Acquiring lock "cinder-quobyte-46c75f1d-29a4-4e3f-8e41-52b472f78479" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:23:40 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7cdb44be-7dea-4737-bec6-4c57f4a7d852 tempest-VolumesTransfersTest-1536509248 None] Lock "cinder-quobyte-46c75f1d-29a4-4e3f-8e41-52b472f78479" acquired by "delete_volume" :: waited 0.026s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:23:40 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8ff579-8a7f-4f7d-88d9-3460c15c70ea]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:23:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7cdb44be-7dea-4737-bec6-4c57f4a7d852 tempest-VolumesTransfersTest-1536509248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-46c75f1d-29a4-4e3f-8e41-52b472f78479 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:23:41 devstack sudo[98582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-46c75f1d-29a4-4e3f-8e41-52b472f78479 Aug 31 15:23:41 devstack sudo[98582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:23:41 devstack sudo[98582]: pam_unix(sudo:session): session closed for user root Aug 31 15:23:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7cdb44be-7dea-4737-bec6-4c57f4a7d852 tempest-VolumesTransfersTest-1536509248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-46c75f1d-29a4-4e3f-8e41-52b472f78479" returned: 0 in 0.556s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:23:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7cdb44be-7dea-4737-bec6-4c57f4a7d852 tempest-VolumesTransfersTest-1536509248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-46c75f1d-29a4-4e3f-8e41-52b472f78479 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:23:41 devstack sudo[98589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-46c75f1d-29a4-4e3f-8e41-52b472f78479 Aug 31 15:23:41 devstack sudo[98589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:23:41 devstack sudo[98589]: pam_unix(sudo:session): session closed for user root Aug 31 15:23:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7cdb44be-7dea-4737-bec6-4c57f4a7d852 tempest-VolumesTransfersTest-1536509248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-46c75f1d-29a4-4e3f-8e41-52b472f78479" returned: 0 in 0.319s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:23:41 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7cdb44be-7dea-4737-bec6-4c57f4a7d852 tempest-VolumesTransfersTest-1536509248 None] Lock "cinder-quobyte-46c75f1d-29a4-4e3f-8e41-52b472f78479" released by "delete_volume" :: held 0.933s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:23:41 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-7cdb44be-7dea-4737-bec6-4c57f4a7d852 tempest-VolumesTransfersTest-1536509248 None] Created reservations ['ebd75276-253e-402a-8c6d-854796e08d16', 'd7090e7f-04a2-471c-b7c6-eb6075ca337a', '05999786-572e-4636-8af4-d52d88ede844', '2a891802-8b2f-49c1-938c-92779c7b029b'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:23:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7cdb44be-7dea-4737-bec6-4c57f4a7d852 tempest-VolumesTransfersTest-1536509248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:23:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7cdb44be-7dea-4737-bec6-4c57f4a7d852 tempest-VolumesTransfersTest-1536509248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:23:42 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-7cdb44be-7dea-4737-bec6-4c57f4a7d852 tempest-VolumesTransfersTest-1536509248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:23:42 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-7cdb44be-7dea-4737-bec6-4c57f4a7d852 tempest-VolumesTransfersTest-1536509248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:23:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7cdb44be-7dea-4737-bec6-4c57f4a7d852 tempest-VolumesTransfersTest-1536509248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:23:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7cdb44be-7dea-4737-bec6-4c57f4a7d852 tempest-VolumesTransfersTest-1536509248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:23:42 devstack sudo[98592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:23:42 devstack sudo[98592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:23:42 devstack sudo[98592]: pam_unix(sudo:session): session closed for user root Aug 31 15:23:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7cdb44be-7dea-4737-bec6-4c57f4a7d852 tempest-VolumesTransfersTest-1536509248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.252s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:23:42 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-7cdb44be-7dea-4737-bec6-4c57f4a7d852 tempest-VolumesTransfersTest-1536509248 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:23:42 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-7cdb44be-7dea-4737-bec6-4c57f4a7d852 tempest-VolumesTransfersTest-1536509248 None] Deleted volume successfully. Aug 31 15:23:42 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7cdb44be-7dea-4737-bec6-4c57f4a7d852 tempest-VolumesTransfersTest-1536509248 None] Lock "cinder-46c75f1d-29a4-4e3f-8e41-52b472f78479-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:23:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-2741032b-e124-4fe0-b662-0677089841dd req-59f46343-8d82-420f-a12f-f88aee72cb11 tempest-TestInstancesWithCinderVolumes-1668180206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:23:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-2741032b-e124-4fe0-b662-0677089841dd req-59f46343-8d82-420f-a12f-f88aee72cb11 tempest-TestInstancesWithCinderVolumes-1668180206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:23:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-2741032b-e124-4fe0-b662-0677089841dd req-59f46343-8d82-420f-a12f-f88aee72cb11 tempest-TestInstancesWithCinderVolumes-1668180206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:23:43 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-2741032b-e124-4fe0-b662-0677089841dd req-59f46343-8d82-420f-a12f-f88aee72cb11 tempest-TestInstancesWithCinderVolumes-1668180206 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77', 'name': 'volume-d63da34f-7901-41c2-a934-61ea0ad82633', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4f6972d5-8054-43b2-bee1-960a177aa1e0', 'enforce_multipath': True} {{(pid=86000) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 31 15:23:43 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-2741032b-e124-4fe0-b662-0677089841dd req-59f46343-8d82-420f-a12f-f88aee72cb11 tempest-TestInstancesWithCinderVolumes-1668180206 None] attachment_update completed successfully. Aug 31 15:23:44 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4e5759e-548d-459b-adb1-478505b4e320 tempest-VolumesTransfersTest-1434614232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:23:44 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-a4e5759e-548d-459b-adb1-478505b4e320 tempest-VolumesTransfersTest-1434614232 None] Flow 'volume_create_manager' (ebb18454-3516-4e24-8809-424ffc58f173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:23:44 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-a4e5759e-548d-459b-adb1-478505b4e320 tempest-VolumesTransfersTest-1434614232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a68402f2-ed32-4776-bfd3-5bc2212aab5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:23:44 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-a4e5759e-548d-459b-adb1-478505b4e320 tempest-VolumesTransfersTest-1434614232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a68402f2-ed32-4776-bfd3-5bc2212aab5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1632971455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45111c87-ced4-40c5-b798-e61ba730eadc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5370cdae5c4c4933b3137d4765f29c86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:23:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:23:44Z,use_quota=True,user_id='2db87c428f65474b942342b027f16394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:23:44 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-a4e5759e-548d-459b-adb1-478505b4e320 tempest-VolumesTransfersTest-1434614232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05799cb6-707f-47aa-af2f-776eabbc5b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:23:44 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-a4e5759e-548d-459b-adb1-478505b4e320 tempest-VolumesTransfersTest-1434614232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05799cb6-707f-47aa-af2f-776eabbc5b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:23:44 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-a4e5759e-548d-459b-adb1-478505b4e320 tempest-VolumesTransfersTest-1434614232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0098ae4-2193-4c78-9c7a-56e2a209d422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:23:44 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-a4e5759e-548d-459b-adb1-478505b4e320 tempest-VolumesTransfersTest-1434614232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0098ae4-2193-4c78-9c7a-56e2a209d422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45111c87-ced4-40c5-b798-e61ba730eadc', 'volume_name': 'volume-45111c87-ced4-40c5-b798-e61ba730eadc', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:23:44 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-a4e5759e-548d-459b-adb1-478505b4e320 tempest-VolumesTransfersTest-1434614232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86864c46-f29a-4943-964e-5b1780eeec5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:23:44 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-a4e5759e-548d-459b-adb1-478505b4e320 tempest-VolumesTransfersTest-1434614232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86864c46-f29a-4943-964e-5b1780eeec5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:23:44 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-a4e5759e-548d-459b-adb1-478505b4e320 tempest-VolumesTransfersTest-1434614232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0720c63a-ed8b-4314-b819-8610a672330c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:23:44 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-a4e5759e-548d-459b-adb1-478505b4e320 tempest-VolumesTransfersTest-1434614232 None] Volume 45111c87-ced4-40c5-b798-e61ba730eadc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45111c87-ced4-40c5-b798-e61ba730eadc', 'volume_size': 1} Aug 31 15:23:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-a4e5759e-548d-459b-adb1-478505b4e320 tempest-VolumesTransfersTest-1434614232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:23:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-a4e5759e-548d-459b-adb1-478505b4e320 tempest-VolumesTransfersTest-1434614232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:23:44 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-a4e5759e-548d-459b-adb1-478505b4e320 tempest-VolumesTransfersTest-1434614232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1632971455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45111c87-ced4-40c5-b798-e61ba730eadc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5370cdae5c4c4933b3137d4765f29c86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:23:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:23:44Z,use_quota=True,user_id='2db87c428f65474b942342b027f16394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:23:44 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-a4e5759e-548d-459b-adb1-478505b4e320 tempest-VolumesTransfersTest-1434614232 None] Creating volume 45111c87-ced4-40c5-b798-e61ba730eadc {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:23:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-a4e5759e-548d-459b-adb1-478505b4e320 tempest-VolumesTransfersTest-1434614232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:23:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-a4e5759e-548d-459b-adb1-478505b4e320 tempest-VolumesTransfersTest-1434614232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:23:44 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-a4e5759e-548d-459b-adb1-478505b4e320 tempest-VolumesTransfersTest-1434614232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:23:44 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-a4e5759e-548d-459b-adb1-478505b4e320 tempest-VolumesTransfersTest-1434614232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:23:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-a4e5759e-548d-459b-adb1-478505b4e320 tempest-VolumesTransfersTest-1434614232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:23:44 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-a4e5759e-548d-459b-adb1-478505b4e320 tempest-VolumesTransfersTest-1434614232 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:23:44 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-a4e5759e-548d-459b-adb1-478505b4e320 tempest-VolumesTransfersTest-1434614232 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:23:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a4e5759e-548d-459b-adb1-478505b4e320 tempest-VolumesTransfersTest-1434614232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-45111c87-ced4-40c5-b798-e61ba730eadc 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:23:44 devstack sudo[98604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-45111c87-ced4-40c5-b798-e61ba730eadc 1073741824 Aug 31 15:23:44 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:23:44 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root Aug 31 15:23:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a4e5759e-548d-459b-adb1-478505b4e320 tempest-VolumesTransfersTest-1434614232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-45111c87-ced4-40c5-b798-e61ba730eadc 1073741824" returned: 0 in 0.502s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:23:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a4e5759e-548d-459b-adb1-478505b4e320 tempest-VolumesTransfersTest-1434614232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-45111c87-ced4-40c5-b798-e61ba730eadc {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:23:44 devstack sudo[98610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-45111c87-ced4-40c5-b798-e61ba730eadc Aug 31 15:23:44 devstack sudo[98610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:23:45 devstack sudo[98610]: pam_unix(sudo:session): session closed for user root Aug 31 15:23:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a4e5759e-548d-459b-adb1-478505b4e320 tempest-VolumesTransfersTest-1434614232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-45111c87-ced4-40c5-b798-e61ba730eadc" returned: 0 in 0.289s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:23:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-a4e5759e-548d-459b-adb1-478505b4e320 tempest-VolumesTransfersTest-1434614232 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:23:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-a4e5759e-548d-459b-adb1-478505b4e320 tempest-VolumesTransfersTest-1434614232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:23:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-a4e5759e-548d-459b-adb1-478505b4e320 tempest-VolumesTransfersTest-1434614232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0720c63a-ed8b-4314-b819-8610a672330c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45111c87-ced4-40c5-b798-e61ba730eadc', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:23:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-a4e5759e-548d-459b-adb1-478505b4e320 tempest-VolumesTransfersTest-1434614232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d79ea4e0-0cba-4473-89fb-696234e27dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:23:45 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-a4e5759e-548d-459b-adb1-478505b4e320 tempest-VolumesTransfersTest-1434614232 None] Volume volume-45111c87-ced4-40c5-b798-e61ba730eadc (45111c87-ced4-40c5-b798-e61ba730eadc): created successfully Aug 31 15:23:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-a4e5759e-548d-459b-adb1-478505b4e320 tempest-VolumesTransfersTest-1434614232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d79ea4e0-0cba-4473-89fb-696234e27dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:23:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-a4e5759e-548d-459b-adb1-478505b4e320 tempest-VolumesTransfersTest-1434614232 None] Flow 'volume_create_manager' (ebb18454-3516-4e24-8809-424ffc58f173) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:23:45 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-a4e5759e-548d-459b-adb1-478505b4e320 tempest-VolumesTransfersTest-1434614232 None] Created volume successfully. Aug 31 15:23:45 devstack cinder-volume[86000]: DEBUG oslo_service.periodic_task [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86000) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:23:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:23:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:23:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:23:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:23:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:23:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:23:45 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:23:45 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:23:45 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Aug 31 15:23:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.443s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:23:45 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:23:45 devstack cinder-volume[86000]: DEBUG oslo_service.periodic_task [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running periodic task VolumeManager._thread_info {{(pid=86000) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:23:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] thread count: 28 {{(pid=86000) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 31 15:23:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] thread info: [<_MainThread(MainThread, started 137631281086592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86000) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 31 15:23:46 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6d8db852-0c34-4695-9bc2-6853682b53a1 tempest-VolumesTransfersTest-1536509248 None] Acquiring lock "cinder-45111c87-ced4-40c5-b798-e61ba730eadc-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:23:46 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6d8db852-0c34-4695-9bc2-6853682b53a1 tempest-VolumesTransfersTest-1536509248 None] Lock "cinder-45111c87-ced4-40c5-b798-e61ba730eadc-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:23:47 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6d8db852-0c34-4695-9bc2-6853682b53a1 tempest-VolumesTransfersTest-1536509248 None] Acquiring lock "cinder-quobyte-45111c87-ced4-40c5-b798-e61ba730eadc" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:23:47 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6d8db852-0c34-4695-9bc2-6853682b53a1 tempest-VolumesTransfersTest-1536509248 None] Lock "cinder-quobyte-45111c87-ced4-40c5-b798-e61ba730eadc" acquired by "delete_volume" :: waited 0.022s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:23:47 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d847b2-bb49-4771-b330-74bf85764283]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:23:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6d8db852-0c34-4695-9bc2-6853682b53a1 tempest-VolumesTransfersTest-1536509248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-45111c87-ced4-40c5-b798-e61ba730eadc {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:23:47 devstack sudo[99034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-45111c87-ced4-40c5-b798-e61ba730eadc Aug 31 15:23:47 devstack sudo[99034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:23:48 devstack sudo[99034]: pam_unix(sudo:session): session closed for user root Aug 31 15:23:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6d8db852-0c34-4695-9bc2-6853682b53a1 tempest-VolumesTransfersTest-1536509248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-45111c87-ced4-40c5-b798-e61ba730eadc" returned: 0 in 0.974s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:23:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6d8db852-0c34-4695-9bc2-6853682b53a1 tempest-VolumesTransfersTest-1536509248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-45111c87-ced4-40c5-b798-e61ba730eadc {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:23:48 devstack sudo[99068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-45111c87-ced4-40c5-b798-e61ba730eadc Aug 31 15:23:48 devstack sudo[99068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:23:48 devstack sudo[99068]: pam_unix(sudo:session): session closed for user root Aug 31 15:23:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6d8db852-0c34-4695-9bc2-6853682b53a1 tempest-VolumesTransfersTest-1536509248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-45111c87-ced4-40c5-b798-e61ba730eadc" returned: 0 in 0.321s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:23:48 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6d8db852-0c34-4695-9bc2-6853682b53a1 tempest-VolumesTransfersTest-1536509248 None] Lock "cinder-quobyte-45111c87-ced4-40c5-b798-e61ba730eadc" released by "delete_volume" :: held 1.423s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:23:48 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-6d8db852-0c34-4695-9bc2-6853682b53a1 tempest-VolumesTransfersTest-1536509248 None] Created reservations ['c99c94f7-81ca-4f48-9501-4edabf2c3e3e', '4a72396f-1495-414e-9b12-90d3b5c19928', 'e8f2710c-ff0c-4a15-8d17-8d4c2e73b41c', 'e1eac493-becb-4127-80af-055e779ccaaa'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:23:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6d8db852-0c34-4695-9bc2-6853682b53a1 tempest-VolumesTransfersTest-1536509248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:23:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6d8db852-0c34-4695-9bc2-6853682b53a1 tempest-VolumesTransfersTest-1536509248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:23:48 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6d8db852-0c34-4695-9bc2-6853682b53a1 tempest-VolumesTransfersTest-1536509248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:23:48 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6d8db852-0c34-4695-9bc2-6853682b53a1 tempest-VolumesTransfersTest-1536509248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:23:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6d8db852-0c34-4695-9bc2-6853682b53a1 tempest-VolumesTransfersTest-1536509248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:23:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6d8db852-0c34-4695-9bc2-6853682b53a1 tempest-VolumesTransfersTest-1536509248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:23:48 devstack sudo[99074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:23:48 devstack sudo[99074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:23:49 devstack sudo[99074]: pam_unix(sudo:session): session closed for user root Aug 31 15:23:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6d8db852-0c34-4695-9bc2-6853682b53a1 tempest-VolumesTransfersTest-1536509248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.566s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:23:49 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-6d8db852-0c34-4695-9bc2-6853682b53a1 tempest-VolumesTransfersTest-1536509248 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:23:49 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-6d8db852-0c34-4695-9bc2-6853682b53a1 tempest-VolumesTransfersTest-1536509248 None] Deleted volume successfully. Aug 31 15:23:49 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6d8db852-0c34-4695-9bc2-6853682b53a1 tempest-VolumesTransfersTest-1536509248 None] Lock "cinder-45111c87-ced4-40c5-b798-e61ba730eadc-delete_volume" released by "delete_volume" :: held 2.458s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:23:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-d1331c61-1f87-49bb-bd51-ffff34973b6d req-c45b2a22-dc05-4357-a1c1-32e33464a60b tempest-TestStampPattern-603172502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:23:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-d1331c61-1f87-49bb-bd51-ffff34973b6d req-c45b2a22-dc05-4357-a1c1-32e33464a60b tempest-TestStampPattern-603172502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:23:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-d1331c61-1f87-49bb-bd51-ffff34973b6d req-c45b2a22-dc05-4357-a1c1-32e33464a60b tempest-TestStampPattern-603172502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:23:54 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-d1331c61-1f87-49bb-bd51-ffff34973b6d req-c45b2a22-dc05-4357-a1c1-32e33464a60b tempest-TestStampPattern-603172502 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77', 'name': 'volume-07bcb2f9-6d26-412e-b676-6aed3a938bde', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1046c423-381e-4799-af04-3b1d4178445b', 'enforce_multipath': True} {{(pid=86000) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 31 15:23:54 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-d1331c61-1f87-49bb-bd51-ffff34973b6d req-c45b2a22-dc05-4357-a1c1-32e33464a60b tempest-TestStampPattern-603172502 None] attachment_update completed successfully. Aug 31 15:24:01 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-78a178f4-140a-4a71-83f0-501b28e5bb81 req-c033acaa-fea9-449c-b82b-7dccdfc0892a tempest-TestStampPattern-603172502 None] Terminate volume connection completed successfully. Aug 31 15:24:01 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-78a178f4-140a-4a71-83f0-501b28e5bb81 req-c033acaa-fea9-449c-b82b-7dccdfc0892a tempest-TestStampPattern-603172502 None] Deleting attachment 1046c423-381e-4799-af04-3b1d4178445b. {{(pid=86000) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 31 15:24:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-a166b121-a3df-4a06-a41f-ae04ca4fe9a8 tempest-TestStampPattern-603172502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:24:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-a166b121-a3df-4a06-a41f-ae04ca4fe9a8 tempest-TestStampPattern-603172502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:24:02 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-a166b121-a3df-4a06-a41f-ae04ca4fe9a8 tempest-TestStampPattern-603172502 None] Creating offline snapshot a7d8d308-9194-4209-98b2-9d05186dfbf6 of volume 07bcb2f9-6d26-412e-b676-6aed3a938bde {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:24:02 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf517f6-d34f-42ca-9858-1194046ba94b]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:24:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a166b121-a3df-4a06-a41f-ae04ca4fe9a8 tempest-TestStampPattern-603172502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:02 devstack sudo[99125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde Aug 31 15:24:02 devstack sudo[99125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:03 devstack sudo[99125]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a166b121-a3df-4a06-a41f-ae04ca4fe9a8 tempest-TestStampPattern-603172502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde" returned: 0 in 0.957s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a166b121-a3df-4a06-a41f-ae04ca4fe9a8 tempest-TestStampPattern-603172502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde.a7d8d308-9194-4209-98b2-9d05186dfbf6 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:03 devstack sudo[99131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde.a7d8d308-9194-4209-98b2-9d05186dfbf6 1G Aug 31 15:24:03 devstack sudo[99131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:04 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5c45319-bade-424f-894f-55b1c3bced45 tempest-VolumesTransfersV357Test-8368819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:24:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c5c45319-bade-424f-894f-55b1c3bced45 tempest-VolumesTransfersV357Test-8368819 None] Flow 'volume_create_manager' (0ee73cbc-d147-4124-be32-0788517db0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:24:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c5c45319-bade-424f-894f-55b1c3bced45 tempest-VolumesTransfersV357Test-8368819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72cb7c73-82f5-48a1-91a0-184637a1de6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:24:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c5c45319-bade-424f-894f-55b1c3bced45 tempest-VolumesTransfersV357Test-8368819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72cb7c73-82f5-48a1-91a0-184637a1de6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1228465556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d2d4d5e-7585-4ace-945e-de0b1c5ffde8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7213ae704f6b41ba95659e1216b1cab6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:24:04Z,use_quota=True,user_id='68240dbad09e49b4a01c6cdc187ea4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:24:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c5c45319-bade-424f-894f-55b1c3bced45 tempest-VolumesTransfersV357Test-8368819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d54274e8-7981-4680-839e-274316d3e81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:24:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c5c45319-bade-424f-894f-55b1c3bced45 tempest-VolumesTransfersV357Test-8368819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d54274e8-7981-4680-839e-274316d3e81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:24:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c5c45319-bade-424f-894f-55b1c3bced45 tempest-VolumesTransfersV357Test-8368819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f12ba1be-9e46-470f-a1b0-dd605bfa4c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:24:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c5c45319-bade-424f-894f-55b1c3bced45 tempest-VolumesTransfersV357Test-8368819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f12ba1be-9e46-470f-a1b0-dd605bfa4c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d2d4d5e-7585-4ace-945e-de0b1c5ffde8', 'volume_name': 'volume-2d2d4d5e-7585-4ace-945e-de0b1c5ffde8', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:24:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c5c45319-bade-424f-894f-55b1c3bced45 tempest-VolumesTransfersV357Test-8368819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a94b11b-9c3f-491d-9670-13160dfc50a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:24:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c5c45319-bade-424f-894f-55b1c3bced45 tempest-VolumesTransfersV357Test-8368819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a94b11b-9c3f-491d-9670-13160dfc50a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:24:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c5c45319-bade-424f-894f-55b1c3bced45 tempest-VolumesTransfersV357Test-8368819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11f9bf93-49a4-44fc-9eab-6f0862b2e1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:24:04 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-c5c45319-bade-424f-894f-55b1c3bced45 tempest-VolumesTransfersV357Test-8368819 None] Volume 2d2d4d5e-7585-4ace-945e-de0b1c5ffde8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d2d4d5e-7585-4ace-945e-de0b1c5ffde8', 'volume_size': 1} Aug 31 15:24:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c5c45319-bade-424f-894f-55b1c3bced45 tempest-VolumesTransfersV357Test-8368819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:24:04 devstack sudo[99131]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a166b121-a3df-4a06-a41f-ae04ca4fe9a8 tempest-TestStampPattern-603172502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde.a7d8d308-9194-4209-98b2-9d05186dfbf6 1G" returned: 0 in 0.716s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a166b121-a3df-4a06-a41f-ae04ca4fe9a8 tempest-TestStampPattern-603172502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07bcb2f9-6d26-412e-b676-6aed3a938bde -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde.a7d8d308-9194-4209-98b2-9d05186dfbf6 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:04 devstack sudo[99137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07bcb2f9-6d26-412e-b676-6aed3a938bde -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde.a7d8d308-9194-4209-98b2-9d05186dfbf6 Aug 31 15:24:04 devstack sudo[99137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:04 devstack sudo[99137]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a166b121-a3df-4a06-a41f-ae04ca4fe9a8 tempest-TestStampPattern-603172502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07bcb2f9-6d26-412e-b676-6aed3a938bde -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde.a7d8d308-9194-4209-98b2-9d05186dfbf6" returned: 0 in 0.547s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:04 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-a166b121-a3df-4a06-a41f-ae04ca4fe9a8 tempest-TestStampPattern-603172502 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde.a7d8d308-9194-4209-98b2-9d05186dfbf6 is being set with open permissions: ugo+rw Aug 31 15:24:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a166b121-a3df-4a06-a41f-ae04ca4fe9a8 tempest-TestStampPattern-603172502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde.a7d8d308-9194-4209-98b2-9d05186dfbf6 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:04 devstack sudo[99143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde.a7d8d308-9194-4209-98b2-9d05186dfbf6 Aug 31 15:24:04 devstack sudo[99143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:05 devstack sudo[99143]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a166b121-a3df-4a06-a41f-ae04ca4fe9a8 tempest-TestStampPattern-603172502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde.a7d8d308-9194-4209-98b2-9d05186dfbf6" returned: 0 in 0.563s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a166b121-a3df-4a06-a41f-ae04ca4fe9a8 tempest-TestStampPattern-603172502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:05 devstack sudo[99151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde.info Aug 31 15:24:05 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:05 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a166b121-a3df-4a06-a41f-ae04ca4fe9a8 tempest-TestStampPattern-603172502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde.info" returned: 0 in 0.437s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:05 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-a166b121-a3df-4a06-a41f-ae04ca4fe9a8 tempest-TestStampPattern-603172502 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde.info is being set with open permissions: ugo+rw Aug 31 15:24:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a166b121-a3df-4a06-a41f-ae04ca4fe9a8 tempest-TestStampPattern-603172502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:06 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde.info Aug 31 15:24:06 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:06 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a166b121-a3df-4a06-a41f-ae04ca4fe9a8 tempest-TestStampPattern-603172502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde.info" returned: 0 in 0.325s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-a166b121-a3df-4a06-a41f-ae04ca4fe9a8 tempest-TestStampPattern-603172502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.748s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:24:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c5c45319-bade-424f-894f-55b1c3bced45 tempest-VolumesTransfersV357Test-8368819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.166s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:24:06 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c5c45319-bade-424f-894f-55b1c3bced45 tempest-VolumesTransfersV357Test-8368819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1228465556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d2d4d5e-7585-4ace-945e-de0b1c5ffde8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7213ae704f6b41ba95659e1216b1cab6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:24:04Z,use_quota=True,user_id='68240dbad09e49b4a01c6cdc187ea4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:24:06 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-c5c45319-bade-424f-894f-55b1c3bced45 tempest-VolumesTransfersV357Test-8368819 None] Creating volume 2d2d4d5e-7585-4ace-945e-de0b1c5ffde8 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:24:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c5c45319-bade-424f-894f-55b1c3bced45 tempest-VolumesTransfersV357Test-8368819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:24:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c5c45319-bade-424f-894f-55b1c3bced45 tempest-VolumesTransfersV357Test-8368819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:24:06 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c5c45319-bade-424f-894f-55b1c3bced45 tempest-VolumesTransfersV357Test-8368819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:24:06 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c5c45319-bade-424f-894f-55b1c3bced45 tempest-VolumesTransfersV357Test-8368819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:24:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c5c45319-bade-424f-894f-55b1c3bced45 tempest-VolumesTransfersV357Test-8368819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:24:06 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c5c45319-bade-424f-894f-55b1c3bced45 tempest-VolumesTransfersV357Test-8368819 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:24:06 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-c5c45319-bade-424f-894f-55b1c3bced45 tempest-VolumesTransfersV357Test-8368819 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:24:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c5c45319-bade-424f-894f-55b1c3bced45 tempest-VolumesTransfersV357Test-8368819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2d2d4d5e-7585-4ace-945e-de0b1c5ffde8 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:06 devstack sudo[99192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2d2d4d5e-7585-4ace-945e-de0b1c5ffde8 1073741824 Aug 31 15:24:06 devstack sudo[99192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:06 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-a166b121-a3df-4a06-a41f-ae04ca4fe9a8 tempest-TestStampPattern-603172502 None] Create snapshot completed successfully Aug 31 15:24:07 devstack sudo[99192]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c5c45319-bade-424f-894f-55b1c3bced45 tempest-VolumesTransfersV357Test-8368819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2d2d4d5e-7585-4ace-945e-de0b1c5ffde8 1073741824" returned: 0 in 0.856s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c5c45319-bade-424f-894f-55b1c3bced45 tempest-VolumesTransfersV357Test-8368819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2d2d4d5e-7585-4ace-945e-de0b1c5ffde8 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:07 devstack sudo[99208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2d2d4d5e-7585-4ace-945e-de0b1c5ffde8 Aug 31 15:24:07 devstack sudo[99208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:07 devstack sudo[99208]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c5c45319-bade-424f-894f-55b1c3bced45 tempest-VolumesTransfersV357Test-8368819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2d2d4d5e-7585-4ace-945e-de0b1c5ffde8" returned: 0 in 0.307s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:07 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c5c45319-bade-424f-894f-55b1c3bced45 tempest-VolumesTransfersV357Test-8368819 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:24:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c5c45319-bade-424f-894f-55b1c3bced45 tempest-VolumesTransfersV357Test-8368819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:24:07 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c5c45319-bade-424f-894f-55b1c3bced45 tempest-VolumesTransfersV357Test-8368819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11f9bf93-49a4-44fc-9eab-6f0862b2e1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d2d4d5e-7585-4ace-945e-de0b1c5ffde8', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:24:07 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c5c45319-bade-424f-894f-55b1c3bced45 tempest-VolumesTransfersV357Test-8368819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (235ff445-f877-4082-9f8e-b1bfe2a52997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:24:07 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-c5c45319-bade-424f-894f-55b1c3bced45 tempest-VolumesTransfersV357Test-8368819 None] Volume volume-2d2d4d5e-7585-4ace-945e-de0b1c5ffde8 (2d2d4d5e-7585-4ace-945e-de0b1c5ffde8): created successfully Aug 31 15:24:07 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c5c45319-bade-424f-894f-55b1c3bced45 tempest-VolumesTransfersV357Test-8368819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (235ff445-f877-4082-9f8e-b1bfe2a52997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:24:07 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c5c45319-bade-424f-894f-55b1c3bced45 tempest-VolumesTransfersV357Test-8368819 None] Flow 'volume_create_manager' (0ee73cbc-d147-4124-be32-0788517db0e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:24:07 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-c5c45319-bade-424f-894f-55b1c3bced45 tempest-VolumesTransfersV357Test-8368819 None] Created volume successfully. Aug 31 15:24:09 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-b6f51c58-6bc6-4a00-882a-01b0ceb376ec tempest-VolumesTransfersV357Test-1256201468 None] Transfer volume completed successfully. Aug 31 15:24:10 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-59c3eb16-c5c4-42a0-aa28-e854a3a0af71 tempest-VolumesTransfersV357Test-361610892 None] Acquiring lock "cinder-2d2d4d5e-7585-4ace-945e-de0b1c5ffde8-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:24:10 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-59c3eb16-c5c4-42a0-aa28-e854a3a0af71 tempest-VolumesTransfersV357Test-361610892 None] Lock "cinder-2d2d4d5e-7585-4ace-945e-de0b1c5ffde8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:24:10 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-59c3eb16-c5c4-42a0-aa28-e854a3a0af71 tempest-VolumesTransfersV357Test-361610892 None] Acquiring lock "cinder-quobyte-2d2d4d5e-7585-4ace-945e-de0b1c5ffde8" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:24:10 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-59c3eb16-c5c4-42a0-aa28-e854a3a0af71 tempest-VolumesTransfersV357Test-361610892 None] Lock "cinder-quobyte-2d2d4d5e-7585-4ace-945e-de0b1c5ffde8" acquired by "delete_volume" :: waited 0.067s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:24:10 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a709f324-fa45-4726-b7fe-fbe9f691a9a8]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:24:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-59c3eb16-c5c4-42a0-aa28-e854a3a0af71 tempest-VolumesTransfersV357Test-361610892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2d2d4d5e-7585-4ace-945e-de0b1c5ffde8 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:10 devstack sudo[99308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2d2d4d5e-7585-4ace-945e-de0b1c5ffde8 Aug 31 15:24:10 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:11 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-59c3eb16-c5c4-42a0-aa28-e854a3a0af71 tempest-VolumesTransfersV357Test-361610892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2d2d4d5e-7585-4ace-945e-de0b1c5ffde8" returned: 0 in 0.486s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-59c3eb16-c5c4-42a0-aa28-e854a3a0af71 tempest-VolumesTransfersV357Test-361610892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2d2d4d5e-7585-4ace-945e-de0b1c5ffde8 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:11 devstack sudo[99317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2d2d4d5e-7585-4ace-945e-de0b1c5ffde8 Aug 31 15:24:11 devstack sudo[99317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:11 devstack sudo[99317]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-59c3eb16-c5c4-42a0-aa28-e854a3a0af71 tempest-VolumesTransfersV357Test-361610892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2d2d4d5e-7585-4ace-945e-de0b1c5ffde8" returned: 0 in 0.292s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:11 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-59c3eb16-c5c4-42a0-aa28-e854a3a0af71 tempest-VolumesTransfersV357Test-361610892 None] Lock "cinder-quobyte-2d2d4d5e-7585-4ace-945e-de0b1c5ffde8" released by "delete_volume" :: held 0.892s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:24:11 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-59c3eb16-c5c4-42a0-aa28-e854a3a0af71 tempest-VolumesTransfersV357Test-361610892 None] Created reservations ['50931068-6ce9-4c7e-b14d-f99163616cdb', '16658789-a9f5-4f7a-868f-d17e39fcfc32', 'ab0cb56e-e0ed-4754-985b-8f42aff0b8d0', '017de10b-fe13-47b6-8e1c-51a8dee04596'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:24:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-59c3eb16-c5c4-42a0-aa28-e854a3a0af71 tempest-VolumesTransfersV357Test-361610892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:24:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-59c3eb16-c5c4-42a0-aa28-e854a3a0af71 tempest-VolumesTransfersV357Test-361610892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:24:11 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-59c3eb16-c5c4-42a0-aa28-e854a3a0af71 tempest-VolumesTransfersV357Test-361610892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:24:11 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-59c3eb16-c5c4-42a0-aa28-e854a3a0af71 tempest-VolumesTransfersV357Test-361610892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:24:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-59c3eb16-c5c4-42a0-aa28-e854a3a0af71 tempest-VolumesTransfersV357Test-361610892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:24:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-59c3eb16-c5c4-42a0-aa28-e854a3a0af71 tempest-VolumesTransfersV357Test-361610892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:11 devstack sudo[99322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:24:11 devstack sudo[99322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:12 devstack sudo[99322]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-59c3eb16-c5c4-42a0-aa28-e854a3a0af71 tempest-VolumesTransfersV357Test-361610892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.518s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:12 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-59c3eb16-c5c4-42a0-aa28-e854a3a0af71 tempest-VolumesTransfersV357Test-361610892 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:24:12 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-59c3eb16-c5c4-42a0-aa28-e854a3a0af71 tempest-VolumesTransfersV357Test-361610892 None] Deleted volume successfully. Aug 31 15:24:12 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-59c3eb16-c5c4-42a0-aa28-e854a3a0af71 tempest-VolumesTransfersV357Test-361610892 None] Lock "cinder-2d2d4d5e-7585-4ace-945e-de0b1c5ffde8-delete_volume" released by "delete_volume" :: held 1.941s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:24:12 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc674c4f-d375-4995-8a71-7f99dc3ba608 tempest-VolumesTransfersV357Test-8368819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:24:12 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dc674c4f-d375-4995-8a71-7f99dc3ba608 tempest-VolumesTransfersV357Test-8368819 None] Flow 'volume_create_manager' (319a8082-059a-4b4e-9dbd-82f137cd3daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:24:12 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dc674c4f-d375-4995-8a71-7f99dc3ba608 tempest-VolumesTransfersV357Test-8368819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb19e51e-6ac2-4167-b175-1846f5ab1a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:24:12 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dc674c4f-d375-4995-8a71-7f99dc3ba608 tempest-VolumesTransfersV357Test-8368819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb19e51e-6ac2-4167-b175-1846f5ab1a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1932851316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf16f5df-3f3d-4c10-93f1-aca1c47b4519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7213ae704f6b41ba95659e1216b1cab6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:24:13Z,use_quota=True,user_id='68240dbad09e49b4a01c6cdc187ea4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:24:12 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dc674c4f-d375-4995-8a71-7f99dc3ba608 tempest-VolumesTransfersV357Test-8368819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ed8df71-0d9f-4d7b-a7a2-db689ec128b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:24:12 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dc674c4f-d375-4995-8a71-7f99dc3ba608 tempest-VolumesTransfersV357Test-8368819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ed8df71-0d9f-4d7b-a7a2-db689ec128b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:24:12 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dc674c4f-d375-4995-8a71-7f99dc3ba608 tempest-VolumesTransfersV357Test-8368819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b08769c-1ae6-409b-9be0-6faef58509fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:24:12 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dc674c4f-d375-4995-8a71-7f99dc3ba608 tempest-VolumesTransfersV357Test-8368819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b08769c-1ae6-409b-9be0-6faef58509fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf16f5df-3f3d-4c10-93f1-aca1c47b4519', 'volume_name': 'volume-bf16f5df-3f3d-4c10-93f1-aca1c47b4519', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:24:12 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dc674c4f-d375-4995-8a71-7f99dc3ba608 tempest-VolumesTransfersV357Test-8368819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67d62939-8dbc-4ed1-b449-ebc1203cb994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:24:12 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dc674c4f-d375-4995-8a71-7f99dc3ba608 tempest-VolumesTransfersV357Test-8368819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67d62939-8dbc-4ed1-b449-ebc1203cb994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:24:12 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dc674c4f-d375-4995-8a71-7f99dc3ba608 tempest-VolumesTransfersV357Test-8368819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d4c420c-2cfb-4c88-8eab-50197fad2dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:24:12 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-dc674c4f-d375-4995-8a71-7f99dc3ba608 tempest-VolumesTransfersV357Test-8368819 None] Volume bf16f5df-3f3d-4c10-93f1-aca1c47b4519: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf16f5df-3f3d-4c10-93f1-aca1c47b4519', 'volume_size': 1} Aug 31 15:24:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-dc674c4f-d375-4995-8a71-7f99dc3ba608 tempest-VolumesTransfersV357Test-8368819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:24:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-dc674c4f-d375-4995-8a71-7f99dc3ba608 tempest-VolumesTransfersV357Test-8368819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:24:12 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-dc674c4f-d375-4995-8a71-7f99dc3ba608 tempest-VolumesTransfersV357Test-8368819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1932851316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf16f5df-3f3d-4c10-93f1-aca1c47b4519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7213ae704f6b41ba95659e1216b1cab6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:24:13Z,use_quota=True,user_id='68240dbad09e49b4a01c6cdc187ea4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:24:12 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-dc674c4f-d375-4995-8a71-7f99dc3ba608 tempest-VolumesTransfersV357Test-8368819 None] Creating volume bf16f5df-3f3d-4c10-93f1-aca1c47b4519 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:24:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-dc674c4f-d375-4995-8a71-7f99dc3ba608 tempest-VolumesTransfersV357Test-8368819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:24:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-dc674c4f-d375-4995-8a71-7f99dc3ba608 tempest-VolumesTransfersV357Test-8368819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:24:12 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-dc674c4f-d375-4995-8a71-7f99dc3ba608 tempest-VolumesTransfersV357Test-8368819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:24:12 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-dc674c4f-d375-4995-8a71-7f99dc3ba608 tempest-VolumesTransfersV357Test-8368819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:24:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-dc674c4f-d375-4995-8a71-7f99dc3ba608 tempest-VolumesTransfersV357Test-8368819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:24:12 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-dc674c4f-d375-4995-8a71-7f99dc3ba608 tempest-VolumesTransfersV357Test-8368819 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:24:12 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-dc674c4f-d375-4995-8a71-7f99dc3ba608 tempest-VolumesTransfersV357Test-8368819 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:24:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-dc674c4f-d375-4995-8a71-7f99dc3ba608 tempest-VolumesTransfersV357Test-8368819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bf16f5df-3f3d-4c10-93f1-aca1c47b4519 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:12 devstack sudo[99325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bf16f5df-3f3d-4c10-93f1-aca1c47b4519 1073741824 Aug 31 15:24:12 devstack sudo[99325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:13 devstack sudo[99325]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-dc674c4f-d375-4995-8a71-7f99dc3ba608 tempest-VolumesTransfersV357Test-8368819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bf16f5df-3f3d-4c10-93f1-aca1c47b4519 1073741824" returned: 0 in 0.926s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-dc674c4f-d375-4995-8a71-7f99dc3ba608 tempest-VolumesTransfersV357Test-8368819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bf16f5df-3f3d-4c10-93f1-aca1c47b4519 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:14 devstack sudo[99331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bf16f5df-3f3d-4c10-93f1-aca1c47b4519 Aug 31 15:24:14 devstack sudo[99331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:14 devstack sudo[99331]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-dc674c4f-d375-4995-8a71-7f99dc3ba608 tempest-VolumesTransfersV357Test-8368819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bf16f5df-3f3d-4c10-93f1-aca1c47b4519" returned: 0 in 0.581s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:14 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-dc674c4f-d375-4995-8a71-7f99dc3ba608 tempest-VolumesTransfersV357Test-8368819 None] <== create_volume: return (1670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:24:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-dc674c4f-d375-4995-8a71-7f99dc3ba608 tempest-VolumesTransfersV357Test-8368819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:24:14 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dc674c4f-d375-4995-8a71-7f99dc3ba608 tempest-VolumesTransfersV357Test-8368819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d4c420c-2cfb-4c88-8eab-50197fad2dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf16f5df-3f3d-4c10-93f1-aca1c47b4519', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:24:14 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dc674c4f-d375-4995-8a71-7f99dc3ba608 tempest-VolumesTransfersV357Test-8368819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea38e596-8974-47e0-99be-c578aeacdaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:24:14 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-dc674c4f-d375-4995-8a71-7f99dc3ba608 tempest-VolumesTransfersV357Test-8368819 None] Volume volume-bf16f5df-3f3d-4c10-93f1-aca1c47b4519 (bf16f5df-3f3d-4c10-93f1-aca1c47b4519): created successfully Aug 31 15:24:14 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dc674c4f-d375-4995-8a71-7f99dc3ba608 tempest-VolumesTransfersV357Test-8368819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea38e596-8974-47e0-99be-c578aeacdaec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:24:14 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dc674c4f-d375-4995-8a71-7f99dc3ba608 tempest-VolumesTransfersV357Test-8368819 None] Flow 'volume_create_manager' (319a8082-059a-4b4e-9dbd-82f137cd3daf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:24:14 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-dc674c4f-d375-4995-8a71-7f99dc3ba608 tempest-VolumesTransfersV357Test-8368819 None] Created volume successfully. Aug 31 15:24:15 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5a587fa5-a4ff-40f6-8e5d-e3e70307ed6c tempest-VolumesTransfersV357Test-361610892 None] Acquiring lock "cinder-bf16f5df-3f3d-4c10-93f1-aca1c47b4519-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:24:15 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5a587fa5-a4ff-40f6-8e5d-e3e70307ed6c tempest-VolumesTransfersV357Test-361610892 None] Lock "cinder-bf16f5df-3f3d-4c10-93f1-aca1c47b4519-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:24:15 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5a587fa5-a4ff-40f6-8e5d-e3e70307ed6c tempest-VolumesTransfersV357Test-361610892 None] Acquiring lock "cinder-quobyte-bf16f5df-3f3d-4c10-93f1-aca1c47b4519" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:24:15 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5a587fa5-a4ff-40f6-8e5d-e3e70307ed6c tempest-VolumesTransfersV357Test-361610892 None] Lock "cinder-quobyte-bf16f5df-3f3d-4c10-93f1-aca1c47b4519" acquired by "delete_volume" :: waited 0.029s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:24:15 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f93268-3a15-4dc1-8548-e43187fe29df]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:24:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5a587fa5-a4ff-40f6-8e5d-e3e70307ed6c tempest-VolumesTransfersV357Test-361610892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bf16f5df-3f3d-4c10-93f1-aca1c47b4519 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:16 devstack sudo[99345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bf16f5df-3f3d-4c10-93f1-aca1c47b4519 Aug 31 15:24:16 devstack sudo[99345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:16 devstack sudo[99345]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5a587fa5-a4ff-40f6-8e5d-e3e70307ed6c tempest-VolumesTransfersV357Test-361610892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bf16f5df-3f3d-4c10-93f1-aca1c47b4519" returned: 0 in 0.732s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5a587fa5-a4ff-40f6-8e5d-e3e70307ed6c tempest-VolumesTransfersV357Test-361610892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bf16f5df-3f3d-4c10-93f1-aca1c47b4519 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:16 devstack sudo[99355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bf16f5df-3f3d-4c10-93f1-aca1c47b4519 Aug 31 15:24:16 devstack sudo[99355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:16 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:UPDATE=56,cinder:SELECT=58,cinder:DELETE=6,cinder:INSERT=12 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:SELECT=52,cinder:UPDATE=49,cinder:INSERT=17,cinder:DELETE=5 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Flow 'volume_create_manager' (8140d923-1570-42d0-9783-8f55f94f330d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:24:17 devstack sudo[99355]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a9b6a41-9c61-428f-8f09-99c8806381b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5a587fa5-a4ff-40f6-8e5d-e3e70307ed6c tempest-VolumesTransfersV357Test-361610892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bf16f5df-3f3d-4c10-93f1-aca1c47b4519" returned: 0 in 0.568s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a9b6a41-9c61-428f-8f09-99c8806381b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:24:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1570375260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db8e488e-99c5-40ab-95bf-1a4bdddfd245,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d7b60fd3c7a4d8a9259deb8af83242b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a7d8d308-9194-4209-98b2-9d05186dfbf6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:24:17Z,use_quota=True,user_id='8ce70d649f59489da2fc780006b7458c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb49883-3ee8-492d-a4c5-a0f35a630de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb49883-3ee8-492d-a4c5-a0f35a630de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (576bc655-b7f8-4678-91ed-22bb11f36d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (576bc655-b7f8-4678-91ed-22bb11f36d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'db8e488e-99c5-40ab-95bf-1a4bdddfd245', 'volume_name': 'volume-db8e488e-99c5-40ab-95bf-1a4bdddfd245', 'volume_size': 1, 'snapshot_id': 'a7d8d308-9194-4209-98b2-9d05186dfbf6'}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (202c9bbe-fd25-46b5-bab0-b8390322cc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (202c9bbe-fd25-46b5-bab0-b8390322cc1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (367a0553-89eb-4883-8acb-cc14b3e6b28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:24:17 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Volume db8e488e-99c5-40ab-95bf-1a4bdddfd245: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-db8e488e-99c5-40ab-95bf-1a4bdddfd245', 'volume_size': 1, 'snapshot_id': 'a7d8d308-9194-4209-98b2-9d05186dfbf6'} Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5a587fa5-a4ff-40f6-8e5d-e3e70307ed6c tempest-VolumesTransfersV357Test-361610892 None] Lock "cinder-quobyte-bf16f5df-3f3d-4c10-93f1-aca1c47b4519" released by "delete_volume" :: held 1.503s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Acquiring lock "cinder-quobyte-a7d8d308-9194-4209-98b2-9d05186dfbf6-db8e488e-99c5-40ab-95bf-1a4bdddfd245" by "_create_volume_from_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Lock "cinder-quobyte-a7d8d308-9194-4209-98b2-9d05186dfbf6-db8e488e-99c5-40ab-95bf-1a4bdddfd245" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Creating volume db8e488e-99c5-40ab-95bf-1a4bdddfd245 from snapshot a7d8d308-9194-4209-98b2-9d05186dfbf6 {{(pid=86000) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Acquiring lock "cinder-quobyte-db8e488e-99c5-40ab-95bf-1a4bdddfd245" by "_copy_volume_from_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Lock "cinder-quobyte-db8e488e-99c5-40ab-95bf-1a4bdddfd245" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] snapshot: a7d8d308-9194-4209-98b2-9d05186dfbf6, volume: db8e488e-99c5-40ab-95bf-1a4bdddfd245, {{(pid=86000) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb33c9e8-b8aa-4918-943a-ebb2a2a0bf23]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde.a7d8d308-9194-4209-98b2-9d05186dfbf6 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-fe6add67-80da-4f76-80df-aed1cd267ea6 req-caee1523-9ea6-4d2a-a9a6-9dbae3f64f3a tempest-TestInstancesWithCinderVolumes-1668180206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-5a587fa5-a4ff-40f6-8e5d-e3e70307ed6c tempest-VolumesTransfersV357Test-361610892 None] Created reservations ['a620da6a-bace-4578-8e1d-129a60683db9', '61e8a589-c1b0-40d2-8437-968fe4195a8d', '9cf6312a-cdca-4d7b-b228-601d2cd4a751', '10afde77-86b0-482a-a2cc-581480faeb97'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:24:17 devstack sudo[99366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde.a7d8d308-9194-4209-98b2-9d05186dfbf6 Aug 31 15:24:17 devstack sudo[99366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5a587fa5-a4ff-40f6-8e5d-e3e70307ed6c tempest-VolumesTransfersV357Test-361610892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5a587fa5-a4ff-40f6-8e5d-e3e70307ed6c tempest-VolumesTransfersV357Test-361610892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5a587fa5-a4ff-40f6-8e5d-e3e70307ed6c tempest-VolumesTransfersV357Test-361610892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5a587fa5-a4ff-40f6-8e5d-e3e70307ed6c tempest-VolumesTransfersV357Test-361610892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5a587fa5-a4ff-40f6-8e5d-e3e70307ed6c tempest-VolumesTransfersV357Test-361610892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5a587fa5-a4ff-40f6-8e5d-e3e70307ed6c tempest-VolumesTransfersV357Test-361610892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:17 devstack sudo[99368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:24:17 devstack sudo[99368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:17 devstack sudo[99366]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde.a7d8d308-9194-4209-98b2-9d05186dfbf6" returned: 0 in 0.419s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07bcb2f9-6d26-412e-b676-6aed3a938bde(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d489d9-3be2-497a-8094-7668e857468f]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:17 devstack sudo[99368]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5a587fa5-a4ff-40f6-8e5d-e3e70307ed6c tempest-VolumesTransfersV357Test-361610892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.313s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-5a587fa5-a4ff-40f6-8e5d-e3e70307ed6c tempest-VolumesTransfersV357Test-361610892 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:24:17 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-5a587fa5-a4ff-40f6-8e5d-e3e70307ed6c tempest-VolumesTransfersV357Test-361610892 None] Deleted volume successfully. Aug 31 15:24:17 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5a587fa5-a4ff-40f6-8e5d-e3e70307ed6c tempest-VolumesTransfersV357Test-361610892 None] Lock "cinder-bf16f5df-3f3d-4c10-93f1-aca1c47b4519-delete_volume" released by "delete_volume" :: held 2.261s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:24:17 devstack sudo[99375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde Aug 31 15:24:17 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:18 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde" returned: 0 in 0.586s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:18 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde {{(pid=86000) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 31 15:24:18 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Creating direct copy from snapshot {{(pid=86000) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 31 15:24:18 devstack cinder-volume[86000]: DEBUG cinder.utils [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Path /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-db8e488e-99c5-40ab-95bf-1a4bdddfd245 not found in is_blk_device check {{(pid=86000) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 31 15:24:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-db8e488e-99c5-40ab-95bf-1a4bdddfd245 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:18 devstack sudo[99383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-db8e488e-99c5-40ab-95bf-1a4bdddfd245 Aug 31 15:24:18 devstack sudo[99383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:27 devstack sudo[99383]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-db8e488e-99c5-40ab-95bf-1a4bdddfd245" returned: 0 in 8.718s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:27 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde, size 1024.00 MB, duration 8.72 sec, destination /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-db8e488e-99c5-40ab-95bf-1a4bdddfd245 {{(pid=86000) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 31 15:24:27 devstack cinder-volume[86000]: INFO cinder.image.image_utils [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Converted 1024.00 MB image at 117.44 MB/s Aug 31 15:24:27 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-db8e488e-99c5-40ab-95bf-1a4bdddfd245 is being set with open permissions: ugo+rw Aug 31 15:24:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-db8e488e-99c5-40ab-95bf-1a4bdddfd245 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:27 devstack sudo[99463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-db8e488e-99c5-40ab-95bf-1a4bdddfd245 Aug 31 15:24:27 devstack sudo[99463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:27 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=10 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:24:27 devstack sudo[99463]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-db8e488e-99c5-40ab-95bf-1a4bdddfd245" returned: 0 in 0.450s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:27 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Lock "cinder-quobyte-db8e488e-99c5-40ab-95bf-1a4bdddfd245" released by "_copy_volume_from_snapshot" :: held 10.290s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:24:27 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Lock "cinder-quobyte-a7d8d308-9194-4209-98b2-9d05186dfbf6-db8e488e-99c5-40ab-95bf-1a4bdddfd245" released by "_create_volume_from_snapshot" :: held 10.373s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:24:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.405s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:24:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-fe6add67-80da-4f76-80df-aed1cd267ea6 req-caee1523-9ea6-4d2a-a9a6-9dbae3f64f3a tempest-TestInstancesWithCinderVolumes-1668180206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.235s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:24:27 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (367a0553-89eb-4883-8acb-cc14b3e6b28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db8e488e-99c5-40ab-95bf-1a4bdddfd245', 'volume_size': 1, 'snapshot_id': 'a7d8d308-9194-4209-98b2-9d05186dfbf6'}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:24:27 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7acaa7d0-d0b7-478f-ab34-aa16b9a1cf9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:24:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-fe6add67-80da-4f76-80df-aed1cd267ea6 req-caee1523-9ea6-4d2a-a9a6-9dbae3f64f3a tempest-TestInstancesWithCinderVolumes-1668180206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.058s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:24:27 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Volume volume-db8e488e-99c5-40ab-95bf-1a4bdddfd245 (db8e488e-99c5-40ab-95bf-1a4bdddfd245): created successfully Aug 31 15:24:27 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7acaa7d0-d0b7-478f-ab34-aa16b9a1cf9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:24:27 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Flow 'volume_create_manager' (8140d923-1570-42d0-9783-8f55f94f330d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:24:27 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-fe6add67-80da-4f76-80df-aed1cd267ea6 req-caee1523-9ea6-4d2a-a9a6-9dbae3f64f3a tempest-TestInstancesWithCinderVolumes-1668180206 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77', 'name': 'volume-e27c5b47-0d09-4a58-bd88-41a34033e923', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cbf6dd86-0553-4cf5-bea4-d089994d5a36', 'enforce_multipath': True} {{(pid=86000) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 31 15:24:27 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-ed14ffd2-1767-4860-89c7-c47d06b3b94f tempest-TestStampPattern-603172502 None] Created volume successfully. Aug 31 15:24:27 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-fe6add67-80da-4f76-80df-aed1cd267ea6 req-caee1523-9ea6-4d2a-a9a6-9dbae3f64f3a tempest-TestInstancesWithCinderVolumes-1668180206 None] attachment_update completed successfully. Aug 31 15:24:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-7cdf7aed-95c1-4961-804a-e9a7426b85c2 req-dadd2b29-eb32-4398-afb3-b4dde79e9e48 tempest-TestInstancesWithCinderVolumes-1668180206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:24:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-7cdf7aed-95c1-4961-804a-e9a7426b85c2 req-dadd2b29-eb32-4398-afb3-b4dde79e9e48 tempest-TestInstancesWithCinderVolumes-1668180206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:24:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-7cdf7aed-95c1-4961-804a-e9a7426b85c2 req-dadd2b29-eb32-4398-afb3-b4dde79e9e48 tempest-TestInstancesWithCinderVolumes-1668180206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:24:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-7cdf7aed-95c1-4961-804a-e9a7426b85c2 req-dadd2b29-eb32-4398-afb3-b4dde79e9e48 tempest-TestInstancesWithCinderVolumes-1668180206 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77', 'name': 'volume-d9d6128b-8945-47aa-9eff-7bfa48f35ed2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3d007670-7a27-4578-8dda-a93f7b683e20', 'enforce_multipath': True} {{(pid=86000) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 31 15:24:31 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-7cdf7aed-95c1-4961-804a-e9a7426b85c2 req-dadd2b29-eb32-4398-afb3-b4dde79e9e48 tempest-TestInstancesWithCinderVolumes-1668180206 None] attachment_update completed successfully. Aug 31 15:24:32 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-51a84ddf-54d3-4b3a-8580-6fb9cf0ef91a tempest-VolumesCloneTest-1482626770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:24:32 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-51a84ddf-54d3-4b3a-8580-6fb9cf0ef91a tempest-VolumesCloneTest-1482626770 None] Flow 'volume_create_manager' (4ca72648-5d59-41cd-a346-7a1e720799bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:24:32 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-51a84ddf-54d3-4b3a-8580-6fb9cf0ef91a tempest-VolumesCloneTest-1482626770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c75d0a8c-6966-4052-a130-770cb1487f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:24:32 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-51a84ddf-54d3-4b3a-8580-6fb9cf0ef91a tempest-VolumesCloneTest-1482626770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c75d0a8c-6966-4052-a130-770cb1487f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1218763962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80346d41-c5cf-46b6-a6cb-8afb88814abe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ffbb7625f84954848db02812f71249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:24:32Z,use_quota=True,user_id='19d967e47f8043d99fada31ab7c51ae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:24:32 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-51a84ddf-54d3-4b3a-8580-6fb9cf0ef91a tempest-VolumesCloneTest-1482626770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b8585c2-3ec2-43c9-90d6-0fb6506f7037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:24:32 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-51a84ddf-54d3-4b3a-8580-6fb9cf0ef91a tempest-VolumesCloneTest-1482626770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b8585c2-3ec2-43c9-90d6-0fb6506f7037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:24:32 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-51a84ddf-54d3-4b3a-8580-6fb9cf0ef91a tempest-VolumesCloneTest-1482626770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5aff0f5-93af-4936-96c0-535176c4032f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:24:32 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-51a84ddf-54d3-4b3a-8580-6fb9cf0ef91a tempest-VolumesCloneTest-1482626770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5aff0f5-93af-4936-96c0-535176c4032f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80346d41-c5cf-46b6-a6cb-8afb88814abe', 'volume_name': 'volume-80346d41-c5cf-46b6-a6cb-8afb88814abe', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:24:32 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-51a84ddf-54d3-4b3a-8580-6fb9cf0ef91a tempest-VolumesCloneTest-1482626770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (989d63d8-bf9a-437e-869c-a20e699f8014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:24:32 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-51a84ddf-54d3-4b3a-8580-6fb9cf0ef91a tempest-VolumesCloneTest-1482626770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (989d63d8-bf9a-437e-869c-a20e699f8014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:24:32 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-51a84ddf-54d3-4b3a-8580-6fb9cf0ef91a tempest-VolumesCloneTest-1482626770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7a9fdaf-7b14-442e-9d19-b55f8f81128f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:24:32 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-51a84ddf-54d3-4b3a-8580-6fb9cf0ef91a tempest-VolumesCloneTest-1482626770 None] Volume 80346d41-c5cf-46b6-a6cb-8afb88814abe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80346d41-c5cf-46b6-a6cb-8afb88814abe', 'volume_size': 1} Aug 31 15:24:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-51a84ddf-54d3-4b3a-8580-6fb9cf0ef91a tempest-VolumesCloneTest-1482626770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:24:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-51a84ddf-54d3-4b3a-8580-6fb9cf0ef91a tempest-VolumesCloneTest-1482626770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:24:32 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-51a84ddf-54d3-4b3a-8580-6fb9cf0ef91a tempest-VolumesCloneTest-1482626770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1218763962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80346d41-c5cf-46b6-a6cb-8afb88814abe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ffbb7625f84954848db02812f71249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:24:32Z,use_quota=True,user_id='19d967e47f8043d99fada31ab7c51ae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:24:32 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-51a84ddf-54d3-4b3a-8580-6fb9cf0ef91a tempest-VolumesCloneTest-1482626770 None] Creating volume 80346d41-c5cf-46b6-a6cb-8afb88814abe {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:24:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-51a84ddf-54d3-4b3a-8580-6fb9cf0ef91a tempest-VolumesCloneTest-1482626770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:24:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-51a84ddf-54d3-4b3a-8580-6fb9cf0ef91a tempest-VolumesCloneTest-1482626770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:24:32 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-51a84ddf-54d3-4b3a-8580-6fb9cf0ef91a tempest-VolumesCloneTest-1482626770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:24:32 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-51a84ddf-54d3-4b3a-8580-6fb9cf0ef91a tempest-VolumesCloneTest-1482626770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:24:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-51a84ddf-54d3-4b3a-8580-6fb9cf0ef91a tempest-VolumesCloneTest-1482626770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:24:32 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-51a84ddf-54d3-4b3a-8580-6fb9cf0ef91a tempest-VolumesCloneTest-1482626770 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:24:32 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-51a84ddf-54d3-4b3a-8580-6fb9cf0ef91a tempest-VolumesCloneTest-1482626770 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:24:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-51a84ddf-54d3-4b3a-8580-6fb9cf0ef91a tempest-VolumesCloneTest-1482626770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:32 devstack sudo[99555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe 1073741824 Aug 31 15:24:32 devstack sudo[99555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:32 devstack sudo[99555]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-51a84ddf-54d3-4b3a-8580-6fb9cf0ef91a tempest-VolumesCloneTest-1482626770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe 1073741824" returned: 0 in 0.602s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-51a84ddf-54d3-4b3a-8580-6fb9cf0ef91a tempest-VolumesCloneTest-1482626770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:32 devstack sudo[99563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe Aug 31 15:24:32 devstack sudo[99563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:33 devstack sudo[99563]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-51a84ddf-54d3-4b3a-8580-6fb9cf0ef91a tempest-VolumesCloneTest-1482626770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe" returned: 0 in 0.363s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:33 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-51a84ddf-54d3-4b3a-8580-6fb9cf0ef91a tempest-VolumesCloneTest-1482626770 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:24:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-51a84ddf-54d3-4b3a-8580-6fb9cf0ef91a tempest-VolumesCloneTest-1482626770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:24:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-51a84ddf-54d3-4b3a-8580-6fb9cf0ef91a tempest-VolumesCloneTest-1482626770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7a9fdaf-7b14-442e-9d19-b55f8f81128f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80346d41-c5cf-46b6-a6cb-8afb88814abe', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:24:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-51a84ddf-54d3-4b3a-8580-6fb9cf0ef91a tempest-VolumesCloneTest-1482626770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c977817-fa14-4d7c-a3f5-31868107cc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:24:33 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-51a84ddf-54d3-4b3a-8580-6fb9cf0ef91a tempest-VolumesCloneTest-1482626770 None] Volume volume-80346d41-c5cf-46b6-a6cb-8afb88814abe (80346d41-c5cf-46b6-a6cb-8afb88814abe): created successfully Aug 31 15:24:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-51a84ddf-54d3-4b3a-8580-6fb9cf0ef91a tempest-VolumesCloneTest-1482626770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c977817-fa14-4d7c-a3f5-31868107cc7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:24:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-51a84ddf-54d3-4b3a-8580-6fb9cf0ef91a tempest-VolumesCloneTest-1482626770 None] Flow 'volume_create_manager' (4ca72648-5d59-41cd-a346-7a1e720799bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:24:33 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-51a84ddf-54d3-4b3a-8580-6fb9cf0ef91a tempest-VolumesCloneTest-1482626770 None] Created volume successfully. Aug 31 15:24:34 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:24:34 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Flow 'volume_create_manager' (fad85f66-5827-4463-9eeb-abdb96d49e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:24:34 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfd3ae76-bf37-4f58-a55c-952b9d3c4ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:24:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfd3ae76-bf37-4f58-a55c-952b9d3c4ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2131144802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4043bd1-5cda-4e46-9a8c-be988e5ccf63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ffbb7625f84954848db02812f71249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:24:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=80346d41-c5cf-46b6-a6cb-8afb88814abe,status='creating',terminated_at=None,updated_at=2026-08-31T13:24:35Z,use_quota=True,user_id='19d967e47f8043d99fada31ab7c51ae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:24:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5830db3-b37c-44f1-8c9d-5fa72c99592b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:24:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5830db3-b37c-44f1-8c9d-5fa72c99592b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:24:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b874996-3085-4a8e-a40b-7812eac77f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:24:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b874996-3085-4a8e-a40b-7812eac77f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f4043bd1-5cda-4e46-9a8c-be988e5ccf63', 'volume_name': 'volume-f4043bd1-5cda-4e46-9a8c-be988e5ccf63', 'volume_size': 2, 'source_volid': '80346d41-c5cf-46b6-a6cb-8afb88814abe', 'source_volstatus': 'available'}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:24:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (270572d0-c1af-4dfc-b860-cb38fdf4426d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:24:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (270572d0-c1af-4dfc-b860-cb38fdf4426d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:24:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac0d2cf4-f2ff-47d0-a841-8fe5d079a341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:24:35 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Volume f4043bd1-5cda-4e46-9a8c-be988e5ccf63: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f4043bd1-5cda-4e46-9a8c-be988e5ccf63', 'volume_size': 2, 'source_volid': '80346d41-c5cf-46b6-a6cb-8afb88814abe', 'source_volstatus': 'available'} Aug 31 15:24:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:24:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:24:35 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Cloning volume 80346d41-c5cf-46b6-a6cb-8afb88814abe to volume f4043bd1-5cda-4e46-9a8c-be988e5ccf63 Aug 31 15:24:35 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Creating offline snapshot 36e64428-63fc-4125-a8aa-de65714d11c8 of volume 80346d41-c5cf-46b6-a6cb-8afb88814abe {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:24:35 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51b165f-fd30-44c7-bc1d-02bc269e1281]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:24:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:35 devstack sudo[99574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe Aug 31 15:24:35 devstack sudo[99574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:35 devstack sudo[99574]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe" returned: 0 in 0.604s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe.36e64428-63fc-4125-a8aa-de65714d11c8 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:35 devstack sudo[99579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe.36e64428-63fc-4125-a8aa-de65714d11c8 1G Aug 31 15:24:35 devstack sudo[99579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:36 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3a39746-acff-42bf-950c-16a896c67e0c tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:24:36 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c3a39746-acff-42bf-950c-16a896c67e0c tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Flow 'volume_create_manager' (c9bf850e-0f58-482d-9ca3-9a3303a65f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:24:36 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c3a39746-acff-42bf-950c-16a896c67e0c tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07444212-1fa9-417e-8f63-ce930724fbf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:24:36 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c3a39746-acff-42bf-950c-16a896c67e0c tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07444212-1fa9-417e-8f63-ce930724fbf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-804055872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7b4b3f0-8b84-4787-b81c-029310cda1e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6f10ad1bb34d0cbc04e4ddd2e9b132',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:24:36Z,use_quota=True,user_id='392d83018e1f4b2c86ade0b57bfc5bf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:24:36 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c3a39746-acff-42bf-950c-16a896c67e0c tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ba3b4fc-92fe-47f5-91af-c6334d0ea755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:24:36 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c3a39746-acff-42bf-950c-16a896c67e0c tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ba3b4fc-92fe-47f5-91af-c6334d0ea755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:24:36 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c3a39746-acff-42bf-950c-16a896c67e0c tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d186d8e0-202a-4c1d-a4e0-124e5e29d204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:24:36 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c3a39746-acff-42bf-950c-16a896c67e0c tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d186d8e0-202a-4c1d-a4e0-124e5e29d204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7b4b3f0-8b84-4787-b81c-029310cda1e6', 'volume_name': 'volume-c7b4b3f0-8b84-4787-b81c-029310cda1e6', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:24:36 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c3a39746-acff-42bf-950c-16a896c67e0c tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a7c19ec-e9cf-4f70-ae60-6de64f366779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:24:36 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c3a39746-acff-42bf-950c-16a896c67e0c tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a7c19ec-e9cf-4f70-ae60-6de64f366779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:24:36 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c3a39746-acff-42bf-950c-16a896c67e0c tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fb1198d-f512-4214-ab18-69c8bf465933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:24:36 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-c3a39746-acff-42bf-950c-16a896c67e0c tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Volume c7b4b3f0-8b84-4787-b81c-029310cda1e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7b4b3f0-8b84-4787-b81c-029310cda1e6', 'volume_size': 1} Aug 31 15:24:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c3a39746-acff-42bf-950c-16a896c67e0c tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:24:36 devstack sudo[99579]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe.36e64428-63fc-4125-a8aa-de65714d11c8 1G" returned: 0 in 0.922s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80346d41-c5cf-46b6-a6cb-8afb88814abe -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe.36e64428-63fc-4125-a8aa-de65714d11c8 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:36 devstack sudo[99598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80346d41-c5cf-46b6-a6cb-8afb88814abe -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe.36e64428-63fc-4125-a8aa-de65714d11c8 Aug 31 15:24:36 devstack sudo[99598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:37 devstack sudo[99598]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80346d41-c5cf-46b6-a6cb-8afb88814abe -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe.36e64428-63fc-4125-a8aa-de65714d11c8" returned: 0 in 0.406s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:37 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe.36e64428-63fc-4125-a8aa-de65714d11c8 is being set with open permissions: ugo+rw Aug 31 15:24:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe.36e64428-63fc-4125-a8aa-de65714d11c8 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:37 devstack sudo[99610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe.36e64428-63fc-4125-a8aa-de65714d11c8 Aug 31 15:24:37 devstack sudo[99610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:37 devstack sudo[99610]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe.36e64428-63fc-4125-a8aa-de65714d11c8" returned: 0 in 0.291s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:37 devstack sudo[99617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe.info Aug 31 15:24:37 devstack sudo[99617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:37 devstack sudo[99617]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe.info" returned: 0 in 0.297s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:37 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe.info is being set with open permissions: ugo+rw Aug 31 15:24:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:37 devstack sudo[99624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe.info Aug 31 15:24:37 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:38 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe.info" returned: 0 in 0.274s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:38 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Acquiring lock "cinder-quobyte-f4043bd1-5cda-4e46-9a8c-be988e5ccf63" by "_copy_volume_from_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:24:38 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Lock "cinder-quobyte-f4043bd1-5cda-4e46-9a8c-be988e5ccf63" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:24:38 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] snapshot: 36e64428-63fc-4125-a8aa-de65714d11c8, volume: f4043bd1-5cda-4e46-9a8c-be988e5ccf63, {{(pid=86000) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 31 15:24:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:24:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:24:38 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:24:38 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:24:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:24:38 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9322af-3288-4895-9b83-8c4f07211336]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:24:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe.36e64428-63fc-4125-a8aa-de65714d11c8 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:38 devstack sudo[99627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe.36e64428-63fc-4125-a8aa-de65714d11c8 Aug 31 15:24:38 devstack sudo[99627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:38 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-2b5ddf8b-6a05-4846-baaa-5ecbbaf37577 req-00dbcc24-8a5b-4767-b2ab-35b038fb73ef tempest-TestInstancesWithCinderVolumes-1668180206 None] Terminate volume connection completed successfully. Aug 31 15:24:38 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-2b5ddf8b-6a05-4846-baaa-5ecbbaf37577 req-00dbcc24-8a5b-4767-b2ab-35b038fb73ef tempest-TestInstancesWithCinderVolumes-1668180206 None] Deleting attachment cbf6dd86-0553-4cf5-bea4-d089994d5a36. {{(pid=86000) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 31 15:24:38 devstack sudo[99627]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe.36e64428-63fc-4125-a8aa-de65714d11c8" returned: 0 in 0.380s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:38 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80346d41-c5cf-46b6-a6cb-8afb88814abe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:24:38 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ff00a5-e98f-478f-94e7-ceadaf46f953]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:24:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:38 devstack sudo[99634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe Aug 31 15:24:38 devstack sudo[99634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:38 devstack sudo[99634]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe" returned: 0 in 0.373s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:38 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe {{(pid=86000) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 31 15:24:38 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Creating direct copy from snapshot {{(pid=86000) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 31 15:24:38 devstack cinder-volume[86000]: DEBUG cinder.utils [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Path /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f4043bd1-5cda-4e46-9a8c-be988e5ccf63 not found in is_blk_device check {{(pid=86000) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 31 15:24:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f4043bd1-5cda-4e46-9a8c-be988e5ccf63 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:38 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f4043bd1-5cda-4e46-9a8c-be988e5ccf63 Aug 31 15:24:38 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:39 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4ec83dca-94e3-4448-89f7-f606e1046540 tempest-TestInstancesWithCinderVolumes-1668180206 None] Acquiring lock "cinder-e27c5b47-0d09-4a58-bd88-41a34033e923-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:24:39 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4ec83dca-94e3-4448-89f7-f606e1046540 tempest-TestInstancesWithCinderVolumes-1668180206 None] Lock "cinder-e27c5b47-0d09-4a58-bd88-41a34033e923-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:24:39 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4ec83dca-94e3-4448-89f7-f606e1046540 tempest-TestInstancesWithCinderVolumes-1668180206 None] Acquiring lock "cinder-quobyte-e27c5b47-0d09-4a58-bd88-41a34033e923" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:24:39 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4ec83dca-94e3-4448-89f7-f606e1046540 tempest-TestInstancesWithCinderVolumes-1668180206 None] Lock "cinder-quobyte-e27c5b47-0d09-4a58-bd88-41a34033e923" acquired by "delete_volume" :: waited 0.028s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:24:39 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc72472-70e0-470a-b20d-d710aa145180]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:24:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4ec83dca-94e3-4448-89f7-f606e1046540 tempest-TestInstancesWithCinderVolumes-1668180206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e27c5b47-0d09-4a58-bd88-41a34033e923 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:39 devstack sudo[99648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e27c5b47-0d09-4a58-bd88-41a34033e923 Aug 31 15:24:39 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:40 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4ec83dca-94e3-4448-89f7-f606e1046540 tempest-TestInstancesWithCinderVolumes-1668180206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e27c5b47-0d09-4a58-bd88-41a34033e923" returned: 0 in 1.280s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4ec83dca-94e3-4448-89f7-f606e1046540 tempest-TestInstancesWithCinderVolumes-1668180206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e27c5b47-0d09-4a58-bd88-41a34033e923 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:40 devstack sudo[99662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e27c5b47-0d09-4a58-bd88-41a34033e923 Aug 31 15:24:40 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:41 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4ec83dca-94e3-4448-89f7-f606e1046540 tempest-TestInstancesWithCinderVolumes-1668180206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e27c5b47-0d09-4a58-bd88-41a34033e923" returned: 0 in 0.814s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:41 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4ec83dca-94e3-4448-89f7-f606e1046540 tempest-TestInstancesWithCinderVolumes-1668180206 None] Lock "cinder-quobyte-e27c5b47-0d09-4a58-bd88-41a34033e923" released by "delete_volume" :: held 2.189s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:24:41 devstack cinder-volume[86000]: WARNING cinder.quota [None req-4ec83dca-94e3-4448-89f7-f606e1046540 tempest-TestInstancesWithCinderVolumes-1668180206 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2058715551-1642619913 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2058715551-1642619913, it is now deprecated. Please use the default quota class for default quota. Aug 31 15:24:41 devstack cinder-volume[86000]: WARNING cinder.quota [None req-4ec83dca-94e3-4448-89f7-f606e1046540 tempest-TestInstancesWithCinderVolumes-1668180206 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2058715551-1642619913 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2058715551-1642619913, it is now deprecated. Please use the default quota class for default quota. Aug 31 15:24:41 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-4ec83dca-94e3-4448-89f7-f606e1046540 tempest-TestInstancesWithCinderVolumes-1668180206 None] Created reservations ['f2a4e4ce-2ba3-4268-8495-d8ed01f232a5', '9c75619f-074d-4d00-8f76-dd77c179de61', 'b0fbe962-990a-46e9-b628-f2323dcc3129', '8ce4b011-4459-48da-bc38-d32cb0bb1307'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:24:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4ec83dca-94e3-4448-89f7-f606e1046540 tempest-TestInstancesWithCinderVolumes-1668180206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:24:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4ec83dca-94e3-4448-89f7-f606e1046540 tempest-TestInstancesWithCinderVolumes-1668180206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:24:42 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4ec83dca-94e3-4448-89f7-f606e1046540 tempest-TestInstancesWithCinderVolumes-1668180206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:24:42 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4ec83dca-94e3-4448-89f7-f606e1046540 tempest-TestInstancesWithCinderVolumes-1668180206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:24:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4ec83dca-94e3-4448-89f7-f606e1046540 tempest-TestInstancesWithCinderVolumes-1668180206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:24:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4ec83dca-94e3-4448-89f7-f606e1046540 tempest-TestInstancesWithCinderVolumes-1668180206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:42 devstack sudo[99665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:24:42 devstack sudo[99665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:43 devstack sudo[99665]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4ec83dca-94e3-4448-89f7-f606e1046540 tempest-TestInstancesWithCinderVolumes-1668180206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 1.104s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:43 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-4ec83dca-94e3-4448-89f7-f606e1046540 tempest-TestInstancesWithCinderVolumes-1668180206 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:24:43 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-4ec83dca-94e3-4448-89f7-f606e1046540 tempest-TestInstancesWithCinderVolumes-1668180206 None] Deleted volume successfully. Aug 31 15:24:43 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4ec83dca-94e3-4448-89f7-f606e1046540 tempest-TestInstancesWithCinderVolumes-1668180206 None] Lock "cinder-e27c5b47-0d09-4a58-bd88-41a34033e923-delete_volume" released by "delete_volume" :: held 3.909s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:24:45 devstack cinder-volume[86000]: DEBUG oslo_service.periodic_task [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86000) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:24:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:24:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:24:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:24:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:24:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:24:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:45 devstack sudo[99687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:24:45 devstack sudo[99687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:46 devstack sudo[99687]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.909s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:46 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:24:46 devstack cinder-volume[86000]: DEBUG oslo_service.periodic_task [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running periodic task VolumeManager._thread_info {{(pid=86000) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:24:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] thread count: 28 {{(pid=86000) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 31 15:24:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] thread info: [<_MainThread(MainThread, started 137631281086592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86000) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 31 15:24:46 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f4043bd1-5cda-4e46-9a8c-be988e5ccf63" returned: 0 in 7.394s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:46 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe, size 1024.00 MB, duration 7.40 sec, destination /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f4043bd1-5cda-4e46-9a8c-be988e5ccf63 {{(pid=86000) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 31 15:24:46 devstack cinder-volume[86000]: INFO cinder.image.image_utils [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Converted 1024.00 MB image at 138.47 MB/s Aug 31 15:24:46 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f4043bd1-5cda-4e46-9a8c-be988e5ccf63 is being set with open permissions: ugo+rw Aug 31 15:24:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f4043bd1-5cda-4e46-9a8c-be988e5ccf63 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:46 devstack sudo[99704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f4043bd1-5cda-4e46-9a8c-be988e5ccf63 Aug 31 15:24:46 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:46 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f4043bd1-5cda-4e46-9a8c-be988e5ccf63" returned: 0 in 0.276s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:46 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Lock "cinder-quobyte-f4043bd1-5cda-4e46-9a8c-be988e5ccf63" released by "_copy_volume_from_snapshot" :: held 8.545s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:24:46 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Acquiring lock "cinder-quobyte-36e64428-63fc-4125-a8aa-de65714d11c8" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:24:46 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Lock "cinder-quobyte-36e64428-63fc-4125-a8aa-de65714d11c8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:24:46 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Deleting offline snapshot 36e64428-63fc-4125-a8aa-de65714d11c8 of volume 80346d41-c5cf-46b6-a6cb-8afb88814abe {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:24:46 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] snapshot_file for this snap is: volume-80346d41-c5cf-46b6-a6cb-8afb88814abe.36e64428-63fc-4125-a8aa-de65714d11c8 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:24:46 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77d3d0d-93d7-450e-a0ca-43418fed4764]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:24:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe.36e64428-63fc-4125-a8aa-de65714d11c8 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:46 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-20e930ac-cba7-4baa-a7f2-0f7da88be6cb req-93db6e5b-54a6-4973-bb1a-85f8386a5311 tempest-TestInstancesWithCinderVolumes-1668180206 None] Terminate volume connection completed successfully. Aug 31 15:24:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-20e930ac-cba7-4baa-a7f2-0f7da88be6cb req-93db6e5b-54a6-4973-bb1a-85f8386a5311 tempest-TestInstancesWithCinderVolumes-1668180206 None] Deleting attachment 3d007670-7a27-4578-8dda-a93f7b683e20. {{(pid=86000) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 31 15:24:46 devstack sudo[99710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe.36e64428-63fc-4125-a8aa-de65714d11c8 Aug 31 15:24:46 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:47 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe.36e64428-63fc-4125-a8aa-de65714d11c8" returned: 0 in 0.396s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:47 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80346d41-c5cf-46b6-a6cb-8afb88814abe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:24:47 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39387e1-30c3-455f-83b8-b6605d6cefa2]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:24:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:47 devstack sudo[99715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe Aug 31 15:24:47 devstack sudo[99715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:47 devstack sudo[99715]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe" returned: 0 in 0.544s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe.36e64428-63fc-4125-a8aa-de65714d11c8 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:47 devstack sudo[99720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe.36e64428-63fc-4125-a8aa-de65714d11c8 Aug 31 15:24:47 devstack sudo[99720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:47 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-02fc7201-ee5f-4a6c-9e7f-9cce221c325a tempest-TestInstancesWithCinderVolumes-1668180206 None] Acquiring lock "cinder-d9d6128b-8945-47aa-9eff-7bfa48f35ed2-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:24:47 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-02fc7201-ee5f-4a6c-9e7f-9cce221c325a tempest-TestInstancesWithCinderVolumes-1668180206 None] Lock "cinder-d9d6128b-8945-47aa-9eff-7bfa48f35ed2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:24:47 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-02fc7201-ee5f-4a6c-9e7f-9cce221c325a tempest-TestInstancesWithCinderVolumes-1668180206 None] Acquiring lock "cinder-quobyte-d9d6128b-8945-47aa-9eff-7bfa48f35ed2" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:24:47 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-02fc7201-ee5f-4a6c-9e7f-9cce221c325a tempest-TestInstancesWithCinderVolumes-1668180206 None] Lock "cinder-quobyte-d9d6128b-8945-47aa-9eff-7bfa48f35ed2" acquired by "delete_volume" :: waited 0.022s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:24:47 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d420c136-f789-4d79-83e4-bbf92d44bb63]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:24:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-02fc7201-ee5f-4a6c-9e7f-9cce221c325a tempest-TestInstancesWithCinderVolumes-1668180206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d9d6128b-8945-47aa-9eff-7bfa48f35ed2 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:47 devstack sudo[99722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d9d6128b-8945-47aa-9eff-7bfa48f35ed2 Aug 31 15:24:47 devstack sudo[99722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:48 devstack sudo[99720]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe.36e64428-63fc-4125-a8aa-de65714d11c8" returned: 0 in 0.413s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe.36e64428-63fc-4125-a8aa-de65714d11c8 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:48 devstack sudo[99727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe.36e64428-63fc-4125-a8aa-de65714d11c8 Aug 31 15:24:48 devstack sudo[99727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:48 devstack sudo[99722]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-02fc7201-ee5f-4a6c-9e7f-9cce221c325a tempest-TestInstancesWithCinderVolumes-1668180206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d9d6128b-8945-47aa-9eff-7bfa48f35ed2" returned: 0 in 0.406s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-02fc7201-ee5f-4a6c-9e7f-9cce221c325a tempest-TestInstancesWithCinderVolumes-1668180206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d9d6128b-8945-47aa-9eff-7bfa48f35ed2 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:48 devstack sudo[99732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d9d6128b-8945-47aa-9eff-7bfa48f35ed2 Aug 31 15:24:48 devstack sudo[99732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:48 devstack sudo[99727]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe.36e64428-63fc-4125-a8aa-de65714d11c8" returned: 0 in 0.288s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:48 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Lock "cinder-quobyte-36e64428-63fc-4125-a8aa-de65714d11c8" released by "_delete_snapshot" :: held 1.753s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:24:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.368s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:24:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c3a39746-acff-42bf-950c-16a896c67e0c tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.820s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:24:48 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c3a39746-acff-42bf-950c-16a896c67e0c tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-804055872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7b4b3f0-8b84-4787-b81c-029310cda1e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6f10ad1bb34d0cbc04e4ddd2e9b132',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:24:36Z,use_quota=True,user_id='392d83018e1f4b2c86ade0b57bfc5bf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:24:48 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-c3a39746-acff-42bf-950c-16a896c67e0c tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Creating volume c7b4b3f0-8b84-4787-b81c-029310cda1e6 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:24:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c3a39746-acff-42bf-950c-16a896c67e0c tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:24:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c3a39746-acff-42bf-950c-16a896c67e0c tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:24:48 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c3a39746-acff-42bf-950c-16a896c67e0c tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:24:48 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c3a39746-acff-42bf-950c-16a896c67e0c tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:24:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c3a39746-acff-42bf-950c-16a896c67e0c tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:24:48 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c3a39746-acff-42bf-950c-16a896c67e0c tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:24:48 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-c3a39746-acff-42bf-950c-16a896c67e0c tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:24:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c3a39746-acff-42bf-950c-16a896c67e0c tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c7b4b3f0-8b84-4787-b81c-029310cda1e6 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:48 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac0d2cf4-f2ff-47d0-a841-8fe5d079a341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4043bd1-5cda-4e46-9a8c-be988e5ccf63', 'volume_size': 2, 'source_volid': '80346d41-c5cf-46b6-a6cb-8afb88814abe', 'source_volstatus': 'available'}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:24:48 devstack sudo[99735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c7b4b3f0-8b84-4787-b81c-029310cda1e6 1073741824 Aug 31 15:24:48 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:48 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1c56119-f27f-4af5-ae4e-47aded46c390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:24:48 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Volume volume-f4043bd1-5cda-4e46-9a8c-be988e5ccf63 (f4043bd1-5cda-4e46-9a8c-be988e5ccf63): created successfully Aug 31 15:24:48 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1c56119-f27f-4af5-ae4e-47aded46c390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:24:48 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Flow 'volume_create_manager' (fad85f66-5827-4463-9eeb-abdb96d49e1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:24:48 devstack sudo[99732]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-02fc7201-ee5f-4a6c-9e7f-9cce221c325a tempest-TestInstancesWithCinderVolumes-1668180206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d9d6128b-8945-47aa-9eff-7bfa48f35ed2" returned: 0 in 0.278s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:48 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-02fc7201-ee5f-4a6c-9e7f-9cce221c325a tempest-TestInstancesWithCinderVolumes-1668180206 None] Lock "cinder-quobyte-d9d6128b-8945-47aa-9eff-7bfa48f35ed2" released by "delete_volume" :: held 0.745s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:24:48 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-c228c64b-e3ba-46df-ba57-df04a665bff3 tempest-VolumesCloneTest-1482626770 None] Created volume successfully. Aug 31 15:24:48 devstack cinder-volume[86000]: WARNING cinder.quota [None req-02fc7201-ee5f-4a6c-9e7f-9cce221c325a tempest-TestInstancesWithCinderVolumes-1668180206 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1388038550-1422645583 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1388038550-1422645583, it is now deprecated. Please use the default quota class for default quota. Aug 31 15:24:48 devstack cinder-volume[86000]: WARNING cinder.quota [None req-02fc7201-ee5f-4a6c-9e7f-9cce221c325a tempest-TestInstancesWithCinderVolumes-1668180206 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1388038550-1422645583 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1388038550-1422645583, it is now deprecated. Please use the default quota class for default quota. Aug 31 15:24:48 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-02fc7201-ee5f-4a6c-9e7f-9cce221c325a tempest-TestInstancesWithCinderVolumes-1668180206 None] Created reservations ['dee8657d-ba57-4697-938d-9cf4df5ffe4e', 'b5eba7df-694d-4a04-acbb-5f8280132718', '3246a29a-224f-4d18-9c7d-de6f0841770f', 'd871e319-80e0-4a66-b059-26778bf9a860'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:24:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-02fc7201-ee5f-4a6c-9e7f-9cce221c325a tempest-TestInstancesWithCinderVolumes-1668180206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:24:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-02fc7201-ee5f-4a6c-9e7f-9cce221c325a tempest-TestInstancesWithCinderVolumes-1668180206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:24:48 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-02fc7201-ee5f-4a6c-9e7f-9cce221c325a tempest-TestInstancesWithCinderVolumes-1668180206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:24:48 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-02fc7201-ee5f-4a6c-9e7f-9cce221c325a tempest-TestInstancesWithCinderVolumes-1668180206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:24:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-02fc7201-ee5f-4a6c-9e7f-9cce221c325a tempest-TestInstancesWithCinderVolumes-1668180206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:24:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-02fc7201-ee5f-4a6c-9e7f-9cce221c325a tempest-TestInstancesWithCinderVolumes-1668180206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:48 devstack sudo[99739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:24:48 devstack sudo[99739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:48 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c3a39746-acff-42bf-950c-16a896c67e0c tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c7b4b3f0-8b84-4787-b81c-029310cda1e6 1073741824" returned: 0 in 0.514s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:49 devstack sudo[99739]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c3a39746-acff-42bf-950c-16a896c67e0c tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c7b4b3f0-8b84-4787-b81c-029310cda1e6 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-02fc7201-ee5f-4a6c-9e7f-9cce221c325a tempest-TestInstancesWithCinderVolumes-1668180206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.326s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:49 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-02fc7201-ee5f-4a6c-9e7f-9cce221c325a tempest-TestInstancesWithCinderVolumes-1668180206 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:24:49 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-02fc7201-ee5f-4a6c-9e7f-9cce221c325a tempest-TestInstancesWithCinderVolumes-1668180206 None] Deleted volume successfully. Aug 31 15:24:49 devstack sudo[99746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c7b4b3f0-8b84-4787-b81c-029310cda1e6 Aug 31 15:24:49 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:49 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-02fc7201-ee5f-4a6c-9e7f-9cce221c325a tempest-TestInstancesWithCinderVolumes-1668180206 None] Lock "cinder-d9d6128b-8945-47aa-9eff-7bfa48f35ed2-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:24:49 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c3a39746-acff-42bf-950c-16a896c67e0c tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c7b4b3f0-8b84-4787-b81c-029310cda1e6" returned: 0 in 0.286s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:49 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c3a39746-acff-42bf-950c-16a896c67e0c tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:24:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c3a39746-acff-42bf-950c-16a896c67e0c tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:24:49 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c3a39746-acff-42bf-950c-16a896c67e0c tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fb1198d-f512-4214-ab18-69c8bf465933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7b4b3f0-8b84-4787-b81c-029310cda1e6', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:24:49 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c3a39746-acff-42bf-950c-16a896c67e0c tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63ee4b7b-2246-48c0-a535-5ba3fbc114a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:24:49 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-c3a39746-acff-42bf-950c-16a896c67e0c tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Volume volume-c7b4b3f0-8b84-4787-b81c-029310cda1e6 (c7b4b3f0-8b84-4787-b81c-029310cda1e6): created successfully Aug 31 15:24:49 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c3a39746-acff-42bf-950c-16a896c67e0c tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63ee4b7b-2246-48c0-a535-5ba3fbc114a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:24:49 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c3a39746-acff-42bf-950c-16a896c67e0c tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Flow 'volume_create_manager' (c9bf850e-0f58-482d-9ca3-9a3303a65f9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:24:49 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-c3a39746-acff-42bf-950c-16a896c67e0c tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Created volume successfully. Aug 31 15:24:49 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e848335a-08c7-4bcd-aacf-66fd79a1e910 tempest-VolumesCloneTest-1482626770 None] Acquiring lock "cinder-f4043bd1-5cda-4e46-9a8c-be988e5ccf63-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:24:49 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e848335a-08c7-4bcd-aacf-66fd79a1e910 tempest-VolumesCloneTest-1482626770 None] Lock "cinder-f4043bd1-5cda-4e46-9a8c-be988e5ccf63-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:24:49 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e848335a-08c7-4bcd-aacf-66fd79a1e910 tempest-VolumesCloneTest-1482626770 None] Acquiring lock "cinder-quobyte-f4043bd1-5cda-4e46-9a8c-be988e5ccf63" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:24:49 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e848335a-08c7-4bcd-aacf-66fd79a1e910 tempest-VolumesCloneTest-1482626770 None] Lock "cinder-quobyte-f4043bd1-5cda-4e46-9a8c-be988e5ccf63" acquired by "delete_volume" :: waited 0.018s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:24:49 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[124b2272-ed9d-4870-b5d1-67da4e8db193]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:24:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e848335a-08c7-4bcd-aacf-66fd79a1e910 tempest-VolumesCloneTest-1482626770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f4043bd1-5cda-4e46-9a8c-be988e5ccf63 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:49 devstack sudo[99750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f4043bd1-5cda-4e46-9a8c-be988e5ccf63 Aug 31 15:24:49 devstack sudo[99750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:50 devstack sudo[99750]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e848335a-08c7-4bcd-aacf-66fd79a1e910 tempest-VolumesCloneTest-1482626770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f4043bd1-5cda-4e46-9a8c-be988e5ccf63" returned: 0 in 0.432s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e848335a-08c7-4bcd-aacf-66fd79a1e910 tempest-VolumesCloneTest-1482626770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f4043bd1-5cda-4e46-9a8c-be988e5ccf63 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:50 devstack sudo[99761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f4043bd1-5cda-4e46-9a8c-be988e5ccf63 Aug 31 15:24:50 devstack sudo[99761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:50 devstack sudo[99761]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e848335a-08c7-4bcd-aacf-66fd79a1e910 tempest-VolumesCloneTest-1482626770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f4043bd1-5cda-4e46-9a8c-be988e5ccf63" returned: 0 in 0.427s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:50 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e848335a-08c7-4bcd-aacf-66fd79a1e910 tempest-VolumesCloneTest-1482626770 None] Lock "cinder-quobyte-f4043bd1-5cda-4e46-9a8c-be988e5ccf63" released by "delete_volume" :: held 0.922s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:24:50 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-e848335a-08c7-4bcd-aacf-66fd79a1e910 tempest-VolumesCloneTest-1482626770 None] Created reservations ['870ceb3b-96ea-4a16-be21-9d17194bacd3', 'c06cab8f-b857-4da1-8071-26c9765a635c', 'af6e8570-df14-487e-9ade-2124a8204f75', 'a2fecb16-a1ca-4398-9579-c3d0c5a9626e'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:24:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e848335a-08c7-4bcd-aacf-66fd79a1e910 tempest-VolumesCloneTest-1482626770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:24:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e848335a-08c7-4bcd-aacf-66fd79a1e910 tempest-VolumesCloneTest-1482626770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:24:50 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-e848335a-08c7-4bcd-aacf-66fd79a1e910 tempest-VolumesCloneTest-1482626770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:24:50 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-e848335a-08c7-4bcd-aacf-66fd79a1e910 tempest-VolumesCloneTest-1482626770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:24:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e848335a-08c7-4bcd-aacf-66fd79a1e910 tempest-VolumesCloneTest-1482626770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:24:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e848335a-08c7-4bcd-aacf-66fd79a1e910 tempest-VolumesCloneTest-1482626770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:50 devstack sudo[99776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:24:50 devstack sudo[99776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:51 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6bca1beb-339f-4101-98f8-610f9625fe2b tempest-VolumesCloneTest-1482626770 None] Acquiring lock "cinder-80346d41-c5cf-46b6-a6cb-8afb88814abe-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:24:51 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6bca1beb-339f-4101-98f8-610f9625fe2b tempest-VolumesCloneTest-1482626770 None] Lock "cinder-80346d41-c5cf-46b6-a6cb-8afb88814abe-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:24:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-44cb0b77-244d-43b0-ab85-3378ab3b1b42 req-6eaa9727-43a1-4ff1-ada6-1e4f536fb4fd tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:24:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-44cb0b77-244d-43b0-ab85-3378ab3b1b42 req-6eaa9727-43a1-4ff1-ada6-1e4f536fb4fd tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:24:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-44cb0b77-244d-43b0-ab85-3378ab3b1b42 req-6eaa9727-43a1-4ff1-ada6-1e4f536fb4fd tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:24:51 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6bca1beb-339f-4101-98f8-610f9625fe2b tempest-VolumesCloneTest-1482626770 None] Acquiring lock "cinder-quobyte-80346d41-c5cf-46b6-a6cb-8afb88814abe" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:24:51 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-44cb0b77-244d-43b0-ab85-3378ab3b1b42 req-6eaa9727-43a1-4ff1-ada6-1e4f536fb4fd tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77', 'name': 'volume-c7b4b3f0-8b84-4787-b81c-029310cda1e6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9822ee67-d1ef-449c-99b5-4e78b4f638b6', 'enforce_multipath': True} {{(pid=86000) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 31 15:24:51 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6bca1beb-339f-4101-98f8-610f9625fe2b tempest-VolumesCloneTest-1482626770 None] Lock "cinder-quobyte-80346d41-c5cf-46b6-a6cb-8afb88814abe" acquired by "delete_volume" :: waited 0.038s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:24:51 devstack sudo[99776]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e848335a-08c7-4bcd-aacf-66fd79a1e910 tempest-VolumesCloneTest-1482626770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.589s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:51 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-e848335a-08c7-4bcd-aacf-66fd79a1e910 tempest-VolumesCloneTest-1482626770 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:24:51 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[08cb0280-96b7-4dcd-bc7b-c36db76641a9]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:24:51 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-e848335a-08c7-4bcd-aacf-66fd79a1e910 tempest-VolumesCloneTest-1482626770 None] Deleted volume successfully. Aug 31 15:24:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6bca1beb-339f-4101-98f8-610f9625fe2b tempest-VolumesCloneTest-1482626770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:51 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e848335a-08c7-4bcd-aacf-66fd79a1e910 tempest-VolumesCloneTest-1482626770 None] Lock "cinder-f4043bd1-5cda-4e46-9a8c-be988e5ccf63-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:24:51 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-44cb0b77-244d-43b0-ab85-3378ab3b1b42 req-6eaa9727-43a1-4ff1-ada6-1e4f536fb4fd tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] attachment_update completed successfully. Aug 31 15:24:51 devstack sudo[99796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe Aug 31 15:24:51 devstack sudo[99796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:52 devstack sudo[99796]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6bca1beb-339f-4101-98f8-610f9625fe2b tempest-VolumesCloneTest-1482626770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe" returned: 0 in 0.556s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6bca1beb-339f-4101-98f8-610f9625fe2b tempest-VolumesCloneTest-1482626770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:52 devstack sudo[100180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe Aug 31 15:24:52 devstack sudo[100180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:52 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-b47c9646-05aa-4ff2-9a9d-f07a8059a52d req-a61a58d7-0d60-4a3a-b826-f9278ab37502 tempest-TestInstancesWithCinderVolumes-1668180206 None] Terminate volume connection completed successfully. Aug 31 15:24:52 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-b47c9646-05aa-4ff2-9a9d-f07a8059a52d req-a61a58d7-0d60-4a3a-b826-f9278ab37502 tempest-TestInstancesWithCinderVolumes-1668180206 None] Deleting attachment 4f6972d5-8054-43b2-bee1-960a177aa1e0. {{(pid=86000) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 31 15:24:52 devstack sudo[100180]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6bca1beb-339f-4101-98f8-610f9625fe2b tempest-VolumesCloneTest-1482626770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-80346d41-c5cf-46b6-a6cb-8afb88814abe" returned: 0 in 0.458s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:52 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6bca1beb-339f-4101-98f8-610f9625fe2b tempest-VolumesCloneTest-1482626770 None] Lock "cinder-quobyte-80346d41-c5cf-46b6-a6cb-8afb88814abe" released by "delete_volume" :: held 1.113s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:24:52 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-6bca1beb-339f-4101-98f8-610f9625fe2b tempest-VolumesCloneTest-1482626770 None] Created reservations ['16134a6a-64ac-41e7-8aa0-b3c4daf1501f', 'fd48de77-6d58-41e6-b92d-09544ed4981d', '3accbcf3-71c7-4959-8a6c-ce65715219dc', '5e9d0be3-0d02-41a2-8bb5-0d406974ee4a'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:24:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6bca1beb-339f-4101-98f8-610f9625fe2b tempest-VolumesCloneTest-1482626770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:24:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6bca1beb-339f-4101-98f8-610f9625fe2b tempest-VolumesCloneTest-1482626770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:24:52 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6bca1beb-339f-4101-98f8-610f9625fe2b tempest-VolumesCloneTest-1482626770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:24:52 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6bca1beb-339f-4101-98f8-610f9625fe2b tempest-VolumesCloneTest-1482626770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:24:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6bca1beb-339f-4101-98f8-610f9625fe2b tempest-VolumesCloneTest-1482626770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:24:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6bca1beb-339f-4101-98f8-610f9625fe2b tempest-VolumesCloneTest-1482626770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:52 devstack sudo[100189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:24:52 devstack sudo[100189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:53 devstack sudo[100189]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6bca1beb-339f-4101-98f8-610f9625fe2b tempest-VolumesCloneTest-1482626770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.298s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:53 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-6bca1beb-339f-4101-98f8-610f9625fe2b tempest-VolumesCloneTest-1482626770 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:24:53 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-6bca1beb-339f-4101-98f8-610f9625fe2b tempest-VolumesCloneTest-1482626770 None] Deleted volume successfully. Aug 31 15:24:53 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6bca1beb-339f-4101-98f8-610f9625fe2b tempest-VolumesCloneTest-1482626770 None] Lock "cinder-80346d41-c5cf-46b6-a6cb-8afb88814abe-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:24:53 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-32591411-7e90-4a27-8f2f-34aec357d33e tempest-TestInstancesWithCinderVolumes-1668180206 None] Acquiring lock "cinder-d63da34f-7901-41c2-a934-61ea0ad82633-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:24:53 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-32591411-7e90-4a27-8f2f-34aec357d33e tempest-TestInstancesWithCinderVolumes-1668180206 None] Lock "cinder-d63da34f-7901-41c2-a934-61ea0ad82633-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:24:53 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-32591411-7e90-4a27-8f2f-34aec357d33e tempest-TestInstancesWithCinderVolumes-1668180206 None] Acquiring lock "cinder-quobyte-d63da34f-7901-41c2-a934-61ea0ad82633" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:24:53 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-32591411-7e90-4a27-8f2f-34aec357d33e tempest-TestInstancesWithCinderVolumes-1668180206 None] Lock "cinder-quobyte-d63da34f-7901-41c2-a934-61ea0ad82633" acquired by "delete_volume" :: waited 0.043s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:24:53 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8277a919-99f6-48b9-9395-12ac681fa2e0]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:24:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-32591411-7e90-4a27-8f2f-34aec357d33e tempest-TestInstancesWithCinderVolumes-1668180206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d63da34f-7901-41c2-a934-61ea0ad82633 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:53 devstack sudo[100192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d63da34f-7901-41c2-a934-61ea0ad82633 Aug 31 15:24:53 devstack sudo[100192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:54 devstack sudo[100192]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-32591411-7e90-4a27-8f2f-34aec357d33e tempest-TestInstancesWithCinderVolumes-1668180206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d63da34f-7901-41c2-a934-61ea0ad82633" returned: 0 in 0.378s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-32591411-7e90-4a27-8f2f-34aec357d33e tempest-TestInstancesWithCinderVolumes-1668180206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d63da34f-7901-41c2-a934-61ea0ad82633 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:54 devstack sudo[100197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d63da34f-7901-41c2-a934-61ea0ad82633 Aug 31 15:24:54 devstack sudo[100197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:54 devstack sudo[100197]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-32591411-7e90-4a27-8f2f-34aec357d33e tempest-TestInstancesWithCinderVolumes-1668180206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d63da34f-7901-41c2-a934-61ea0ad82633" returned: 0 in 0.307s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:54 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-32591411-7e90-4a27-8f2f-34aec357d33e tempest-TestInstancesWithCinderVolumes-1668180206 None] Lock "cinder-quobyte-d63da34f-7901-41c2-a934-61ea0ad82633" released by "delete_volume" :: held 0.771s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:24:54 devstack cinder-volume[86000]: WARNING cinder.quota [None req-32591411-7e90-4a27-8f2f-34aec357d33e tempest-TestInstancesWithCinderVolumes-1668180206 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1180250441-49212132 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1180250441-49212132, it is now deprecated. Please use the default quota class for default quota. Aug 31 15:24:54 devstack cinder-volume[86000]: WARNING cinder.quota [None req-32591411-7e90-4a27-8f2f-34aec357d33e tempest-TestInstancesWithCinderVolumes-1668180206 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1180250441-49212132 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1180250441-49212132, it is now deprecated. Please use the default quota class for default quota. Aug 31 15:24:54 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-32591411-7e90-4a27-8f2f-34aec357d33e tempest-TestInstancesWithCinderVolumes-1668180206 None] Created reservations ['ef0ea3b7-12f0-48c2-b371-9b9a4277fbf3', 'dc5702e9-b54f-46ec-ba53-d509ac859be8', '07efa646-27e7-498d-9fe9-d3493fc7f9fa', '6caa6778-70c3-43c2-884c-e9ebb1090ffa'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:24:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-32591411-7e90-4a27-8f2f-34aec357d33e tempest-TestInstancesWithCinderVolumes-1668180206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:24:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-32591411-7e90-4a27-8f2f-34aec357d33e tempest-TestInstancesWithCinderVolumes-1668180206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:24:54 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-32591411-7e90-4a27-8f2f-34aec357d33e tempest-TestInstancesWithCinderVolumes-1668180206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:24:54 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-32591411-7e90-4a27-8f2f-34aec357d33e tempest-TestInstancesWithCinderVolumes-1668180206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:24:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-32591411-7e90-4a27-8f2f-34aec357d33e tempest-TestInstancesWithCinderVolumes-1668180206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:24:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-32591411-7e90-4a27-8f2f-34aec357d33e tempest-TestInstancesWithCinderVolumes-1668180206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:54 devstack sudo[100202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:24:54 devstack sudo[100202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:54 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-f83054a6-230f-4fda-ad07-4c8c5e015cc8 req-838f0530-5677-4151-8a7a-de14a55aacf4 tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Terminate volume connection completed successfully. Aug 31 15:24:54 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-f83054a6-230f-4fda-ad07-4c8c5e015cc8 req-838f0530-5677-4151-8a7a-de14a55aacf4 tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Deleting attachment 9822ee67-d1ef-449c-99b5-4e78b4f638b6. {{(pid=86000) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 31 15:24:54 devstack sudo[100202]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-32591411-7e90-4a27-8f2f-34aec357d33e tempest-TestInstancesWithCinderVolumes-1668180206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.393s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:54 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-32591411-7e90-4a27-8f2f-34aec357d33e tempest-TestInstancesWithCinderVolumes-1668180206 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:24:54 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-32591411-7e90-4a27-8f2f-34aec357d33e tempest-TestInstancesWithCinderVolumes-1668180206 None] Deleted volume successfully. Aug 31 15:24:54 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-32591411-7e90-4a27-8f2f-34aec357d33e tempest-TestInstancesWithCinderVolumes-1668180206 None] Lock "cinder-d63da34f-7901-41c2-a934-61ea0ad82633-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:24:55 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-913a9cfb-2f87-4e7d-bea3-8048ce5c3901 tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Acquiring lock "cinder-c7b4b3f0-8b84-4787-b81c-029310cda1e6-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:24:55 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-913a9cfb-2f87-4e7d-bea3-8048ce5c3901 tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Lock "cinder-c7b4b3f0-8b84-4787-b81c-029310cda1e6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:24:55 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-913a9cfb-2f87-4e7d-bea3-8048ce5c3901 tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Acquiring lock "cinder-quobyte-c7b4b3f0-8b84-4787-b81c-029310cda1e6" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:24:55 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-913a9cfb-2f87-4e7d-bea3-8048ce5c3901 tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Lock "cinder-quobyte-c7b4b3f0-8b84-4787-b81c-029310cda1e6" acquired by "delete_volume" :: waited 0.021s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:24:55 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[780a89c9-cd17-4cc7-990a-a8361526df1d]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:24:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-913a9cfb-2f87-4e7d-bea3-8048ce5c3901 tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c7b4b3f0-8b84-4787-b81c-029310cda1e6 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:55 devstack sudo[100229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c7b4b3f0-8b84-4787-b81c-029310cda1e6 Aug 31 15:24:55 devstack sudo[100229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:56 devstack sudo[100229]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-913a9cfb-2f87-4e7d-bea3-8048ce5c3901 tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c7b4b3f0-8b84-4787-b81c-029310cda1e6" returned: 0 in 0.507s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-913a9cfb-2f87-4e7d-bea3-8048ce5c3901 tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c7b4b3f0-8b84-4787-b81c-029310cda1e6 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:56 devstack sudo[100234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c7b4b3f0-8b84-4787-b81c-029310cda1e6 Aug 31 15:24:56 devstack sudo[100234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:56 devstack sudo[100234]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-913a9cfb-2f87-4e7d-bea3-8048ce5c3901 tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c7b4b3f0-8b84-4787-b81c-029310cda1e6" returned: 0 in 0.318s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:56 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-913a9cfb-2f87-4e7d-bea3-8048ce5c3901 tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Lock "cinder-quobyte-c7b4b3f0-8b84-4787-b81c-029310cda1e6" released by "delete_volume" :: held 0.888s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:24:56 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-913a9cfb-2f87-4e7d-bea3-8048ce5c3901 tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Created reservations ['a4166111-5241-41c8-944d-39ef12867d07', '8848d330-3791-4b53-a3e2-a08d3aa2061f', 'c8b5018d-b299-4f35-b3d1-d34a155b35f2', '3f898438-cc77-4e1a-a895-b6b07807fd75'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:24:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-913a9cfb-2f87-4e7d-bea3-8048ce5c3901 tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:24:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-913a9cfb-2f87-4e7d-bea3-8048ce5c3901 tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:24:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-913a9cfb-2f87-4e7d-bea3-8048ce5c3901 tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:24:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-913a9cfb-2f87-4e7d-bea3-8048ce5c3901 tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:24:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-913a9cfb-2f87-4e7d-bea3-8048ce5c3901 tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:24:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-913a9cfb-2f87-4e7d-bea3-8048ce5c3901 tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:56 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:24:56 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:57 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-913a9cfb-2f87-4e7d-bea3-8048ce5c3901 tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.351s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:57 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-913a9cfb-2f87-4e7d-bea3-8048ce5c3901 tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:24:57 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-913a9cfb-2f87-4e7d-bea3-8048ce5c3901 tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Deleted volume successfully. Aug 31 15:24:57 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-913a9cfb-2f87-4e7d-bea3-8048ce5c3901 tempest-TestServerVolumeAttachScenarioOldVersion-2032488602 None] Lock "cinder-c7b4b3f0-8b84-4787-b81c-029310cda1e6-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:24:57 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a43b62d-3875-47f2-888c-c6f36973e283 tempest-VolumesGetTest-722448469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:24:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4a43b62d-3875-47f2-888c-c6f36973e283 tempest-VolumesGetTest-722448469 None] Flow 'volume_create_manager' (51f6d250-a2c4-463a-8d4b-1928d5281615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:24:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4a43b62d-3875-47f2-888c-c6f36973e283 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a6e148d-2106-48b6-83e5-ad862ce65c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:24:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4a43b62d-3875-47f2-888c-c6f36973e283 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a6e148d-2106-48b6-83e5-ad862ce65c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:24:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-559692713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dcee0a9-126f-4589-ac77-410b2f36fbe6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f2d13a635434495f88759f010f2182c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:24:57Z,use_quota=True,user_id='972de954be064952b24bddfa46a2d487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:24:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4a43b62d-3875-47f2-888c-c6f36973e283 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2712def2-3f40-4307-a5a3-f5082c6e9c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:24:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4a43b62d-3875-47f2-888c-c6f36973e283 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2712def2-3f40-4307-a5a3-f5082c6e9c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:24:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4a43b62d-3875-47f2-888c-c6f36973e283 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8af9426f-04fe-4442-94c1-8fe280127d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:24:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4a43b62d-3875-47f2-888c-c6f36973e283 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8af9426f-04fe-4442-94c1-8fe280127d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dcee0a9-126f-4589-ac77-410b2f36fbe6', 'volume_name': 'volume-4dcee0a9-126f-4589-ac77-410b2f36fbe6', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:24:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4a43b62d-3875-47f2-888c-c6f36973e283 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb1b7074-2d3b-46fb-9324-82b44cf9dc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:24:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4a43b62d-3875-47f2-888c-c6f36973e283 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb1b7074-2d3b-46fb-9324-82b44cf9dc1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:24:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4a43b62d-3875-47f2-888c-c6f36973e283 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf2ff06-d14a-484e-921f-032e3ad7bbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:24:57 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-4a43b62d-3875-47f2-888c-c6f36973e283 tempest-VolumesGetTest-722448469 None] Volume 4dcee0a9-126f-4589-ac77-410b2f36fbe6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dcee0a9-126f-4589-ac77-410b2f36fbe6', 'volume_size': 1} Aug 31 15:24:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4a43b62d-3875-47f2-888c-c6f36973e283 tempest-VolumesGetTest-722448469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:24:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4a43b62d-3875-47f2-888c-c6f36973e283 tempest-VolumesGetTest-722448469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:24:57 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4a43b62d-3875-47f2-888c-c6f36973e283 tempest-VolumesGetTest-722448469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:24:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-559692713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dcee0a9-126f-4589-ac77-410b2f36fbe6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f2d13a635434495f88759f010f2182c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:24:57Z,use_quota=True,user_id='972de954be064952b24bddfa46a2d487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:24:57 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-4a43b62d-3875-47f2-888c-c6f36973e283 tempest-VolumesGetTest-722448469 None] Creating volume 4dcee0a9-126f-4589-ac77-410b2f36fbe6 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:24:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4a43b62d-3875-47f2-888c-c6f36973e283 tempest-VolumesGetTest-722448469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:24:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4a43b62d-3875-47f2-888c-c6f36973e283 tempest-VolumesGetTest-722448469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:24:57 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4a43b62d-3875-47f2-888c-c6f36973e283 tempest-VolumesGetTest-722448469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:24:57 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4a43b62d-3875-47f2-888c-c6f36973e283 tempest-VolumesGetTest-722448469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:24:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4a43b62d-3875-47f2-888c-c6f36973e283 tempest-VolumesGetTest-722448469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:24:57 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4a43b62d-3875-47f2-888c-c6f36973e283 tempest-VolumesGetTest-722448469 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:24:57 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-4a43b62d-3875-47f2-888c-c6f36973e283 tempest-VolumesGetTest-722448469 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:24:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4a43b62d-3875-47f2-888c-c6f36973e283 tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4dcee0a9-126f-4589-ac77-410b2f36fbe6 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:57 devstack sudo[100258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4dcee0a9-126f-4589-ac77-410b2f36fbe6 1073741824 Aug 31 15:24:57 devstack sudo[100258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:58 devstack sudo[100258]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4a43b62d-3875-47f2-888c-c6f36973e283 tempest-VolumesGetTest-722448469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4dcee0a9-126f-4589-ac77-410b2f36fbe6 1073741824" returned: 0 in 0.738s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4a43b62d-3875-47f2-888c-c6f36973e283 tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4dcee0a9-126f-4589-ac77-410b2f36fbe6 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:24:58 devstack sudo[100266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4dcee0a9-126f-4589-ac77-410b2f36fbe6 Aug 31 15:24:58 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:24:59 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root Aug 31 15:24:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4a43b62d-3875-47f2-888c-c6f36973e283 tempest-VolumesGetTest-722448469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4dcee0a9-126f-4589-ac77-410b2f36fbe6" returned: 0 in 0.338s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:24:59 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4a43b62d-3875-47f2-888c-c6f36973e283 tempest-VolumesGetTest-722448469 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:24:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4a43b62d-3875-47f2-888c-c6f36973e283 tempest-VolumesGetTest-722448469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:24:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4a43b62d-3875-47f2-888c-c6f36973e283 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf2ff06-d14a-484e-921f-032e3ad7bbe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dcee0a9-126f-4589-ac77-410b2f36fbe6', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:24:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4a43b62d-3875-47f2-888c-c6f36973e283 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3bbc1fb-a2c7-402e-a815-4943c3d4c2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:24:59 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-4a43b62d-3875-47f2-888c-c6f36973e283 tempest-VolumesGetTest-722448469 None] Volume volume-4dcee0a9-126f-4589-ac77-410b2f36fbe6 (4dcee0a9-126f-4589-ac77-410b2f36fbe6): created successfully Aug 31 15:24:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4a43b62d-3875-47f2-888c-c6f36973e283 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3bbc1fb-a2c7-402e-a815-4943c3d4c2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:24:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4a43b62d-3875-47f2-888c-c6f36973e283 tempest-VolumesGetTest-722448469 None] Flow 'volume_create_manager' (51f6d250-a2c4-463a-8d4b-1928d5281615) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:24:59 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-4a43b62d-3875-47f2-888c-c6f36973e283 tempest-VolumesGetTest-722448469 None] Created volume successfully. Aug 31 15:25:00 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3e85250-8f74-4adf-ab1d-4d53531fca31 tempest-VolumesGetTest-722448469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:25:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c3e85250-8f74-4adf-ab1d-4d53531fca31 tempest-VolumesGetTest-722448469 None] Flow 'volume_create_manager' (44d34db7-5f6b-447b-a118-dd538a3b4048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:25:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c3e85250-8f74-4adf-ab1d-4d53531fca31 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd9938f1-8583-4f78-a0ab-9e9b4e6296a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c3e85250-8f74-4adf-ab1d-4d53531fca31 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd9938f1-8583-4f78-a0ab-9e9b4e6296a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:25:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1354412098',display_name='tempest-VolumesGetTest-Volume-1846258467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28e8c364-0047-4ad4-8ca3-a884e06deabe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2d13a635434495f88759f010f2182c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:25:01Z,use_quota=True,user_id='972de954be064952b24bddfa46a2d487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c3e85250-8f74-4adf-ab1d-4d53531fca31 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (168a3b6b-de7a-424a-9ad7-f58827a9c4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c3e85250-8f74-4adf-ab1d-4d53531fca31 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (168a3b6b-de7a-424a-9ad7-f58827a9c4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c3e85250-8f74-4adf-ab1d-4d53531fca31 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0013a811-6c9c-4453-ab9a-faddc3948ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c3e85250-8f74-4adf-ab1d-4d53531fca31 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0013a811-6c9c-4453-ab9a-faddc3948ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28e8c364-0047-4ad4-8ca3-a884e06deabe', 'volume_name': 'volume-28e8c364-0047-4ad4-8ca3-a884e06deabe', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c3e85250-8f74-4adf-ab1d-4d53531fca31 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67277e6a-819c-4955-b707-673d6c548e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c3e85250-8f74-4adf-ab1d-4d53531fca31 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67277e6a-819c-4955-b707-673d6c548e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c3e85250-8f74-4adf-ab1d-4d53531fca31 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0994d140-1c2a-4a55-a28f-ecf7dc6a6c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:00 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-c3e85250-8f74-4adf-ab1d-4d53531fca31 tempest-VolumesGetTest-722448469 None] Volume 28e8c364-0047-4ad4-8ca3-a884e06deabe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28e8c364-0047-4ad4-8ca3-a884e06deabe', 'volume_size': 1} Aug 31 15:25:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c3e85250-8f74-4adf-ab1d-4d53531fca31 tempest-VolumesGetTest-722448469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c3e85250-8f74-4adf-ab1d-4d53531fca31 tempest-VolumesGetTest-722448469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:00 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c3e85250-8f74-4adf-ab1d-4d53531fca31 tempest-VolumesGetTest-722448469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:25:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1354412098',display_name='tempest-VolumesGetTest-Volume-1846258467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28e8c364-0047-4ad4-8ca3-a884e06deabe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2d13a635434495f88759f010f2182c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:25:01Z,use_quota=True,user_id='972de954be064952b24bddfa46a2d487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:25:00 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-c3e85250-8f74-4adf-ab1d-4d53531fca31 tempest-VolumesGetTest-722448469 None] Creating volume 28e8c364-0047-4ad4-8ca3-a884e06deabe {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:25:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c3e85250-8f74-4adf-ab1d-4d53531fca31 tempest-VolumesGetTest-722448469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c3e85250-8f74-4adf-ab1d-4d53531fca31 tempest-VolumesGetTest-722448469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:00 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c3e85250-8f74-4adf-ab1d-4d53531fca31 tempest-VolumesGetTest-722448469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:25:00 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c3e85250-8f74-4adf-ab1d-4d53531fca31 tempest-VolumesGetTest-722448469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:25:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c3e85250-8f74-4adf-ab1d-4d53531fca31 tempest-VolumesGetTest-722448469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:00 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c3e85250-8f74-4adf-ab1d-4d53531fca31 tempest-VolumesGetTest-722448469 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:25:00 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-c3e85250-8f74-4adf-ab1d-4d53531fca31 tempest-VolumesGetTest-722448469 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:25:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c3e85250-8f74-4adf-ab1d-4d53531fca31 tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-28e8c364-0047-4ad4-8ca3-a884e06deabe 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:00 devstack sudo[100273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-28e8c364-0047-4ad4-8ca3-a884e06deabe 1073741824 Aug 31 15:25:00 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:01 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c3e85250-8f74-4adf-ab1d-4d53531fca31 tempest-VolumesGetTest-722448469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-28e8c364-0047-4ad4-8ca3-a884e06deabe 1073741824" returned: 0 in 0.905s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c3e85250-8f74-4adf-ab1d-4d53531fca31 tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-28e8c364-0047-4ad4-8ca3-a884e06deabe {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:01 devstack sudo[100282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-28e8c364-0047-4ad4-8ca3-a884e06deabe Aug 31 15:25:01 devstack sudo[100282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:02 devstack sudo[100282]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c3e85250-8f74-4adf-ab1d-4d53531fca31 tempest-VolumesGetTest-722448469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-28e8c364-0047-4ad4-8ca3-a884e06deabe" returned: 0 in 0.428s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:02 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c3e85250-8f74-4adf-ab1d-4d53531fca31 tempest-VolumesGetTest-722448469 None] <== create_volume: return (1425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:25:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c3e85250-8f74-4adf-ab1d-4d53531fca31 tempest-VolumesGetTest-722448469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.430s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:02 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c3e85250-8f74-4adf-ab1d-4d53531fca31 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0994d140-1c2a-4a55-a28f-ecf7dc6a6c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28e8c364-0047-4ad4-8ca3-a884e06deabe', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:02 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c3e85250-8f74-4adf-ab1d-4d53531fca31 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80572dec-0a90-4f3a-9855-72cfe542667f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:02 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-c3e85250-8f74-4adf-ab1d-4d53531fca31 tempest-VolumesGetTest-722448469 None] Volume volume-28e8c364-0047-4ad4-8ca3-a884e06deabe (28e8c364-0047-4ad4-8ca3-a884e06deabe): created successfully Aug 31 15:25:02 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c3e85250-8f74-4adf-ab1d-4d53531fca31 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80572dec-0a90-4f3a-9855-72cfe542667f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:02 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c3e85250-8f74-4adf-ab1d-4d53531fca31 tempest-VolumesGetTest-722448469 None] Flow 'volume_create_manager' (44d34db7-5f6b-447b-a118-dd538a3b4048) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:25:02 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-c3e85250-8f74-4adf-ab1d-4d53531fca31 tempest-VolumesGetTest-722448469 None] Created volume successfully. Aug 31 15:25:02 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-15599b1e-8475-4923-a21a-652e65a6d746 tempest-VolumesGetTest-722448469 None] Acquiring lock "cinder-28e8c364-0047-4ad4-8ca3-a884e06deabe-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:25:02 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-15599b1e-8475-4923-a21a-652e65a6d746 tempest-VolumesGetTest-722448469 None] Lock "cinder-28e8c364-0047-4ad4-8ca3-a884e06deabe-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:25:02 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-15599b1e-8475-4923-a21a-652e65a6d746 tempest-VolumesGetTest-722448469 None] Acquiring lock "cinder-quobyte-28e8c364-0047-4ad4-8ca3-a884e06deabe" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:25:02 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-15599b1e-8475-4923-a21a-652e65a6d746 tempest-VolumesGetTest-722448469 None] Lock "cinder-quobyte-28e8c364-0047-4ad4-8ca3-a884e06deabe" acquired by "delete_volume" :: waited 0.020s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:25:02 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[679316ad-c52c-45aa-9e4a-52b4a0ca6665]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:25:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-15599b1e-8475-4923-a21a-652e65a6d746 tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-28e8c364-0047-4ad4-8ca3-a884e06deabe {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:03 devstack sudo[100286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-28e8c364-0047-4ad4-8ca3-a884e06deabe Aug 31 15:25:03 devstack sudo[100286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:03 devstack sudo[100286]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-15599b1e-8475-4923-a21a-652e65a6d746 tempest-VolumesGetTest-722448469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-28e8c364-0047-4ad4-8ca3-a884e06deabe" returned: 0 in 0.430s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-15599b1e-8475-4923-a21a-652e65a6d746 tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-28e8c364-0047-4ad4-8ca3-a884e06deabe {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:03 devstack sudo[100292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-28e8c364-0047-4ad4-8ca3-a884e06deabe Aug 31 15:25:03 devstack sudo[100292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:03 devstack sudo[100292]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-15599b1e-8475-4923-a21a-652e65a6d746 tempest-VolumesGetTest-722448469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-28e8c364-0047-4ad4-8ca3-a884e06deabe" returned: 0 in 0.295s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:03 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-15599b1e-8475-4923-a21a-652e65a6d746 tempest-VolumesGetTest-722448469 None] Lock "cinder-quobyte-28e8c364-0047-4ad4-8ca3-a884e06deabe" released by "delete_volume" :: held 0.773s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:25:03 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-15599b1e-8475-4923-a21a-652e65a6d746 tempest-VolumesGetTest-722448469 None] Created reservations ['cf3becdb-fc6c-4bcd-9fd6-8cd4584c6b58', 'd66fa29e-4793-4304-9985-514f46b61d02', 'a53294e4-1c2c-476b-8ab7-0e06f4d7a204', '04ebe422-22c7-4c24-865b-8777f4a8d3b6'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:25:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-15599b1e-8475-4923-a21a-652e65a6d746 tempest-VolumesGetTest-722448469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-15599b1e-8475-4923-a21a-652e65a6d746 tempest-VolumesGetTest-722448469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:03 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-15599b1e-8475-4923-a21a-652e65a6d746 tempest-VolumesGetTest-722448469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:25:03 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-15599b1e-8475-4923-a21a-652e65a6d746 tempest-VolumesGetTest-722448469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:25:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-15599b1e-8475-4923-a21a-652e65a6d746 tempest-VolumesGetTest-722448469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-15599b1e-8475-4923-a21a-652e65a6d746 tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:03 devstack sudo[100295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:25:03 devstack sudo[100295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:04 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-c77fde4c-acb7-4f93-8363-35b49f1210b3 tempest-VolumesGetTest-722448469 None] Acquiring lock "cinder-4dcee0a9-126f-4589-ac77-410b2f36fbe6-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:25:04 devstack sudo[100295]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-15599b1e-8475-4923-a21a-652e65a6d746 tempest-VolumesGetTest-722448469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.299s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:04 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-15599b1e-8475-4923-a21a-652e65a6d746 tempest-VolumesGetTest-722448469 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:25:04 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-15599b1e-8475-4923-a21a-652e65a6d746 tempest-VolumesGetTest-722448469 None] Deleted volume successfully. Aug 31 15:25:04 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-c77fde4c-acb7-4f93-8363-35b49f1210b3 tempest-VolumesGetTest-722448469 None] Lock "cinder-4dcee0a9-126f-4589-ac77-410b2f36fbe6-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:25:04 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-15599b1e-8475-4923-a21a-652e65a6d746 tempest-VolumesGetTest-722448469 None] Lock "cinder-28e8c364-0047-4ad4-8ca3-a884e06deabe-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:25:04 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-c77fde4c-acb7-4f93-8363-35b49f1210b3 tempest-VolumesGetTest-722448469 None] Acquiring lock "cinder-quobyte-4dcee0a9-126f-4589-ac77-410b2f36fbe6" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:25:04 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-c77fde4c-acb7-4f93-8363-35b49f1210b3 tempest-VolumesGetTest-722448469 None] Lock "cinder-quobyte-4dcee0a9-126f-4589-ac77-410b2f36fbe6" acquired by "delete_volume" :: waited 0.036s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:25:04 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3514c796-68f3-47d6-b407-4f6c12267a67]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:25:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c77fde4c-acb7-4f93-8363-35b49f1210b3 tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4dcee0a9-126f-4589-ac77-410b2f36fbe6 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:04 devstack sudo[100299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4dcee0a9-126f-4589-ac77-410b2f36fbe6 Aug 31 15:25:04 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:04 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c77fde4c-acb7-4f93-8363-35b49f1210b3 tempest-VolumesGetTest-722448469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4dcee0a9-126f-4589-ac77-410b2f36fbe6" returned: 0 in 0.420s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c77fde4c-acb7-4f93-8363-35b49f1210b3 tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4dcee0a9-126f-4589-ac77-410b2f36fbe6 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:04 devstack sudo[100306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4dcee0a9-126f-4589-ac77-410b2f36fbe6 Aug 31 15:25:04 devstack sudo[100306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:04 devstack sudo[100306]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c77fde4c-acb7-4f93-8363-35b49f1210b3 tempest-VolumesGetTest-722448469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4dcee0a9-126f-4589-ac77-410b2f36fbe6" returned: 0 in 0.271s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:04 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-c77fde4c-acb7-4f93-8363-35b49f1210b3 tempest-VolumesGetTest-722448469 None] Lock "cinder-quobyte-4dcee0a9-126f-4589-ac77-410b2f36fbe6" released by "delete_volume" :: held 0.738s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:25:05 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-c77fde4c-acb7-4f93-8363-35b49f1210b3 tempest-VolumesGetTest-722448469 None] Created reservations ['ea8085f9-180b-4fa1-af35-5ca70ef1fc40', '47d07b8b-7ddf-4e87-b266-d611968667be', 'e5952105-94f3-4a60-9253-35e7eeddc82c', 'd7da5632-bce2-4f0e-80ff-da9233ba266a'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:25:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c77fde4c-acb7-4f93-8363-35b49f1210b3 tempest-VolumesGetTest-722448469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c77fde4c-acb7-4f93-8363-35b49f1210b3 tempest-VolumesGetTest-722448469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:05 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c77fde4c-acb7-4f93-8363-35b49f1210b3 tempest-VolumesGetTest-722448469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:25:05 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c77fde4c-acb7-4f93-8363-35b49f1210b3 tempest-VolumesGetTest-722448469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:25:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c77fde4c-acb7-4f93-8363-35b49f1210b3 tempest-VolumesGetTest-722448469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c77fde4c-acb7-4f93-8363-35b49f1210b3 tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:05 devstack sudo[100309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:25:05 devstack sudo[100309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:05 devstack sudo[100309]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c77fde4c-acb7-4f93-8363-35b49f1210b3 tempest-VolumesGetTest-722448469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.347s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:05 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-c77fde4c-acb7-4f93-8363-35b49f1210b3 tempest-VolumesGetTest-722448469 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:25:05 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-c77fde4c-acb7-4f93-8363-35b49f1210b3 tempest-VolumesGetTest-722448469 None] Deleted volume successfully. Aug 31 15:25:05 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-c77fde4c-acb7-4f93-8363-35b49f1210b3 tempest-VolumesGetTest-722448469 None] Lock "cinder-4dcee0a9-126f-4589-ac77-410b2f36fbe6-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:25:05 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d6418e1-cdb2-412a-84d1-41a70e91c898 tempest-VolumesGetTest-722448469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:25:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4d6418e1-cdb2-412a-84d1-41a70e91c898 tempest-VolumesGetTest-722448469 None] Flow 'volume_create_manager' (86eff74e-3fd7-44b6-a7e2-2987eb8adccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:25:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4d6418e1-cdb2-412a-84d1-41a70e91c898 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1316a692-b469-49da-b312-621363c1cb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4d6418e1-cdb2-412a-84d1-41a70e91c898 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1316a692-b469-49da-b312-621363c1cb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1858172285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a25b3b70-05fb-49b1-a1f2-45daa4423cb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2d13a635434495f88759f010f2182c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:25:06Z,use_quota=True,user_id='972de954be064952b24bddfa46a2d487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4d6418e1-cdb2-412a-84d1-41a70e91c898 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (991e0208-bb05-4884-bd95-7a3095a37d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4d6418e1-cdb2-412a-84d1-41a70e91c898 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (991e0208-bb05-4884-bd95-7a3095a37d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4d6418e1-cdb2-412a-84d1-41a70e91c898 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c38d82ad-74fe-4936-9b80-9a3f5dda3b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4d6418e1-cdb2-412a-84d1-41a70e91c898 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c38d82ad-74fe-4936-9b80-9a3f5dda3b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a25b3b70-05fb-49b1-a1f2-45daa4423cb9', 'volume_name': 'volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4d6418e1-cdb2-412a-84d1-41a70e91c898 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c877674-f6ce-4b78-ad56-9bf6597952a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4d6418e1-cdb2-412a-84d1-41a70e91c898 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c877674-f6ce-4b78-ad56-9bf6597952a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4d6418e1-cdb2-412a-84d1-41a70e91c898 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f5ab400-0e24-4300-afa7-4edc15161e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:05 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-4d6418e1-cdb2-412a-84d1-41a70e91c898 tempest-VolumesGetTest-722448469 None] Volume a25b3b70-05fb-49b1-a1f2-45daa4423cb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9', 'volume_size': 1} Aug 31 15:25:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4d6418e1-cdb2-412a-84d1-41a70e91c898 tempest-VolumesGetTest-722448469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4d6418e1-cdb2-412a-84d1-41a70e91c898 tempest-VolumesGetTest-722448469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:05 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4d6418e1-cdb2-412a-84d1-41a70e91c898 tempest-VolumesGetTest-722448469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1858172285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a25b3b70-05fb-49b1-a1f2-45daa4423cb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2d13a635434495f88759f010f2182c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:25:06Z,use_quota=True,user_id='972de954be064952b24bddfa46a2d487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:25:05 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-4d6418e1-cdb2-412a-84d1-41a70e91c898 tempest-VolumesGetTest-722448469 None] Creating volume a25b3b70-05fb-49b1-a1f2-45daa4423cb9 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:25:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4d6418e1-cdb2-412a-84d1-41a70e91c898 tempest-VolumesGetTest-722448469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4d6418e1-cdb2-412a-84d1-41a70e91c898 tempest-VolumesGetTest-722448469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:05 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4d6418e1-cdb2-412a-84d1-41a70e91c898 tempest-VolumesGetTest-722448469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:25:05 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4d6418e1-cdb2-412a-84d1-41a70e91c898 tempest-VolumesGetTest-722448469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:25:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4d6418e1-cdb2-412a-84d1-41a70e91c898 tempest-VolumesGetTest-722448469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:05 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4d6418e1-cdb2-412a-84d1-41a70e91c898 tempest-VolumesGetTest-722448469 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:25:05 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-4d6418e1-cdb2-412a-84d1-41a70e91c898 tempest-VolumesGetTest-722448469 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:25:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4d6418e1-cdb2-412a-84d1-41a70e91c898 tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:05 devstack sudo[100312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9 1073741824 Aug 31 15:25:05 devstack sudo[100312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:06 devstack sudo[100312]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4d6418e1-cdb2-412a-84d1-41a70e91c898 tempest-VolumesGetTest-722448469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9 1073741824" returned: 0 in 0.424s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4d6418e1-cdb2-412a-84d1-41a70e91c898 tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:06 devstack sudo[100318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9 Aug 31 15:25:06 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:06 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4d6418e1-cdb2-412a-84d1-41a70e91c898 tempest-VolumesGetTest-722448469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9" returned: 0 in 0.311s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:06 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4d6418e1-cdb2-412a-84d1-41a70e91c898 tempest-VolumesGetTest-722448469 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:25:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4d6418e1-cdb2-412a-84d1-41a70e91c898 tempest-VolumesGetTest-722448469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4d6418e1-cdb2-412a-84d1-41a70e91c898 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f5ab400-0e24-4300-afa7-4edc15161e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4d6418e1-cdb2-412a-84d1-41a70e91c898 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (292f08b1-5954-4ccd-bfa2-c5876538c591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:06 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-4d6418e1-cdb2-412a-84d1-41a70e91c898 tempest-VolumesGetTest-722448469 None] Volume volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9 (a25b3b70-05fb-49b1-a1f2-45daa4423cb9): created successfully Aug 31 15:25:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4d6418e1-cdb2-412a-84d1-41a70e91c898 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (292f08b1-5954-4ccd-bfa2-c5876538c591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4d6418e1-cdb2-412a-84d1-41a70e91c898 tempest-VolumesGetTest-722448469 None] Flow 'volume_create_manager' (86eff74e-3fd7-44b6-a7e2-2987eb8adccd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:25:06 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-4d6418e1-cdb2-412a-84d1-41a70e91c898 tempest-VolumesGetTest-722448469 None] Created volume successfully. Aug 31 15:25:08 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:25:08 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Flow 'volume_create_manager' (65d1e707-eb24-4876-b58f-702349ceb727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:25:08 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e63884a3-87c0-4310-a5d4-05468299fce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:08 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e63884a3-87c0-4310-a5d4-05468299fce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1712816086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54b71342-1011-43d9-af07-b8bc653d46ac,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f2d13a635434495f88759f010f2182c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=a25b3b70-05fb-49b1-a1f2-45daa4423cb9,status='creating',terminated_at=None,updated_at=2026-08-31T13:25:08Z,use_quota=True,user_id='972de954be064952b24bddfa46a2d487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:08 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65b8c027-0452-40b6-8a7a-6343f61d42e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:08 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65b8c027-0452-40b6-8a7a-6343f61d42e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:08 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4782d29-d0d7-4adb-9828-1b12777f46fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:08 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4782d29-d0d7-4adb-9828-1b12777f46fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '54b71342-1011-43d9-af07-b8bc653d46ac', 'volume_name': 'volume-54b71342-1011-43d9-af07-b8bc653d46ac', 'volume_size': 1, 'source_volid': 'a25b3b70-05fb-49b1-a1f2-45daa4423cb9', 'source_volstatus': 'available'}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:08 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c68d964-645a-41f8-8893-3217ec49d470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:08 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c68d964-645a-41f8-8893-3217ec49d470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:08 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f49e6d3e-6fb0-42c7-bf94-a58cfeb826fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:08 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Volume 54b71342-1011-43d9-af07-b8bc653d46ac: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-54b71342-1011-43d9-af07-b8bc653d46ac', 'volume_size': 1, 'source_volid': 'a25b3b70-05fb-49b1-a1f2-45daa4423cb9', 'source_volstatus': 'available'} Aug 31 15:25:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:08 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Cloning volume a25b3b70-05fb-49b1-a1f2-45daa4423cb9 to volume 54b71342-1011-43d9-af07-b8bc653d46ac Aug 31 15:25:08 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Creating offline snapshot 7f232a5a-e78e-49fd-9ffe-9d7ef5ce287a of volume a25b3b70-05fb-49b1-a1f2-45daa4423cb9 {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:25:08 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae2363c-f77c-4642-b481-61a5ed8f0c52]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:25:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:08 devstack sudo[100323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9 Aug 31 15:25:08 devstack sudo[100323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:09 devstack sudo[100323]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9" returned: 0 in 0.421s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9.7f232a5a-e78e-49fd-9ffe-9d7ef5ce287a 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:09 devstack sudo[100328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9.7f232a5a-e78e-49fd-9ffe-9d7ef5ce287a 1G Aug 31 15:25:09 devstack sudo[100328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:09 devstack sudo[100328]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9.7f232a5a-e78e-49fd-9ffe-9d7ef5ce287a 1G" returned: 0 in 0.495s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9.7f232a5a-e78e-49fd-9ffe-9d7ef5ce287a {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:09 devstack sudo[100335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9.7f232a5a-e78e-49fd-9ffe-9d7ef5ce287a Aug 31 15:25:09 devstack sudo[100335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:09 devstack sudo[100335]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9.7f232a5a-e78e-49fd-9ffe-9d7ef5ce287a" returned: 0 in 0.319s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:09 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9.7f232a5a-e78e-49fd-9ffe-9d7ef5ce287a is being set with open permissions: ugo+rw Aug 31 15:25:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9.7f232a5a-e78e-49fd-9ffe-9d7ef5ce287a {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:10 devstack sudo[100341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9.7f232a5a-e78e-49fd-9ffe-9d7ef5ce287a Aug 31 15:25:10 devstack sudo[100341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:10 devstack sudo[100341]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9.7f232a5a-e78e-49fd-9ffe-9d7ef5ce287a" returned: 0 in 0.258s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:10 devstack sudo[100344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9.info Aug 31 15:25:10 devstack sudo[100344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:10 devstack sudo[100344]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9.info" returned: 0 in 0.307s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:10 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9.info is being set with open permissions: ugo+rw Aug 31 15:25:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:10 devstack sudo[100347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9.info Aug 31 15:25:10 devstack sudo[100347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:10 devstack sudo[100347]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9.info" returned: 0 in 0.259s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:10 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Acquiring lock "cinder-quobyte-54b71342-1011-43d9-af07-b8bc653d46ac" by "_copy_volume_from_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:25:10 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Lock "cinder-quobyte-54b71342-1011-43d9-af07-b8bc653d46ac" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:25:10 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] snapshot: 7f232a5a-e78e-49fd-9ffe-9d7ef5ce287a, volume: 54b71342-1011-43d9-af07-b8bc653d46ac, {{(pid=86000) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 31 15:25:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:10 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:25:10 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:25:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:10 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccdd17b-6574-4551-893b-f0af870656e9]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:25:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9.7f232a5a-e78e-49fd-9ffe-9d7ef5ce287a {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:11 devstack sudo[100350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9.7f232a5a-e78e-49fd-9ffe-9d7ef5ce287a Aug 31 15:25:11 devstack sudo[100350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:11 devstack sudo[100350]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9.7f232a5a-e78e-49fd-9ffe-9d7ef5ce287a" returned: 0 in 0.419s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:11 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:25:11 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2076f5e7-d8c0-4da5-a321-ec5244f79add]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:25:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:11 devstack sudo[100355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9 Aug 31 15:25:11 devstack sudo[100355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:11 devstack sudo[100355]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9" returned: 0 in 0.468s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:11 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9 {{(pid=86000) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 31 15:25:11 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Creating direct copy from snapshot {{(pid=86000) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 31 15:25:11 devstack cinder-volume[86000]: DEBUG cinder.utils [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Path /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-54b71342-1011-43d9-af07-b8bc653d46ac not found in is_blk_device check {{(pid=86000) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 31 15:25:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-54b71342-1011-43d9-af07-b8bc653d46ac {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:11 devstack sudo[100360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-54b71342-1011-43d9-af07-b8bc653d46ac Aug 31 15:25:11 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-ef0e8046-562f-4de1-8838-927dcb87208b req-c842e278-da8f-43f0-8259-576edde3eef1 tempest-TestStampPattern-603172502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:18 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-54b71342-1011-43d9-af07-b8bc653d46ac" returned: 0 in 6.364s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:18 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9, size 1024.00 MB, duration 6.37 sec, destination /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-54b71342-1011-43d9-af07-b8bc653d46ac {{(pid=86000) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 31 15:25:18 devstack cinder-volume[86000]: INFO cinder.image.image_utils [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Converted 1024.00 MB image at 160.87 MB/s Aug 31 15:25:18 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-54b71342-1011-43d9-af07-b8bc653d46ac is being set with open permissions: ugo+rw Aug 31 15:25:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-54b71342-1011-43d9-af07-b8bc653d46ac {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:18 devstack sudo[100805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-54b71342-1011-43d9-af07-b8bc653d46ac Aug 31 15:25:18 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:18 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-54b71342-1011-43d9-af07-b8bc653d46ac" returned: 0 in 0.275s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:18 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Lock "cinder-quobyte-54b71342-1011-43d9-af07-b8bc653d46ac" released by "_copy_volume_from_snapshot" :: held 7.605s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:25:18 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:SELECT=97,cinder:INSERT=28,cinder:UPDATE=91,cinder:DELETE=11 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:25:18 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Acquiring lock "cinder-quobyte-7f232a5a-e78e-49fd-9ffe-9d7ef5ce287a" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:25:18 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Lock "cinder-quobyte-7f232a5a-e78e-49fd-9ffe-9d7ef5ce287a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:25:18 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Deleting offline snapshot 7f232a5a-e78e-49fd-9ffe-9d7ef5ce287a of volume a25b3b70-05fb-49b1-a1f2-45daa4423cb9 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:25:18 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] snapshot_file for this snap is: volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9.7f232a5a-e78e-49fd-9ffe-9d7ef5ce287a {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:25:18 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c13652-2059-4086-9389-41f3ce95098a]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:25:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9.7f232a5a-e78e-49fd-9ffe-9d7ef5ce287a {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:18 devstack sudo[100808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9.7f232a5a-e78e-49fd-9ffe-9d7ef5ce287a Aug 31 15:25:18 devstack sudo[100808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:18 devstack sudo[100808]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9.7f232a5a-e78e-49fd-9ffe-9d7ef5ce287a" returned: 0 in 0.419s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:18 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:25:19 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3538f23d-751b-4657-b328-36dc75736c63]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:25:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:19 devstack sudo[100815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9 Aug 31 15:25:19 devstack sudo[100815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:19 devstack sudo[100815]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9" returned: 0 in 0.625s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9.7f232a5a-e78e-49fd-9ffe-9d7ef5ce287a {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:19 devstack sudo[100820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9.7f232a5a-e78e-49fd-9ffe-9d7ef5ce287a Aug 31 15:25:19 devstack sudo[100820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:19 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2935d41-aa8a-4dcb-9c96-8cd09014a11a tempest-CreateVolumesFromSnapshotTest-200635454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:25:19 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e2935d41-aa8a-4dcb-9c96-8cd09014a11a tempest-CreateVolumesFromSnapshotTest-200635454 None] Flow 'volume_create_manager' (852c4610-011e-4623-9393-7abd8b7d2597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:25:19 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e2935d41-aa8a-4dcb-9c96-8cd09014a11a tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c81dfb2-a3c3-4b2c-bb94-b292352dcc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:20 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e2935d41-aa8a-4dcb-9c96-8cd09014a11a tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c81dfb2-a3c3-4b2c-bb94-b292352dcc78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:25:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-505653160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12f923b3-10b6-4343-a41a-cb05d9bdf345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d84c2d913ed84d9492ecaca34672acca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:25:20Z,use_quota=True,user_id='2d4b866911f94bb9847a59e4f0b7e53c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:20 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e2935d41-aa8a-4dcb-9c96-8cd09014a11a tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a76afe9-1542-4cde-b751-a66fb3d8ddf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:20 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e2935d41-aa8a-4dcb-9c96-8cd09014a11a tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a76afe9-1542-4cde-b751-a66fb3d8ddf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:20 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e2935d41-aa8a-4dcb-9c96-8cd09014a11a tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (973edfad-bb47-4e2e-bee6-022c8ab21412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:20 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e2935d41-aa8a-4dcb-9c96-8cd09014a11a tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (973edfad-bb47-4e2e-bee6-022c8ab21412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12f923b3-10b6-4343-a41a-cb05d9bdf345', 'volume_name': 'volume-12f923b3-10b6-4343-a41a-cb05d9bdf345', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:20 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e2935d41-aa8a-4dcb-9c96-8cd09014a11a tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9ae1e3a-8364-4ece-bbcd-a487bd55984e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:20 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e2935d41-aa8a-4dcb-9c96-8cd09014a11a tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9ae1e3a-8364-4ece-bbcd-a487bd55984e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:20 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e2935d41-aa8a-4dcb-9c96-8cd09014a11a tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f643114-c2c7-4c39-90c4-746d02a1638e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:20 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-e2935d41-aa8a-4dcb-9c96-8cd09014a11a tempest-CreateVolumesFromSnapshotTest-200635454 None] Volume 12f923b3-10b6-4343-a41a-cb05d9bdf345: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12f923b3-10b6-4343-a41a-cb05d9bdf345', 'volume_size': 1} Aug 31 15:25:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e2935d41-aa8a-4dcb-9c96-8cd09014a11a tempest-CreateVolumesFromSnapshotTest-200635454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:20 devstack sudo[100820]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9.7f232a5a-e78e-49fd-9ffe-9d7ef5ce287a" returned: 0 in 0.427s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9.7f232a5a-e78e-49fd-9ffe-9d7ef5ce287a {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:20 devstack sudo[100826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9.7f232a5a-e78e-49fd-9ffe-9d7ef5ce287a Aug 31 15:25:20 devstack sudo[100826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:20 devstack sudo[100826]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9.7f232a5a-e78e-49fd-9ffe-9d7ef5ce287a" returned: 0 in 0.251s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:20 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Lock "cinder-quobyte-7f232a5a-e78e-49fd-9ffe-9d7ef5ce287a" released by "_delete_snapshot" :: held 1.856s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:25:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.746s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-ef0e8046-562f-4de1-8838-927dcb87208b req-c842e278-da8f-43f0-8259-576edde3eef1 tempest-TestStampPattern-603172502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.856s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-ef0e8046-562f-4de1-8838-927dcb87208b req-c842e278-da8f-43f0-8259-576edde3eef1 tempest-TestStampPattern-603172502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e2935d41-aa8a-4dcb-9c96-8cd09014a11a tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.382s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:20 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-e2935d41-aa8a-4dcb-9c96-8cd09014a11a tempest-CreateVolumesFromSnapshotTest-200635454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:25:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-505653160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12f923b3-10b6-4343-a41a-cb05d9bdf345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d84c2d913ed84d9492ecaca34672acca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:25:20Z,use_quota=True,user_id='2d4b866911f94bb9847a59e4f0b7e53c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:25:20 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-e2935d41-aa8a-4dcb-9c96-8cd09014a11a tempest-CreateVolumesFromSnapshotTest-200635454 None] Creating volume 12f923b3-10b6-4343-a41a-cb05d9bdf345 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:25:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e2935d41-aa8a-4dcb-9c96-8cd09014a11a tempest-CreateVolumesFromSnapshotTest-200635454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e2935d41-aa8a-4dcb-9c96-8cd09014a11a tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:20 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-e2935d41-aa8a-4dcb-9c96-8cd09014a11a tempest-CreateVolumesFromSnapshotTest-200635454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:25:20 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-e2935d41-aa8a-4dcb-9c96-8cd09014a11a tempest-CreateVolumesFromSnapshotTest-200635454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:25:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e2935d41-aa8a-4dcb-9c96-8cd09014a11a tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:20 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-e2935d41-aa8a-4dcb-9c96-8cd09014a11a tempest-CreateVolumesFromSnapshotTest-200635454 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:25:20 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-e2935d41-aa8a-4dcb-9c96-8cd09014a11a tempest-CreateVolumesFromSnapshotTest-200635454 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:25:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e2935d41-aa8a-4dcb-9c96-8cd09014a11a tempest-CreateVolumesFromSnapshotTest-200635454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:20 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f49e6d3e-6fb0-42c7-bf94-a58cfeb826fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54b71342-1011-43d9-af07-b8bc653d46ac', 'volume_size': 1, 'source_volid': 'a25b3b70-05fb-49b1-a1f2-45daa4423cb9', 'source_volstatus': 'available'}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:20 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5b18412-b8ed-4f3a-8d6f-1642cab94923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:20 devstack sudo[100829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345 1073741824 Aug 31 15:25:20 devstack sudo[100829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:20 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Volume volume-54b71342-1011-43d9-af07-b8bc653d46ac (54b71342-1011-43d9-af07-b8bc653d46ac): created successfully Aug 31 15:25:20 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5b18412-b8ed-4f3a-8d6f-1642cab94923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:20 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Flow 'volume_create_manager' (65d1e707-eb24-4876-b58f-702349ceb727) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:25:20 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-c9919bf4-7195-4f30-9148-937a3434915c tempest-VolumesGetTest-722448469 None] Created volume successfully. Aug 31 15:25:20 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-ef0e8046-562f-4de1-8838-927dcb87208b req-c842e278-da8f-43f0-8259-576edde3eef1 tempest-TestStampPattern-603172502 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77', 'name': 'volume-db8e488e-99c5-40ab-95bf-1a4bdddfd245', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a6283c46-d045-4504-8306-14e91f10490b', 'enforce_multipath': True} {{(pid=86000) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 31 15:25:20 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-ef0e8046-562f-4de1-8838-927dcb87208b req-c842e278-da8f-43f0-8259-576edde3eef1 tempest-TestStampPattern-603172502 None] attachment_update completed successfully. Aug 31 15:25:21 devstack sudo[100829]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e2935d41-aa8a-4dcb-9c96-8cd09014a11a tempest-CreateVolumesFromSnapshotTest-200635454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345 1073741824" returned: 0 in 0.801s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e2935d41-aa8a-4dcb-9c96-8cd09014a11a tempest-CreateVolumesFromSnapshotTest-200635454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:21 devstack sudo[101217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345 Aug 31 15:25:21 devstack sudo[101217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:21 devstack sudo[101217]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e2935d41-aa8a-4dcb-9c96-8cd09014a11a tempest-CreateVolumesFromSnapshotTest-200635454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345" returned: 0 in 0.447s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:21 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-e2935d41-aa8a-4dcb-9c96-8cd09014a11a tempest-CreateVolumesFromSnapshotTest-200635454 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:25:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e2935d41-aa8a-4dcb-9c96-8cd09014a11a tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.321s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:21 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e2935d41-aa8a-4dcb-9c96-8cd09014a11a tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f643114-c2c7-4c39-90c4-746d02a1638e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12f923b3-10b6-4343-a41a-cb05d9bdf345', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:21 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e2935d41-aa8a-4dcb-9c96-8cd09014a11a tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d9ffd06-af57-4195-a9e6-120e04afe757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:21 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-e2935d41-aa8a-4dcb-9c96-8cd09014a11a tempest-CreateVolumesFromSnapshotTest-200635454 None] Volume volume-12f923b3-10b6-4343-a41a-cb05d9bdf345 (12f923b3-10b6-4343-a41a-cb05d9bdf345): created successfully Aug 31 15:25:21 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e2935d41-aa8a-4dcb-9c96-8cd09014a11a tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d9ffd06-af57-4195-a9e6-120e04afe757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:21 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e2935d41-aa8a-4dcb-9c96-8cd09014a11a tempest-CreateVolumesFromSnapshotTest-200635454 None] Flow 'volume_create_manager' (852c4610-011e-4623-9393-7abd8b7d2597) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:25:21 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-e2935d41-aa8a-4dcb-9c96-8cd09014a11a tempest-CreateVolumesFromSnapshotTest-200635454 None] Created volume successfully. Aug 31 15:25:22 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c426c29-a2d1-4197-b915-446ca5930ddd tempest-VolumesGetTest-722448469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:25:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5c426c29-a2d1-4197-b915-446ca5930ddd tempest-VolumesGetTest-722448469 None] Flow 'volume_create_manager' (e3163021-af25-46f8-ac74-b985cff988a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:25:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5c426c29-a2d1-4197-b915-446ca5930ddd tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fbb3383-9ffd-4449-9e5a-64f8da2763c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5c426c29-a2d1-4197-b915-446ca5930ddd tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fbb3383-9ffd-4449-9e5a-64f8da2763c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:25:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-643757476',display_name='tempest-VolumesGetTest-Volume-2033198865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f32c2f1-038c-4ef3-bc0d-ef8f835d7606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2d13a635434495f88759f010f2182c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:25:22Z,use_quota=True,user_id='972de954be064952b24bddfa46a2d487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5c426c29-a2d1-4197-b915-446ca5930ddd tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47e7cb9e-8461-489b-b46c-d332a8bdffd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5c426c29-a2d1-4197-b915-446ca5930ddd tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47e7cb9e-8461-489b-b46c-d332a8bdffd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5c426c29-a2d1-4197-b915-446ca5930ddd tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bebec69-0e38-45cb-80c1-a87931bc4c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5c426c29-a2d1-4197-b915-446ca5930ddd tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bebec69-0e38-45cb-80c1-a87931bc4c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f32c2f1-038c-4ef3-bc0d-ef8f835d7606', 'volume_name': 'volume-0f32c2f1-038c-4ef3-bc0d-ef8f835d7606', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5c426c29-a2d1-4197-b915-446ca5930ddd tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb9293bc-4869-41d6-8358-c0be69a11848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5c426c29-a2d1-4197-b915-446ca5930ddd tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb9293bc-4869-41d6-8358-c0be69a11848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5c426c29-a2d1-4197-b915-446ca5930ddd tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45d08e7b-3d92-4b7d-b2d4-0e42cf7667b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:22 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-5c426c29-a2d1-4197-b915-446ca5930ddd tempest-VolumesGetTest-722448469 None] Volume 0f32c2f1-038c-4ef3-bc0d-ef8f835d7606: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f32c2f1-038c-4ef3-bc0d-ef8f835d7606', 'volume_size': 1} Aug 31 15:25:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5c426c29-a2d1-4197-b915-446ca5930ddd tempest-VolumesGetTest-722448469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5c426c29-a2d1-4197-b915-446ca5930ddd tempest-VolumesGetTest-722448469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:22 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5c426c29-a2d1-4197-b915-446ca5930ddd tempest-VolumesGetTest-722448469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:25:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-643757476',display_name='tempest-VolumesGetTest-Volume-2033198865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f32c2f1-038c-4ef3-bc0d-ef8f835d7606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2d13a635434495f88759f010f2182c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:25:22Z,use_quota=True,user_id='972de954be064952b24bddfa46a2d487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:25:22 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-5c426c29-a2d1-4197-b915-446ca5930ddd tempest-VolumesGetTest-722448469 None] Creating volume 0f32c2f1-038c-4ef3-bc0d-ef8f835d7606 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:25:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5c426c29-a2d1-4197-b915-446ca5930ddd tempest-VolumesGetTest-722448469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5c426c29-a2d1-4197-b915-446ca5930ddd tempest-VolumesGetTest-722448469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:22 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5c426c29-a2d1-4197-b915-446ca5930ddd tempest-VolumesGetTest-722448469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:25:22 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5c426c29-a2d1-4197-b915-446ca5930ddd tempest-VolumesGetTest-722448469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:25:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5c426c29-a2d1-4197-b915-446ca5930ddd tempest-VolumesGetTest-722448469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:22 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5c426c29-a2d1-4197-b915-446ca5930ddd tempest-VolumesGetTest-722448469 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:25:22 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-5c426c29-a2d1-4197-b915-446ca5930ddd tempest-VolumesGetTest-722448469 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:25:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5c426c29-a2d1-4197-b915-446ca5930ddd tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0f32c2f1-038c-4ef3-bc0d-ef8f835d7606 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-273814e2-6818-4b88-a82e-4e11ae903ef5 tempest-CreateVolumesFromSnapshotTest-200635454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:22 devstack sudo[101231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0f32c2f1-038c-4ef3-bc0d-ef8f835d7606 1073741824 Aug 31 15:25:22 devstack sudo[101231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:22 devstack sudo[101231]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5c426c29-a2d1-4197-b915-446ca5930ddd tempest-VolumesGetTest-722448469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0f32c2f1-038c-4ef3-bc0d-ef8f835d7606 1073741824" returned: 0 in 0.494s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5c426c29-a2d1-4197-b915-446ca5930ddd tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0f32c2f1-038c-4ef3-bc0d-ef8f835d7606 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:23 devstack sudo[101243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0f32c2f1-038c-4ef3-bc0d-ef8f835d7606 Aug 31 15:25:23 devstack sudo[101243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:23 devstack sudo[101243]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5c426c29-a2d1-4197-b915-446ca5930ddd tempest-VolumesGetTest-722448469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0f32c2f1-038c-4ef3-bc0d-ef8f835d7606" returned: 0 in 0.294s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:23 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5c426c29-a2d1-4197-b915-446ca5930ddd tempest-VolumesGetTest-722448469 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:25:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5c426c29-a2d1-4197-b915-446ca5930ddd tempest-VolumesGetTest-722448469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-273814e2-6818-4b88-a82e-4e11ae903ef5 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.832s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5c426c29-a2d1-4197-b915-446ca5930ddd tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45d08e7b-3d92-4b7d-b2d4-0e42cf7667b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f32c2f1-038c-4ef3-bc0d-ef8f835d7606', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5c426c29-a2d1-4197-b915-446ca5930ddd tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f958a593-48a4-42ed-a6c9-86b481532b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:23 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-273814e2-6818-4b88-a82e-4e11ae903ef5 tempest-CreateVolumesFromSnapshotTest-200635454 None] Creating offline snapshot 470b8dce-0004-4eaa-9874-7554c37aa963 of volume 12f923b3-10b6-4343-a41a-cb05d9bdf345 {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:25:23 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-5c426c29-a2d1-4197-b915-446ca5930ddd tempest-VolumesGetTest-722448469 None] Volume volume-0f32c2f1-038c-4ef3-bc0d-ef8f835d7606 (0f32c2f1-038c-4ef3-bc0d-ef8f835d7606): created successfully Aug 31 15:25:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5c426c29-a2d1-4197-b915-446ca5930ddd tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f958a593-48a4-42ed-a6c9-86b481532b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5c426c29-a2d1-4197-b915-446ca5930ddd tempest-VolumesGetTest-722448469 None] Flow 'volume_create_manager' (e3163021-af25-46f8-ac74-b985cff988a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:25:23 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87f1f1d-640e-48e6-ab78-6c53fa751ad3]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:25:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-273814e2-6818-4b88-a82e-4e11ae903ef5 tempest-CreateVolumesFromSnapshotTest-200635454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:23 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-5c426c29-a2d1-4197-b915-446ca5930ddd tempest-VolumesGetTest-722448469 None] Created volume successfully. Aug 31 15:25:23 devstack sudo[101260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345 Aug 31 15:25:23 devstack sudo[101260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:23 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-5f97eb08-6a54-43c2-a33b-9d9ffef19a9c req-0db112ea-931c-4a5c-afdb-f69e6cbb5603 tempest-TestStampPattern-603172502 None] Terminate volume connection completed successfully. Aug 31 15:25:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-5f97eb08-6a54-43c2-a33b-9d9ffef19a9c req-0db112ea-931c-4a5c-afdb-f69e6cbb5603 tempest-TestStampPattern-603172502 None] Deleting attachment a6283c46-d045-4504-8306-14e91f10490b. {{(pid=86000) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 31 15:25:23 devstack sudo[101260]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-273814e2-6818-4b88-a82e-4e11ae903ef5 tempest-CreateVolumesFromSnapshotTest-200635454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345" returned: 0 in 0.610s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-273814e2-6818-4b88-a82e-4e11ae903ef5 tempest-CreateVolumesFromSnapshotTest-200635454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345.470b8dce-0004-4eaa-9874-7554c37aa963 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:24 devstack sudo[101313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345.470b8dce-0004-4eaa-9874-7554c37aa963 1G Aug 31 15:25:24 devstack sudo[101313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:24 devstack sudo[101313]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-273814e2-6818-4b88-a82e-4e11ae903ef5 tempest-CreateVolumesFromSnapshotTest-200635454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345.470b8dce-0004-4eaa-9874-7554c37aa963 1G" returned: 0 in 0.645s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-273814e2-6818-4b88-a82e-4e11ae903ef5 tempest-CreateVolumesFromSnapshotTest-200635454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12f923b3-10b6-4343-a41a-cb05d9bdf345 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345.470b8dce-0004-4eaa-9874-7554c37aa963 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:24 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-d153d866-001d-44de-913f-a20fd4a17056 tempest-VolumesGetTest-722448469 None] Acquiring lock "cinder-0f32c2f1-038c-4ef3-bc0d-ef8f835d7606-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:25:24 devstack sudo[101324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12f923b3-10b6-4343-a41a-cb05d9bdf345 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345.470b8dce-0004-4eaa-9874-7554c37aa963 Aug 31 15:25:24 devstack sudo[101324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:24 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-d153d866-001d-44de-913f-a20fd4a17056 tempest-VolumesGetTest-722448469 None] Lock "cinder-0f32c2f1-038c-4ef3-bc0d-ef8f835d7606-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:25:24 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-d153d866-001d-44de-913f-a20fd4a17056 tempest-VolumesGetTest-722448469 None] Acquiring lock "cinder-quobyte-0f32c2f1-038c-4ef3-bc0d-ef8f835d7606" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:25:24 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-d153d866-001d-44de-913f-a20fd4a17056 tempest-VolumesGetTest-722448469 None] Lock "cinder-quobyte-0f32c2f1-038c-4ef3-bc0d-ef8f835d7606" acquired by "delete_volume" :: waited 0.014s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:25:24 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac86edca-5753-48f4-a96b-a79c846fa018]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:25:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d153d866-001d-44de-913f-a20fd4a17056 tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0f32c2f1-038c-4ef3-bc0d-ef8f835d7606 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:24 devstack sudo[101328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0f32c2f1-038c-4ef3-bc0d-ef8f835d7606 Aug 31 15:25:24 devstack sudo[101328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:25 devstack sudo[101324]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-273814e2-6818-4b88-a82e-4e11ae903ef5 tempest-CreateVolumesFromSnapshotTest-200635454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12f923b3-10b6-4343-a41a-cb05d9bdf345 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345.470b8dce-0004-4eaa-9874-7554c37aa963" returned: 0 in 0.404s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:25 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-273814e2-6818-4b88-a82e-4e11ae903ef5 tempest-CreateVolumesFromSnapshotTest-200635454 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345.470b8dce-0004-4eaa-9874-7554c37aa963 is being set with open permissions: ugo+rw Aug 31 15:25:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-273814e2-6818-4b88-a82e-4e11ae903ef5 tempest-CreateVolumesFromSnapshotTest-200635454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345.470b8dce-0004-4eaa-9874-7554c37aa963 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:25 devstack sudo[101337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345.470b8dce-0004-4eaa-9874-7554c37aa963 Aug 31 15:25:25 devstack sudo[101337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:25 devstack sudo[101328]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d153d866-001d-44de-913f-a20fd4a17056 tempest-VolumesGetTest-722448469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0f32c2f1-038c-4ef3-bc0d-ef8f835d7606" returned: 0 in 0.551s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d153d866-001d-44de-913f-a20fd4a17056 tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0f32c2f1-038c-4ef3-bc0d-ef8f835d7606 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:25 devstack sudo[101337]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-273814e2-6818-4b88-a82e-4e11ae903ef5 tempest-CreateVolumesFromSnapshotTest-200635454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345.470b8dce-0004-4eaa-9874-7554c37aa963" returned: 0 in 0.400s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:25 devstack sudo[101348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0f32c2f1-038c-4ef3-bc0d-ef8f835d7606 Aug 31 15:25:25 devstack sudo[101348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-273814e2-6818-4b88-a82e-4e11ae903ef5 tempest-CreateVolumesFromSnapshotTest-200635454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:25 devstack sudo[101351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345.info Aug 31 15:25:25 devstack sudo[101351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:25 devstack sudo[101348]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d153d866-001d-44de-913f-a20fd4a17056 tempest-VolumesGetTest-722448469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0f32c2f1-038c-4ef3-bc0d-ef8f835d7606" returned: 0 in 0.584s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:26 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-d153d866-001d-44de-913f-a20fd4a17056 tempest-VolumesGetTest-722448469 None] Lock "cinder-quobyte-0f32c2f1-038c-4ef3-bc0d-ef8f835d7606" released by "delete_volume" :: held 1.209s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:25:26 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-d153d866-001d-44de-913f-a20fd4a17056 tempest-VolumesGetTest-722448469 None] Created reservations ['be148827-b5a8-41af-a248-9b2858efd5bf', '2a45319c-27f3-40e3-b670-263fb9873233', 'a87c98d2-5200-4723-b10a-b3e06dd281d6', '286c0670-5ca4-4160-8147-61caa7d2cd7f'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:25:26 devstack sudo[101351]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-273814e2-6818-4b88-a82e-4e11ae903ef5 tempest-CreateVolumesFromSnapshotTest-200635454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345.info" returned: 0 in 0.627s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:26 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-273814e2-6818-4b88-a82e-4e11ae903ef5 tempest-CreateVolumesFromSnapshotTest-200635454 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345.info is being set with open permissions: ugo+rw Aug 31 15:25:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-273814e2-6818-4b88-a82e-4e11ae903ef5 tempest-CreateVolumesFromSnapshotTest-200635454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:26 devstack sudo[101357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345.info Aug 31 15:25:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-d153d866-001d-44de-913f-a20fd4a17056 tempest-VolumesGetTest-722448469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-d153d866-001d-44de-913f-a20fd4a17056 tempest-VolumesGetTest-722448469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:26 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-d153d866-001d-44de-913f-a20fd4a17056 tempest-VolumesGetTest-722448469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:25:26 devstack sudo[101357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:26 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-d153d866-001d-44de-913f-a20fd4a17056 tempest-VolumesGetTest-722448469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:25:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-d153d866-001d-44de-913f-a20fd4a17056 tempest-VolumesGetTest-722448469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d153d866-001d-44de-913f-a20fd4a17056 tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:26 devstack sudo[101362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:25:26 devstack sudo[101362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:26 devstack sudo[101362]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d153d866-001d-44de-913f-a20fd4a17056 tempest-VolumesGetTest-722448469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.402s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:26 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-d153d866-001d-44de-913f-a20fd4a17056 tempest-VolumesGetTest-722448469 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:25:26 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-d153d866-001d-44de-913f-a20fd4a17056 tempest-VolumesGetTest-722448469 None] Deleted volume successfully. Aug 31 15:25:26 devstack sudo[101357]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-273814e2-6818-4b88-a82e-4e11ae903ef5 tempest-CreateVolumesFromSnapshotTest-200635454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345.info" returned: 0 in 0.505s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-273814e2-6818-4b88-a82e-4e11ae903ef5 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.395s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:26 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-d153d866-001d-44de-913f-a20fd4a17056 tempest-VolumesGetTest-722448469 None] Lock "cinder-0f32c2f1-038c-4ef3-bc0d-ef8f835d7606-delete_volume" released by "delete_volume" :: held 1.977s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:25:26 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-273814e2-6818-4b88-a82e-4e11ae903ef5 tempest-CreateVolumesFromSnapshotTest-200635454 None] Create snapshot completed successfully Aug 31 15:25:27 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-f6e23ee4-7486-42ad-808c-d5681e999d3b tempest-VolumesGetTest-722448469 None] Acquiring lock "cinder-54b71342-1011-43d9-af07-b8bc653d46ac-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:25:27 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-f6e23ee4-7486-42ad-808c-d5681e999d3b tempest-VolumesGetTest-722448469 None] Lock "cinder-54b71342-1011-43d9-af07-b8bc653d46ac-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:25:27 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-f6e23ee4-7486-42ad-808c-d5681e999d3b tempest-VolumesGetTest-722448469 None] Acquiring lock "cinder-quobyte-54b71342-1011-43d9-af07-b8bc653d46ac" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:25:27 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-f6e23ee4-7486-42ad-808c-d5681e999d3b tempest-VolumesGetTest-722448469 None] Lock "cinder-quobyte-54b71342-1011-43d9-af07-b8bc653d46ac" acquired by "delete_volume" :: waited 0.022s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:25:27 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[845ce958-673b-4ec9-b751-82cd9ba56072]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:25:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f6e23ee4-7486-42ad-808c-d5681e999d3b tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-54b71342-1011-43d9-af07-b8bc653d46ac {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:27 devstack sudo[101385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-54b71342-1011-43d9-af07-b8bc653d46ac Aug 31 15:25:27 devstack sudo[101385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:27 devstack sudo[101385]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f6e23ee4-7486-42ad-808c-d5681e999d3b tempest-VolumesGetTest-722448469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-54b71342-1011-43d9-af07-b8bc653d46ac" returned: 0 in 0.598s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f6e23ee4-7486-42ad-808c-d5681e999d3b tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-54b71342-1011-43d9-af07-b8bc653d46ac {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:27 devstack sudo[101392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-54b71342-1011-43d9-af07-b8bc653d46ac Aug 31 15:25:27 devstack sudo[101392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:28 devstack sudo[101392]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f6e23ee4-7486-42ad-808c-d5681e999d3b tempest-VolumesGetTest-722448469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-54b71342-1011-43d9-af07-b8bc653d46ac" returned: 0 in 0.572s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:28 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-f6e23ee4-7486-42ad-808c-d5681e999d3b tempest-VolumesGetTest-722448469 None] Lock "cinder-quobyte-54b71342-1011-43d9-af07-b8bc653d46ac" released by "delete_volume" :: held 1.241s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:25:28 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:UPDATE=122,cinder:INSERT=22,cinder:SELECT=101,cinder:DELETE=9 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:25:28 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-03a05373-809b-43a7-9ded-a57341c83d67 tempest-CreateVolumesFromSnapshotTest-200635454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:25:28 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-03a05373-809b-43a7-9ded-a57341c83d67 tempest-CreateVolumesFromSnapshotTest-200635454 None] Flow 'volume_create_manager' (205b1247-fa73-4d53-9480-fac0e18479ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:25:28 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-03a05373-809b-43a7-9ded-a57341c83d67 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c76ef75f-6798-4d77-a160-6a9030e88d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:28 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-03a05373-809b-43a7-9ded-a57341c83d67 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c76ef75f-6798-4d77-a160-6a9030e88d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-602601119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feac0c72-433b-4aee-b41b-e278e2122a1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d84c2d913ed84d9492ecaca34672acca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:25:28Z,use_quota=True,user_id='2d4b866911f94bb9847a59e4f0b7e53c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:28 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-03a05373-809b-43a7-9ded-a57341c83d67 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fafd3f1-891d-4848-a678-42485c5ea23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:28 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-03a05373-809b-43a7-9ded-a57341c83d67 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fafd3f1-891d-4848-a678-42485c5ea23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:28 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-03a05373-809b-43a7-9ded-a57341c83d67 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f1519f0-4179-4c4c-a6fe-a1a9d092a1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:28 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-03a05373-809b-43a7-9ded-a57341c83d67 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f1519f0-4179-4c4c-a6fe-a1a9d092a1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'feac0c72-433b-4aee-b41b-e278e2122a1f', 'volume_name': 'volume-feac0c72-433b-4aee-b41b-e278e2122a1f', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:28 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-03a05373-809b-43a7-9ded-a57341c83d67 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af1b6af0-1476-4f9c-9af7-169971398e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:28 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-03a05373-809b-43a7-9ded-a57341c83d67 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af1b6af0-1476-4f9c-9af7-169971398e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:28 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-03a05373-809b-43a7-9ded-a57341c83d67 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d5f7f75-7541-4a87-ba1e-e2ff49d05802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:28 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-03a05373-809b-43a7-9ded-a57341c83d67 tempest-CreateVolumesFromSnapshotTest-200635454 None] Volume feac0c72-433b-4aee-b41b-e278e2122a1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-feac0c72-433b-4aee-b41b-e278e2122a1f', 'volume_size': 1} Aug 31 15:25:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-03a05373-809b-43a7-9ded-a57341c83d67 tempest-CreateVolumesFromSnapshotTest-200635454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-03a05373-809b-43a7-9ded-a57341c83d67 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:28 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-03a05373-809b-43a7-9ded-a57341c83d67 tempest-CreateVolumesFromSnapshotTest-200635454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-602601119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feac0c72-433b-4aee-b41b-e278e2122a1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d84c2d913ed84d9492ecaca34672acca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:25:28Z,use_quota=True,user_id='2d4b866911f94bb9847a59e4f0b7e53c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:25:28 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-03a05373-809b-43a7-9ded-a57341c83d67 tempest-CreateVolumesFromSnapshotTest-200635454 None] Creating volume feac0c72-433b-4aee-b41b-e278e2122a1f {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:25:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-03a05373-809b-43a7-9ded-a57341c83d67 tempest-CreateVolumesFromSnapshotTest-200635454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-03a05373-809b-43a7-9ded-a57341c83d67 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:28 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-03a05373-809b-43a7-9ded-a57341c83d67 tempest-CreateVolumesFromSnapshotTest-200635454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:25:28 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-03a05373-809b-43a7-9ded-a57341c83d67 tempest-CreateVolumesFromSnapshotTest-200635454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:25:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-03a05373-809b-43a7-9ded-a57341c83d67 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:28 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-03a05373-809b-43a7-9ded-a57341c83d67 tempest-CreateVolumesFromSnapshotTest-200635454 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:25:28 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-03a05373-809b-43a7-9ded-a57341c83d67 tempest-CreateVolumesFromSnapshotTest-200635454 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:25:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-03a05373-809b-43a7-9ded-a57341c83d67 tempest-CreateVolumesFromSnapshotTest-200635454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-feac0c72-433b-4aee-b41b-e278e2122a1f 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:28 devstack sudo[101395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-feac0c72-433b-4aee-b41b-e278e2122a1f 1073741824 Aug 31 15:25:28 devstack sudo[101395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:28 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-f6e23ee4-7486-42ad-808c-d5681e999d3b tempest-VolumesGetTest-722448469 None] Created reservations ['a006a7d9-edc5-4bfc-86d6-76a1fc90e0ae', 'be6d69c7-b1a0-4f29-9268-83061545e77d', '750dfeed-4195-4578-aa78-4a760dbe22d3', '669ffa30-d416-46e5-87e8-87ed7e415c94'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:25:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f6e23ee4-7486-42ad-808c-d5681e999d3b tempest-VolumesGetTest-722448469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f6e23ee4-7486-42ad-808c-d5681e999d3b tempest-VolumesGetTest-722448469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:28 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f6e23ee4-7486-42ad-808c-d5681e999d3b tempest-VolumesGetTest-722448469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:25:28 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f6e23ee4-7486-42ad-808c-d5681e999d3b tempest-VolumesGetTest-722448469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:25:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f6e23ee4-7486-42ad-808c-d5681e999d3b tempest-VolumesGetTest-722448469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f6e23ee4-7486-42ad-808c-d5681e999d3b tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:28 devstack sudo[101397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:25:28 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:29 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf1a7d57-da03-45c9-9a84-bf4387da6719 tempest-CreateVolumesFromSnapshotTest-200635454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:25:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cf1a7d57-da03-45c9-9a84-bf4387da6719 tempest-CreateVolumesFromSnapshotTest-200635454 None] Flow 'volume_create_manager' (7fe99f1d-85d4-4539-8867-8ee46708654e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:25:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cf1a7d57-da03-45c9-9a84-bf4387da6719 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10f06377-e6df-4119-9e7c-cf104860d945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cf1a7d57-da03-45c9-9a84-bf4387da6719 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10f06377-e6df-4119-9e7c-cf104860d945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-469200285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=465d20c4-ddba-42a1-bbc2-e16a37e6ee81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d84c2d913ed84d9492ecaca34672acca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:25:29Z,use_quota=True,user_id='2d4b866911f94bb9847a59e4f0b7e53c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cf1a7d57-da03-45c9-9a84-bf4387da6719 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f9efed9-9459-47aa-aeee-d63f597efa5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cf1a7d57-da03-45c9-9a84-bf4387da6719 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f9efed9-9459-47aa-aeee-d63f597efa5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cf1a7d57-da03-45c9-9a84-bf4387da6719 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (941e2de9-e6cd-452e-b75b-fd95519cf735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cf1a7d57-da03-45c9-9a84-bf4387da6719 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (941e2de9-e6cd-452e-b75b-fd95519cf735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '465d20c4-ddba-42a1-bbc2-e16a37e6ee81', 'volume_name': 'volume-465d20c4-ddba-42a1-bbc2-e16a37e6ee81', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cf1a7d57-da03-45c9-9a84-bf4387da6719 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cc58071-9fb2-4c06-80c0-d9ff4bbbeaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cf1a7d57-da03-45c9-9a84-bf4387da6719 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cc58071-9fb2-4c06-80c0-d9ff4bbbeaec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cf1a7d57-da03-45c9-9a84-bf4387da6719 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b1b8bd1-9519-40a6-9280-6c0070bfbff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:29 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-cf1a7d57-da03-45c9-9a84-bf4387da6719 tempest-CreateVolumesFromSnapshotTest-200635454 None] Volume 465d20c4-ddba-42a1-bbc2-e16a37e6ee81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-465d20c4-ddba-42a1-bbc2-e16a37e6ee81', 'volume_size': 1} Aug 31 15:25:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-cf1a7d57-da03-45c9-9a84-bf4387da6719 tempest-CreateVolumesFromSnapshotTest-200635454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:29 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-acaa2e10-a3fe-42e6-bf62-ba16e329a8a0 tempest-TestStampPattern-603172502 None] Acquiring lock "cinder-db8e488e-99c5-40ab-95bf-1a4bdddfd245-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:25:29 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-acaa2e10-a3fe-42e6-bf62-ba16e329a8a0 tempest-TestStampPattern-603172502 None] Lock "cinder-db8e488e-99c5-40ab-95bf-1a4bdddfd245-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:25:29 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-acaa2e10-a3fe-42e6-bf62-ba16e329a8a0 tempest-TestStampPattern-603172502 None] Acquiring lock "cinder-quobyte-db8e488e-99c5-40ab-95bf-1a4bdddfd245" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:25:29 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-acaa2e10-a3fe-42e6-bf62-ba16e329a8a0 tempest-TestStampPattern-603172502 None] Lock "cinder-quobyte-db8e488e-99c5-40ab-95bf-1a4bdddfd245" acquired by "delete_volume" :: waited 0.042s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:25:29 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f6e23ee4-7486-42ad-808c-d5681e999d3b tempest-VolumesGetTest-722448469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.656s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:29 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-f6e23ee4-7486-42ad-808c-d5681e999d3b tempest-VolumesGetTest-722448469 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:25:29 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5287dabb-3307-4901-a907-81965fad59a2]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:25:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-acaa2e10-a3fe-42e6-bf62-ba16e329a8a0 tempest-TestStampPattern-603172502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-db8e488e-99c5-40ab-95bf-1a4bdddfd245 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:29 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-f6e23ee4-7486-42ad-808c-d5681e999d3b tempest-VolumesGetTest-722448469 None] Deleted volume successfully. Aug 31 15:25:29 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-f6e23ee4-7486-42ad-808c-d5681e999d3b tempest-VolumesGetTest-722448469 None] Lock "cinder-54b71342-1011-43d9-af07-b8bc653d46ac-delete_volume" released by "delete_volume" :: held 2.542s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:25:29 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a480f8dc-d6a1-4d44-a84f-ca01dff60fdb tempest-VolumesGetTest-722448469 None] Acquiring lock "cinder-a25b3b70-05fb-49b1-a1f2-45daa4423cb9-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:25:29 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-41ed356b-a216-4e49-92a6-61e8ab05f57c tempest-CreateVolumesFromSnapshotTest-200635454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:25:29 devstack sudo[101403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-db8e488e-99c5-40ab-95bf-1a4bdddfd245 Aug 31 15:25:29 devstack sudo[101403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-41ed356b-a216-4e49-92a6-61e8ab05f57c tempest-CreateVolumesFromSnapshotTest-200635454 None] Flow 'volume_create_manager' (72ef5fff-1bf6-49db-b2ca-45ef5d11d8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:25:29 devstack sudo[101395]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-41ed356b-a216-4e49-92a6-61e8ab05f57c tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c6676ee-9363-4401-8b4e-c37ab51790d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-03a05373-809b-43a7-9ded-a57341c83d67 tempest-CreateVolumesFromSnapshotTest-200635454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-feac0c72-433b-4aee-b41b-e278e2122a1f 1073741824" returned: 0 in 1.192s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-41ed356b-a216-4e49-92a6-61e8ab05f57c tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c6676ee-9363-4401-8b4e-c37ab51790d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-138779637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a71d94c9-0339-4a27-9583-1b7d92cbcc31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d84c2d913ed84d9492ecaca34672acca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:25:30Z,use_quota=True,user_id='2d4b866911f94bb9847a59e4f0b7e53c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-41ed356b-a216-4e49-92a6-61e8ab05f57c tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7425631-9acf-4654-937e-33fdc0f42c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-41ed356b-a216-4e49-92a6-61e8ab05f57c tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7425631-9acf-4654-937e-33fdc0f42c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-41ed356b-a216-4e49-92a6-61e8ab05f57c tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a33c60c1-84cc-442c-b89b-09b8f2d7140e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-41ed356b-a216-4e49-92a6-61e8ab05f57c tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a33c60c1-84cc-442c-b89b-09b8f2d7140e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a71d94c9-0339-4a27-9583-1b7d92cbcc31', 'volume_name': 'volume-a71d94c9-0339-4a27-9583-1b7d92cbcc31', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-41ed356b-a216-4e49-92a6-61e8ab05f57c tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db93351f-608a-46cb-918d-25e5883233ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-41ed356b-a216-4e49-92a6-61e8ab05f57c tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db93351f-608a-46cb-918d-25e5883233ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-41ed356b-a216-4e49-92a6-61e8ab05f57c tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d99cf9f-bafb-435f-bd0e-6eee5818ebf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:30 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-41ed356b-a216-4e49-92a6-61e8ab05f57c tempest-CreateVolumesFromSnapshotTest-200635454 None] Volume a71d94c9-0339-4a27-9583-1b7d92cbcc31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a71d94c9-0339-4a27-9583-1b7d92cbcc31', 'volume_size': 1} Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-41ed356b-a216-4e49-92a6-61e8ab05f57c tempest-CreateVolumesFromSnapshotTest-200635454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a480f8dc-d6a1-4d44-a84f-ca01dff60fdb tempest-VolumesGetTest-722448469 None] Lock "cinder-a25b3b70-05fb-49b1-a1f2-45daa4423cb9-delete_volume" acquired by "delete_volume" :: waited 0.254s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-03a05373-809b-43a7-9ded-a57341c83d67 tempest-CreateVolumesFromSnapshotTest-200635454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-feac0c72-433b-4aee-b41b-e278e2122a1f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a480f8dc-d6a1-4d44-a84f-ca01dff60fdb tempest-VolumesGetTest-722448469 None] Acquiring lock "cinder-quobyte-a25b3b70-05fb-49b1-a1f2-45daa4423cb9" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:25:30 devstack sudo[101408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-feac0c72-433b-4aee-b41b-e278e2122a1f Aug 31 15:25:30 devstack sudo[101408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a480f8dc-d6a1-4d44-a84f-ca01dff60fdb tempest-VolumesGetTest-722448469 None] Lock "cinder-quobyte-a25b3b70-05fb-49b1-a1f2-45daa4423cb9" acquired by "delete_volume" :: waited 0.032s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-acaa2e10-a3fe-42e6-bf62-ba16e329a8a0 tempest-TestStampPattern-603172502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-db8e488e-99c5-40ab-95bf-1a4bdddfd245" returned: 0 in 0.643s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-acaa2e10-a3fe-42e6-bf62-ba16e329a8a0 tempest-TestStampPattern-603172502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-db8e488e-99c5-40ab-95bf-1a4bdddfd245 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:30 devstack sudo[101403]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3336bc-32c5-4af7-b82f-f8e37138591e]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a480f8dc-d6a1-4d44-a84f-ca01dff60fdb tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:30 devstack sudo[101411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-db8e488e-99c5-40ab-95bf-1a4bdddfd245 Aug 31 15:25:30 devstack sudo[101411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-53b3f498-8e8b-4741-a498-78572d571ca9 tempest-CreateVolumesFromSnapshotTest-200635454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:25:30 devstack sudo[101412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9 Aug 31 15:25:30 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-53b3f498-8e8b-4741-a498-78572d571ca9 tempest-CreateVolumesFromSnapshotTest-200635454 None] Flow 'volume_create_manager' (bd4237e4-b3a8-4864-91f3-53bbdeab6dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-53b3f498-8e8b-4741-a498-78572d571ca9 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2407e23-234b-42fe-b21d-e873db7a0dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-53b3f498-8e8b-4741-a498-78572d571ca9 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2407e23-234b-42fe-b21d-e873db7a0dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1672101100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cc08fd9-5741-45f3-88bf-eda0a6f7b2cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d84c2d913ed84d9492ecaca34672acca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:25:30Z,use_quota=True,user_id='2d4b866911f94bb9847a59e4f0b7e53c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:30 devstack sudo[101411]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-53b3f498-8e8b-4741-a498-78572d571ca9 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a0dbbbf-40bf-449c-bf59-6dc653800da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-53b3f498-8e8b-4741-a498-78572d571ca9 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a0dbbbf-40bf-449c-bf59-6dc653800da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-53b3f498-8e8b-4741-a498-78572d571ca9 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e542ea5e-ef2c-4786-8100-25ea8603be98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:30 devstack sudo[101408]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-53b3f498-8e8b-4741-a498-78572d571ca9 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e542ea5e-ef2c-4786-8100-25ea8603be98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cc08fd9-5741-45f3-88bf-eda0a6f7b2cc', 'volume_name': 'volume-9cc08fd9-5741-45f3-88bf-eda0a6f7b2cc', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-53b3f498-8e8b-4741-a498-78572d571ca9 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (757fc72d-a464-460e-a328-182725332f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-53b3f498-8e8b-4741-a498-78572d571ca9 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (757fc72d-a464-460e-a328-182725332f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-53b3f498-8e8b-4741-a498-78572d571ca9 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41141860-46b7-482b-9fa9-c857c1713bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:30 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-53b3f498-8e8b-4741-a498-78572d571ca9 tempest-CreateVolumesFromSnapshotTest-200635454 None] Volume 9cc08fd9-5741-45f3-88bf-eda0a6f7b2cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cc08fd9-5741-45f3-88bf-eda0a6f7b2cc', 'volume_size': 1} Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-53b3f498-8e8b-4741-a498-78572d571ca9 tempest-CreateVolumesFromSnapshotTest-200635454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-03a05373-809b-43a7-9ded-a57341c83d67 tempest-CreateVolumesFromSnapshotTest-200635454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-feac0c72-433b-4aee-b41b-e278e2122a1f" returned: 0 in 0.577s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-acaa2e10-a3fe-42e6-bf62-ba16e329a8a0 tempest-TestStampPattern-603172502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-db8e488e-99c5-40ab-95bf-1a4bdddfd245" returned: 0 in 0.459s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-03a05373-809b-43a7-9ded-a57341c83d67 tempest-CreateVolumesFromSnapshotTest-200635454 None] <== create_volume: return (2006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-03a05373-809b-43a7-9ded-a57341c83d67 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.011s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-cf1a7d57-da03-45c9-9a84-bf4387da6719 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.411s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-cf1a7d57-da03-45c9-9a84-bf4387da6719 tempest-CreateVolumesFromSnapshotTest-200635454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-469200285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=465d20c4-ddba-42a1-bbc2-e16a37e6ee81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d84c2d913ed84d9492ecaca34672acca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:25:29Z,use_quota=True,user_id='2d4b866911f94bb9847a59e4f0b7e53c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-cf1a7d57-da03-45c9-9a84-bf4387da6719 tempest-CreateVolumesFromSnapshotTest-200635454 None] Creating volume 465d20c4-ddba-42a1-bbc2-e16a37e6ee81 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-cf1a7d57-da03-45c9-9a84-bf4387da6719 tempest-CreateVolumesFromSnapshotTest-200635454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-cf1a7d57-da03-45c9-9a84-bf4387da6719 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-cf1a7d57-da03-45c9-9a84-bf4387da6719 tempest-CreateVolumesFromSnapshotTest-200635454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-cf1a7d57-da03-45c9-9a84-bf4387da6719 tempest-CreateVolumesFromSnapshotTest-200635454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-cf1a7d57-da03-45c9-9a84-bf4387da6719 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-cf1a7d57-da03-45c9-9a84-bf4387da6719 tempest-CreateVolumesFromSnapshotTest-200635454 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:25:30 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-cf1a7d57-da03-45c9-9a84-bf4387da6719 tempest-CreateVolumesFromSnapshotTest-200635454 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cf1a7d57-da03-45c9-9a84-bf4387da6719 tempest-CreateVolumesFromSnapshotTest-200635454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-465d20c4-ddba-42a1-bbc2-e16a37e6ee81 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-03a05373-809b-43a7-9ded-a57341c83d67 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d5f7f75-7541-4a87-ba1e-e2ff49d05802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-feac0c72-433b-4aee-b41b-e278e2122a1f', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:30 devstack sudo[101417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-465d20c4-ddba-42a1-bbc2-e16a37e6ee81 1073741824 Aug 31 15:25:30 devstack sudo[101417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-03a05373-809b-43a7-9ded-a57341c83d67 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79046db4-7f86-4f1d-8056-9dc2b169681e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-acaa2e10-a3fe-42e6-bf62-ba16e329a8a0 tempest-TestStampPattern-603172502 None] Lock "cinder-quobyte-db8e488e-99c5-40ab-95bf-1a4bdddfd245" released by "delete_volume" :: held 1.285s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:25:30 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-03a05373-809b-43a7-9ded-a57341c83d67 tempest-CreateVolumesFromSnapshotTest-200635454 None] Volume volume-feac0c72-433b-4aee-b41b-e278e2122a1f (feac0c72-433b-4aee-b41b-e278e2122a1f): created successfully Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-03a05373-809b-43a7-9ded-a57341c83d67 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79046db4-7f86-4f1d-8056-9dc2b169681e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-03a05373-809b-43a7-9ded-a57341c83d67 tempest-CreateVolumesFromSnapshotTest-200635454 None] Flow 'volume_create_manager' (205b1247-fa73-4d53-9480-fac0e18479ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:25:30 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-03a05373-809b-43a7-9ded-a57341c83d67 tempest-CreateVolumesFromSnapshotTest-200635454 None] Created volume successfully. Aug 31 15:25:30 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-acaa2e10-a3fe-42e6-bf62-ba16e329a8a0 tempest-TestStampPattern-603172502 None] Created reservations ['a818e036-9d61-417b-8458-e92b416e823f', 'f57c7bcd-96dd-4e5f-b47f-b4f3dadd7deb', '13ce7f0d-77ce-4e85-b3af-6b24fa746bf2', 'b3c3fc58-f47f-4b45-b740-92f534845f0b'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:25:31 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a480f8dc-d6a1-4d44-a84f-ca01dff60fdb tempest-VolumesGetTest-722448469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9" returned: 0 in 0.796s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a480f8dc-d6a1-4d44-a84f-ca01dff60fdb tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-acaa2e10-a3fe-42e6-bf62-ba16e329a8a0 tempest-TestStampPattern-603172502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-acaa2e10-a3fe-42e6-bf62-ba16e329a8a0 tempest-TestStampPattern-603172502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-acaa2e10-a3fe-42e6-bf62-ba16e329a8a0 tempest-TestStampPattern-603172502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-acaa2e10-a3fe-42e6-bf62-ba16e329a8a0 tempest-TestStampPattern-603172502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-acaa2e10-a3fe-42e6-bf62-ba16e329a8a0 tempest-TestStampPattern-603172502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-acaa2e10-a3fe-42e6-bf62-ba16e329a8a0 tempest-TestStampPattern-603172502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:31 devstack sudo[101424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9 Aug 31 15:25:31 devstack sudo[101424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:31 devstack sudo[101426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:25:31 devstack sudo[101426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cb8ab86-8f5b-4015-9cba-25068e7d6003 tempest-CreateVolumesFromSnapshotTest-200635454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6cb8ab86-8f5b-4015-9cba-25068e7d6003 tempest-CreateVolumesFromSnapshotTest-200635454 None] Flow 'volume_create_manager' (d7bea109-4d2d-48bb-9937-e7f46c10bc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6cb8ab86-8f5b-4015-9cba-25068e7d6003 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6f87ca9-c09b-4b57-b728-082225dbdd29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6cb8ab86-8f5b-4015-9cba-25068e7d6003 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6f87ca9-c09b-4b57-b728-082225dbdd29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-243699890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8027036-ff00-4d25-b420-b1d3e7348ab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d84c2d913ed84d9492ecaca34672acca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:25:31Z,use_quota=True,user_id='2d4b866911f94bb9847a59e4f0b7e53c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6cb8ab86-8f5b-4015-9cba-25068e7d6003 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (549fea63-b46e-4d1e-a686-2d94b01785ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6cb8ab86-8f5b-4015-9cba-25068e7d6003 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (549fea63-b46e-4d1e-a686-2d94b01785ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6cb8ab86-8f5b-4015-9cba-25068e7d6003 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (535ac202-8ea6-4eeb-8063-d04d3b8b7c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6cb8ab86-8f5b-4015-9cba-25068e7d6003 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (535ac202-8ea6-4eeb-8063-d04d3b8b7c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8027036-ff00-4d25-b420-b1d3e7348ab6', 'volume_name': 'volume-d8027036-ff00-4d25-b420-b1d3e7348ab6', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6cb8ab86-8f5b-4015-9cba-25068e7d6003 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (671aa9c7-42ca-4443-baaf-7a6d0f71a9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6cb8ab86-8f5b-4015-9cba-25068e7d6003 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (671aa9c7-42ca-4443-baaf-7a6d0f71a9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6cb8ab86-8f5b-4015-9cba-25068e7d6003 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4373ca43-3858-4a17-8a21-4581e125dede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:31 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-6cb8ab86-8f5b-4015-9cba-25068e7d6003 tempest-CreateVolumesFromSnapshotTest-200635454 None] Volume d8027036-ff00-4d25-b420-b1d3e7348ab6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8027036-ff00-4d25-b420-b1d3e7348ab6', 'volume_size': 1} Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6cb8ab86-8f5b-4015-9cba-25068e7d6003 tempest-CreateVolumesFromSnapshotTest-200635454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:31 devstack sudo[101417]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cf1a7d57-da03-45c9-9a84-bf4387da6719 tempest-CreateVolumesFromSnapshotTest-200635454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-465d20c4-ddba-42a1-bbc2-e16a37e6ee81 1073741824" returned: 0 in 0.623s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:31 devstack sudo[101424]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a480f8dc-d6a1-4d44-a84f-ca01dff60fdb tempest-VolumesGetTest-722448469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a25b3b70-05fb-49b1-a1f2-45daa4423cb9" returned: 0 in 0.322s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:31 devstack sudo[101426]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-acaa2e10-a3fe-42e6-bf62-ba16e329a8a0 tempest-TestStampPattern-603172502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.315s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-acaa2e10-a3fe-42e6-bf62-ba16e329a8a0 tempest-TestStampPattern-603172502 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a480f8dc-d6a1-4d44-a84f-ca01dff60fdb tempest-VolumesGetTest-722448469 None] Lock "cinder-quobyte-a25b3b70-05fb-49b1-a1f2-45daa4423cb9" released by "delete_volume" :: held 1.218s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:25:31 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-acaa2e10-a3fe-42e6-bf62-ba16e329a8a0 tempest-TestStampPattern-603172502 None] Deleted volume successfully. Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cf1a7d57-da03-45c9-9a84-bf4387da6719 tempest-CreateVolumesFromSnapshotTest-200635454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-465d20c4-ddba-42a1-bbc2-e16a37e6ee81 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-acaa2e10-a3fe-42e6-bf62-ba16e329a8a0 tempest-TestStampPattern-603172502 None] Lock "cinder-db8e488e-99c5-40ab-95bf-1a4bdddfd245-delete_volume" released by "delete_volume" :: held 2.034s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:25:31 devstack sudo[101431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-465d20c4-ddba-42a1-bbc2-e16a37e6ee81 Aug 31 15:25:31 devstack sudo[101431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-a480f8dc-d6a1-4d44-a84f-ca01dff60fdb tempest-VolumesGetTest-722448469 None] Created reservations ['02ebfd49-a74f-48ca-982e-a78eb912b041', '62fd3276-c61b-4411-a060-475cb9c62e72', 'a7a04910-3024-4e80-93f8-1edf0169d623', 'dd5f601a-e2ee-48b7-a00f-418dee47b474'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-a480f8dc-d6a1-4d44-a84f-ca01dff60fdb tempest-VolumesGetTest-722448469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-a480f8dc-d6a1-4d44-a84f-ca01dff60fdb tempest-VolumesGetTest-722448469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-a480f8dc-d6a1-4d44-a84f-ca01dff60fdb tempest-VolumesGetTest-722448469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-a480f8dc-d6a1-4d44-a84f-ca01dff60fdb tempest-VolumesGetTest-722448469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-a480f8dc-d6a1-4d44-a84f-ca01dff60fdb tempest-VolumesGetTest-722448469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a480f8dc-d6a1-4d44-a84f-ca01dff60fdb tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:31 devstack sudo[101433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:25:31 devstack sudo[101433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:31 devstack sudo[101431]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cf1a7d57-da03-45c9-9a84-bf4387da6719 tempest-CreateVolumesFromSnapshotTest-200635454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-465d20c4-ddba-42a1-bbc2-e16a37e6ee81" returned: 0 in 0.296s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-cf1a7d57-da03-45c9-9a84-bf4387da6719 tempest-CreateVolumesFromSnapshotTest-200635454 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-cf1a7d57-da03-45c9-9a84-bf4387da6719 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-41ed356b-a216-4e49-92a6-61e8ab05f57c tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.718s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-41ed356b-a216-4e49-92a6-61e8ab05f57c tempest-CreateVolumesFromSnapshotTest-200635454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-138779637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a71d94c9-0339-4a27-9583-1b7d92cbcc31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d84c2d913ed84d9492ecaca34672acca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:25:30Z,use_quota=True,user_id='2d4b866911f94bb9847a59e4f0b7e53c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-41ed356b-a216-4e49-92a6-61e8ab05f57c tempest-CreateVolumesFromSnapshotTest-200635454 None] Creating volume a71d94c9-0339-4a27-9583-1b7d92cbcc31 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-41ed356b-a216-4e49-92a6-61e8ab05f57c tempest-CreateVolumesFromSnapshotTest-200635454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-41ed356b-a216-4e49-92a6-61e8ab05f57c tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-41ed356b-a216-4e49-92a6-61e8ab05f57c tempest-CreateVolumesFromSnapshotTest-200635454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-41ed356b-a216-4e49-92a6-61e8ab05f57c tempest-CreateVolumesFromSnapshotTest-200635454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-41ed356b-a216-4e49-92a6-61e8ab05f57c tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-41ed356b-a216-4e49-92a6-61e8ab05f57c tempest-CreateVolumesFromSnapshotTest-200635454 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:25:31 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-41ed356b-a216-4e49-92a6-61e8ab05f57c tempest-CreateVolumesFromSnapshotTest-200635454 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-41ed356b-a216-4e49-92a6-61e8ab05f57c tempest-CreateVolumesFromSnapshotTest-200635454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a71d94c9-0339-4a27-9583-1b7d92cbcc31 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:31 devstack sudo[101436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a71d94c9-0339-4a27-9583-1b7d92cbcc31 1073741824 Aug 31 15:25:31 devstack sudo[101436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cf1a7d57-da03-45c9-9a84-bf4387da6719 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b1b8bd1-9519-40a6-9280-6c0070bfbff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-465d20c4-ddba-42a1-bbc2-e16a37e6ee81', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cf1a7d57-da03-45c9-9a84-bf4387da6719 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b485cba-eb9c-403f-8749-bf7e6dd02a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:31 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-cf1a7d57-da03-45c9-9a84-bf4387da6719 tempest-CreateVolumesFromSnapshotTest-200635454 None] Volume volume-465d20c4-ddba-42a1-bbc2-e16a37e6ee81 (465d20c4-ddba-42a1-bbc2-e16a37e6ee81): created successfully Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cf1a7d57-da03-45c9-9a84-bf4387da6719 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b485cba-eb9c-403f-8749-bf7e6dd02a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cf1a7d57-da03-45c9-9a84-bf4387da6719 tempest-CreateVolumesFromSnapshotTest-200635454 None] Flow 'volume_create_manager' (7fe99f1d-85d4-4539-8867-8ee46708654e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:25:31 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-cf1a7d57-da03-45c9-9a84-bf4387da6719 tempest-CreateVolumesFromSnapshotTest-200635454 None] Created volume successfully. Aug 31 15:25:31 devstack sudo[101433]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a480f8dc-d6a1-4d44-a84f-ca01dff60fdb tempest-VolumesGetTest-722448469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.375s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-a480f8dc-d6a1-4d44-a84f-ca01dff60fdb tempest-VolumesGetTest-722448469 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:25:31 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-a480f8dc-d6a1-4d44-a84f-ca01dff60fdb tempest-VolumesGetTest-722448469 None] Deleted volume successfully. Aug 31 15:25:31 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a480f8dc-d6a1-4d44-a84f-ca01dff60fdb tempest-VolumesGetTest-722448469 None] Lock "cinder-a25b3b70-05fb-49b1-a1f2-45daa4423cb9-delete_volume" released by "delete_volume" :: held 1.931s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:25:32 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-1fb57e0c-7c22-4531-8f43-d6eb2f72b46b tempest-TestStampPattern-603172502 None] Acquiring lock "cinder-a7d8d308-9194-4209-98b2-9d05186dfbf6-delete_snapshot" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:25:32 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-1fb57e0c-7c22-4531-8f43-d6eb2f72b46b tempest-TestStampPattern-603172502 None] Lock "cinder-a7d8d308-9194-4209-98b2-9d05186dfbf6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:25:32 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-1fb57e0c-7c22-4531-8f43-d6eb2f72b46b tempest-TestStampPattern-603172502 None] Acquiring lock "cinder-quobyte-07bcb2f9-6d26-412e-b676-6aed3a938bde" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:25:32 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-1fb57e0c-7c22-4531-8f43-d6eb2f72b46b tempest-TestStampPattern-603172502 None] Lock "cinder-quobyte-07bcb2f9-6d26-412e-b676-6aed3a938bde" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:25:32 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-1fb57e0c-7c22-4531-8f43-d6eb2f72b46b tempest-TestStampPattern-603172502 None] Acquiring lock "cinder-quobyte-a7d8d308-9194-4209-98b2-9d05186dfbf6" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:25:32 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-1fb57e0c-7c22-4531-8f43-d6eb2f72b46b tempest-TestStampPattern-603172502 None] Lock "cinder-quobyte-a7d8d308-9194-4209-98b2-9d05186dfbf6" acquired by "_delete_snapshot" :: waited 0.057s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:25:32 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-1fb57e0c-7c22-4531-8f43-d6eb2f72b46b tempest-TestStampPattern-603172502 None] Deleting offline snapshot a7d8d308-9194-4209-98b2-9d05186dfbf6 of volume 07bcb2f9-6d26-412e-b676-6aed3a938bde {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:25:32 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-1fb57e0c-7c22-4531-8f43-d6eb2f72b46b tempest-TestStampPattern-603172502 None] snapshot_file for this snap is: volume-07bcb2f9-6d26-412e-b676-6aed3a938bde.a7d8d308-9194-4209-98b2-9d05186dfbf6 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:25:32 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3eba71-e1ba-4c17-8137-8c2f440f8a86]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:25:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1fb57e0c-7c22-4531-8f43-d6eb2f72b46b tempest-TestStampPattern-603172502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde.a7d8d308-9194-4209-98b2-9d05186dfbf6 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:32 devstack sudo[101436]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-41ed356b-a216-4e49-92a6-61e8ab05f57c tempest-CreateVolumesFromSnapshotTest-200635454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a71d94c9-0339-4a27-9583-1b7d92cbcc31 1073741824" returned: 0 in 0.682s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:32 devstack sudo[101442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde.a7d8d308-9194-4209-98b2-9d05186dfbf6 Aug 31 15:25:32 devstack sudo[101442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-41ed356b-a216-4e49-92a6-61e8ab05f57c tempest-CreateVolumesFromSnapshotTest-200635454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a71d94c9-0339-4a27-9583-1b7d92cbcc31 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:32 devstack sudo[101445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a71d94c9-0339-4a27-9583-1b7d92cbcc31 Aug 31 15:25:32 devstack sudo[101445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:32 devstack sudo[101442]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1fb57e0c-7c22-4531-8f43-d6eb2f72b46b tempest-TestStampPattern-603172502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde.a7d8d308-9194-4209-98b2-9d05186dfbf6" returned: 0 in 0.534s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:32 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-1fb57e0c-7c22-4531-8f43-d6eb2f72b46b tempest-TestStampPattern-603172502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07bcb2f9-6d26-412e-b676-6aed3a938bde(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:25:32 devstack sudo[101445]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-41ed356b-a216-4e49-92a6-61e8ab05f57c tempest-CreateVolumesFromSnapshotTest-200635454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a71d94c9-0339-4a27-9583-1b7d92cbcc31" returned: 0 in 0.379s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:32 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-41ed356b-a216-4e49-92a6-61e8ab05f57c tempest-CreateVolumesFromSnapshotTest-200635454 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:25:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-41ed356b-a216-4e49-92a6-61e8ab05f57c tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-53b3f498-8e8b-4741-a498-78572d571ca9 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.224s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:32 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-53b3f498-8e8b-4741-a498-78572d571ca9 tempest-CreateVolumesFromSnapshotTest-200635454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1672101100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cc08fd9-5741-45f3-88bf-eda0a6f7b2cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d84c2d913ed84d9492ecaca34672acca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:25:30Z,use_quota=True,user_id='2d4b866911f94bb9847a59e4f0b7e53c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:25:32 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-53b3f498-8e8b-4741-a498-78572d571ca9 tempest-CreateVolumesFromSnapshotTest-200635454 None] Creating volume 9cc08fd9-5741-45f3-88bf-eda0a6f7b2cc {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:25:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-53b3f498-8e8b-4741-a498-78572d571ca9 tempest-CreateVolumesFromSnapshotTest-200635454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-53b3f498-8e8b-4741-a498-78572d571ca9 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:32 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-53b3f498-8e8b-4741-a498-78572d571ca9 tempest-CreateVolumesFromSnapshotTest-200635454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:25:32 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-53b3f498-8e8b-4741-a498-78572d571ca9 tempest-CreateVolumesFromSnapshotTest-200635454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:25:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-53b3f498-8e8b-4741-a498-78572d571ca9 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:32 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-53b3f498-8e8b-4741-a498-78572d571ca9 tempest-CreateVolumesFromSnapshotTest-200635454 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:25:32 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-53b3f498-8e8b-4741-a498-78572d571ca9 tempest-CreateVolumesFromSnapshotTest-200635454 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:25:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-53b3f498-8e8b-4741-a498-78572d571ca9 tempest-CreateVolumesFromSnapshotTest-200635454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9cc08fd9-5741-45f3-88bf-eda0a6f7b2cc 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:32 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59376aa-a96b-427d-a5a2-b16eed8501aa]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:25:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1fb57e0c-7c22-4531-8f43-d6eb2f72b46b tempest-TestStampPattern-603172502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-41ed356b-a216-4e49-92a6-61e8ab05f57c tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d99cf9f-bafb-435f-bd0e-6eee5818ebf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a71d94c9-0339-4a27-9583-1b7d92cbcc31', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:33 devstack sudo[101452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9cc08fd9-5741-45f3-88bf-eda0a6f7b2cc 1073741824 Aug 31 15:25:33 devstack sudo[101452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-41ed356b-a216-4e49-92a6-61e8ab05f57c tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efb7b2a8-186b-4cff-a3f8-339f9ffc9107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:33 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-41ed356b-a216-4e49-92a6-61e8ab05f57c tempest-CreateVolumesFromSnapshotTest-200635454 None] Volume volume-a71d94c9-0339-4a27-9583-1b7d92cbcc31 (a71d94c9-0339-4a27-9583-1b7d92cbcc31): created successfully Aug 31 15:25:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-41ed356b-a216-4e49-92a6-61e8ab05f57c tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efb7b2a8-186b-4cff-a3f8-339f9ffc9107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-41ed356b-a216-4e49-92a6-61e8ab05f57c tempest-CreateVolumesFromSnapshotTest-200635454 None] Flow 'volume_create_manager' (72ef5fff-1bf6-49db-b2ca-45ef5d11d8d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:25:33 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-41ed356b-a216-4e49-92a6-61e8ab05f57c tempest-CreateVolumesFromSnapshotTest-200635454 None] Created volume successfully. Aug 31 15:25:33 devstack sudo[101453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde Aug 31 15:25:33 devstack sudo[101453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:33 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:25:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Flow 'volume_create_manager' (9cd006fd-702b-4c8c-b200-57106ca4a226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:25:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (311fe1dc-4f83-4202-bd19-48f147072e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (311fe1dc-4f83-4202-bd19-48f147072e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-830524809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f25d6730-9ac5-4be1-92eb-ee675212d15c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f2d13a635434495f88759f010f2182c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:25:33Z,use_quota=True,user_id='972de954be064952b24bddfa46a2d487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adabdb01-ce48-4cb6-b825-8d29ea136f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adabdb01-ce48-4cb6-b825-8d29ea136f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67fb44a2-cae0-409e-9d0b-a209cff12978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:33 devstack cinder-volume[86000]: DEBUG cinder.image.glance [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Creating Keystone auth plugin from conf {{(pid=86000) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 31 15:25:33 devstack sudo[101452]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-53b3f498-8e8b-4741-a498-78572d571ca9 tempest-CreateVolumesFromSnapshotTest-200635454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9cc08fd9-5741-45f3-88bf-eda0a6f7b2cc 1073741824" returned: 0 in 0.643s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-53b3f498-8e8b-4741-a498-78572d571ca9 tempest-CreateVolumesFromSnapshotTest-200635454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9cc08fd9-5741-45f3-88bf-eda0a6f7b2cc {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:33 devstack sudo[101462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9cc08fd9-5741-45f3-88bf-eda0a6f7b2cc Aug 31 15:25:33 devstack sudo[101462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:33 devstack sudo[101453]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1fb57e0c-7c22-4531-8f43-d6eb2f72b46b tempest-TestStampPattern-603172502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde" returned: 0 in 0.812s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1fb57e0c-7c22-4531-8f43-d6eb2f72b46b tempest-TestStampPattern-603172502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde.a7d8d308-9194-4209-98b2-9d05186dfbf6 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:33 devstack sudo[101465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde.a7d8d308-9194-4209-98b2-9d05186dfbf6 Aug 31 15:25:33 devstack sudo[101465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67fb44a2-cae0-409e-9d0b-a209cff12978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f25d6730-9ac5-4be1-92eb-ee675212d15c', 'volume_name': 'volume-f25d6730-9ac5-4be1-92eb-ee675212d15c', 'volume_size': 1, 'image_id': '20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '567fd89339ed4743bca5bfab8ec3766d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'created_at': datetime.datetime(2026, 8, 31, 13, 6, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 13, 6, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20bdf4f4-1731-4a30-8e37-8e698c01bf5d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7271c0ab-f3b0-4f41-a87b-ef5e2c4a8323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7271c0ab-f3b0-4f41-a87b-ef5e2c4a8323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9233e2c-8f13-4825-ad8e-18cc5300d33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:33 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Volume f25d6730-9ac5-4be1-92eb-ee675212d15c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f25d6730-9ac5-4be1-92eb-ee675212d15c', 'volume_size': 1, 'image_id': '20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '567fd89339ed4743bca5bfab8ec3766d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'created_at': datetime.datetime(2026, 8, 31, 13, 6, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 13, 6, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20bdf4f4-1731-4a30-8e37-8e698c01bf5d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 31 15:25:33 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Trying to clone f25d6730-9ac5-4be1-92eb-ee675212d15c from image 20bdf4f4-1731-4a30-8e37-8e698c01bf5d at location (None, [{'url': 'file:///opt/stack/data/glance/images/20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'metadata': {}}]). {{(pid=86000) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 31 15:25:33 devstack sudo[101462]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-53b3f498-8e8b-4741-a498-78572d571ca9 tempest-CreateVolumesFromSnapshotTest-200635454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9cc08fd9-5741-45f3-88bf-eda0a6f7b2cc" returned: 0 in 0.328s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:33 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-53b3f498-8e8b-4741-a498-78572d571ca9 tempest-CreateVolumesFromSnapshotTest-200635454 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:25:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-53b3f498-8e8b-4741-a498-78572d571ca9 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6cb8ab86-8f5b-4015-9cba-25068e7d6003 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.640s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:33 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6cb8ab86-8f5b-4015-9cba-25068e7d6003 tempest-CreateVolumesFromSnapshotTest-200635454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-243699890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8027036-ff00-4d25-b420-b1d3e7348ab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d84c2d913ed84d9492ecaca34672acca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:25:31Z,use_quota=True,user_id='2d4b866911f94bb9847a59e4f0b7e53c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:25:33 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-6cb8ab86-8f5b-4015-9cba-25068e7d6003 tempest-CreateVolumesFromSnapshotTest-200635454 None] Creating volume d8027036-ff00-4d25-b420-b1d3e7348ab6 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:25:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6cb8ab86-8f5b-4015-9cba-25068e7d6003 tempest-CreateVolumesFromSnapshotTest-200635454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6cb8ab86-8f5b-4015-9cba-25068e7d6003 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:33 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6cb8ab86-8f5b-4015-9cba-25068e7d6003 tempest-CreateVolumesFromSnapshotTest-200635454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:25:34 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6cb8ab86-8f5b-4015-9cba-25068e7d6003 tempest-CreateVolumesFromSnapshotTest-200635454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:25:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6cb8ab86-8f5b-4015-9cba-25068e7d6003 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:34 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6cb8ab86-8f5b-4015-9cba-25068e7d6003 tempest-CreateVolumesFromSnapshotTest-200635454 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:25:34 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-6cb8ab86-8f5b-4015-9cba-25068e7d6003 tempest-CreateVolumesFromSnapshotTest-200635454 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:25:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6cb8ab86-8f5b-4015-9cba-25068e7d6003 tempest-CreateVolumesFromSnapshotTest-200635454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d8027036-ff00-4d25-b420-b1d3e7348ab6 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:34 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-53b3f498-8e8b-4741-a498-78572d571ca9 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41141860-46b7-482b-9fa9-c857c1713bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cc08fd9-5741-45f3-88bf-eda0a6f7b2cc', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:34 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-53b3f498-8e8b-4741-a498-78572d571ca9 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab3efeab-6760-4291-90bd-52bfd9db97ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:34 devstack sudo[101468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d8027036-ff00-4d25-b420-b1d3e7348ab6 1073741824 Aug 31 15:25:34 devstack sudo[101468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:34 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-53b3f498-8e8b-4741-a498-78572d571ca9 tempest-CreateVolumesFromSnapshotTest-200635454 None] Volume volume-9cc08fd9-5741-45f3-88bf-eda0a6f7b2cc (9cc08fd9-5741-45f3-88bf-eda0a6f7b2cc): created successfully Aug 31 15:25:34 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-53b3f498-8e8b-4741-a498-78572d571ca9 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab3efeab-6760-4291-90bd-52bfd9db97ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:34 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-53b3f498-8e8b-4741-a498-78572d571ca9 tempest-CreateVolumesFromSnapshotTest-200635454 None] Flow 'volume_create_manager' (bd4237e4-b3a8-4864-91f3-53bbdeab6dbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:25:34 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-53b3f498-8e8b-4741-a498-78572d571ca9 tempest-CreateVolumesFromSnapshotTest-200635454 None] Created volume successfully. Aug 31 15:25:34 devstack sudo[101465]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1fb57e0c-7c22-4531-8f43-d6eb2f72b46b tempest-TestStampPattern-603172502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde.a7d8d308-9194-4209-98b2-9d05186dfbf6" returned: 0 in 0.470s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1fb57e0c-7c22-4531-8f43-d6eb2f72b46b tempest-TestStampPattern-603172502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde.a7d8d308-9194-4209-98b2-9d05186dfbf6 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:34 devstack sudo[101474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde.a7d8d308-9194-4209-98b2-9d05186dfbf6 Aug 31 15:25:34 devstack sudo[101474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:34 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_4bmh8d2rdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86000) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 31 15:25:34 devstack cinder-volume[86000]: INFO cinder.image.image_utils [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Image download 20.69 MB at 20.69 MB/s Aug 31 15:25:34 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[af868d11-58d9-4650-96b9-e0cf523f0b75]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:25:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_4bmh8d2rdevstack@QuobyteHD {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:34 devstack sudo[101468]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:34 devstack sudo[101480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_4bmh8d2rdevstack@QuobyteHD Aug 31 15:25:34 devstack sudo[101480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6cb8ab86-8f5b-4015-9cba-25068e7d6003 tempest-CreateVolumesFromSnapshotTest-200635454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d8027036-ff00-4d25-b420-b1d3e7348ab6 1073741824" returned: 0 in 0.653s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6cb8ab86-8f5b-4015-9cba-25068e7d6003 tempest-CreateVolumesFromSnapshotTest-200635454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d8027036-ff00-4d25-b420-b1d3e7348ab6 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:34 devstack sudo[101474]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1fb57e0c-7c22-4531-8f43-d6eb2f72b46b tempest-TestStampPattern-603172502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde.a7d8d308-9194-4209-98b2-9d05186dfbf6" returned: 0 in 0.476s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:34 devstack sudo[101484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d8027036-ff00-4d25-b420-b1d3e7348ab6 Aug 31 15:25:34 devstack sudo[101484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:34 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-1fb57e0c-7c22-4531-8f43-d6eb2f72b46b tempest-TestStampPattern-603172502 None] Lock "cinder-quobyte-a7d8d308-9194-4209-98b2-9d05186dfbf6" released by "_delete_snapshot" :: held 2.475s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:25:34 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-1fb57e0c-7c22-4531-8f43-d6eb2f72b46b tempest-TestStampPattern-603172502 None] Lock "cinder-quobyte-07bcb2f9-6d26-412e-b676-6aed3a938bde" released by "delete_snapshot" :: held 2.544s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:25:34 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-1fb57e0c-7c22-4531-8f43-d6eb2f72b46b tempest-TestStampPattern-603172502 None] Created reservations ['02067625-6786-4dbe-a678-d53b87485b7b', '14e987f9-2b21-4be6-907b-29306c621f1b', 'e74b2e33-44fa-4063-a918-45e1abd43352', 'e0073822-1a82-4ffa-a46b-391f0ea3b2c3'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:25:34 devstack sudo[101480]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_4bmh8d2rdevstack@QuobyteHD" returned: 0 in 0.433s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:34 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Temporary image 20bdf4f4-1731-4a30-8e37-8e698c01bf5d is fetched for user 972de954be064952b24bddfa46a2d487. {{(pid=86000) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 31 15:25:34 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-1fb57e0c-7c22-4531-8f43-d6eb2f72b46b tempest-TestStampPattern-603172502 None] Delete snapshot completed successfully. Aug 31 15:25:35 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-1fb57e0c-7c22-4531-8f43-d6eb2f72b46b tempest-TestStampPattern-603172502 None] Lock "cinder-a7d8d308-9194-4209-98b2-9d05186dfbf6-delete_snapshot" released by "delete_snapshot" :: held 2.759s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:25:35 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[10562fb8-b832-4bda-99bb-bd645623ba21]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:25:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_4bmh8d2rdevstack@QuobyteHD {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:35 devstack sudo[101484]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6cb8ab86-8f5b-4015-9cba-25068e7d6003 tempest-CreateVolumesFromSnapshotTest-200635454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d8027036-ff00-4d25-b420-b1d3e7348ab6" returned: 0 in 0.314s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:35 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6cb8ab86-8f5b-4015-9cba-25068e7d6003 tempest-CreateVolumesFromSnapshotTest-200635454 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:25:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6cb8ab86-8f5b-4015-9cba-25068e7d6003 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6cb8ab86-8f5b-4015-9cba-25068e7d6003 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4373ca43-3858-4a17-8a21-4581e125dede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8027036-ff00-4d25-b420-b1d3e7348ab6', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6cb8ab86-8f5b-4015-9cba-25068e7d6003 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb57494d-6fe3-4c3e-b652-28c0b9b134ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:35 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-6cb8ab86-8f5b-4015-9cba-25068e7d6003 tempest-CreateVolumesFromSnapshotTest-200635454 None] Volume volume-d8027036-ff00-4d25-b420-b1d3e7348ab6 (d8027036-ff00-4d25-b420-b1d3e7348ab6): created successfully Aug 31 15:25:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6cb8ab86-8f5b-4015-9cba-25068e7d6003 tempest-CreateVolumesFromSnapshotTest-200635454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb57494d-6fe3-4c3e-b652-28c0b9b134ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6cb8ab86-8f5b-4015-9cba-25068e7d6003 tempest-CreateVolumesFromSnapshotTest-200635454 None] Flow 'volume_create_manager' (d7bea109-4d2d-48bb-9937-e7f46c10bc4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:25:35 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-6cb8ab86-8f5b-4015-9cba-25068e7d6003 tempest-CreateVolumesFromSnapshotTest-200635454 None] Created volume successfully. Aug 31 15:25:35 devstack sudo[101490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_4bmh8d2rdevstack@QuobyteHD Aug 31 15:25:35 devstack sudo[101490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:35 devstack sudo[101490]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_4bmh8d2rdevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:35 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-830524809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f25d6730-9ac5-4be1-92eb-ee675212d15c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f2d13a635434495f88759f010f2182c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:25:33Z,use_quota=True,user_id='972de954be064952b24bddfa46a2d487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:25:35 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Creating volume f25d6730-9ac5-4be1-92eb-ee675212d15c {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:25:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:35 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:25:35 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:25:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:35 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:25:35 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:25:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f25d6730-9ac5-4be1-92eb-ee675212d15c 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:35 devstack sudo[101495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f25d6730-9ac5-4be1-92eb-ee675212d15c 1073741824 Aug 31 15:25:35 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:35 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7260ee9d-9050-4edf-8190-cc681f145a04 tempest-CreateVolumesFromSnapshotTest-200635454 None] Acquiring lock "cinder-d8027036-ff00-4d25-b420-b1d3e7348ab6-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:25:35 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7260ee9d-9050-4edf-8190-cc681f145a04 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "cinder-d8027036-ff00-4d25-b420-b1d3e7348ab6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:25:35 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7260ee9d-9050-4edf-8190-cc681f145a04 tempest-CreateVolumesFromSnapshotTest-200635454 None] Acquiring lock "cinder-quobyte-d8027036-ff00-4d25-b420-b1d3e7348ab6" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:25:35 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7260ee9d-9050-4edf-8190-cc681f145a04 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "cinder-quobyte-d8027036-ff00-4d25-b420-b1d3e7348ab6" acquired by "delete_volume" :: waited 0.026s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:25:36 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f25d6730-9ac5-4be1-92eb-ee675212d15c 1073741824" returned: 0 in 0.648s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:36 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f113dbef-d51b-4c47-bfa9-38b9bfe57329]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:25:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7260ee9d-9050-4edf-8190-cc681f145a04 tempest-CreateVolumesFromSnapshotTest-200635454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d8027036-ff00-4d25-b420-b1d3e7348ab6 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f25d6730-9ac5-4be1-92eb-ee675212d15c {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:36 devstack sudo[101502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f25d6730-9ac5-4be1-92eb-ee675212d15c Aug 31 15:25:36 devstack sudo[101502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:36 devstack sudo[101501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d8027036-ff00-4d25-b420-b1d3e7348ab6 Aug 31 15:25:36 devstack sudo[101501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:36 devstack sudo[101502]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f25d6730-9ac5-4be1-92eb-ee675212d15c" returned: 0 in 0.353s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:36 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:25:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:36 devstack cinder-volume[86000]: DEBUG cinder.volume.volume_utils [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Attempting download of 20bdf4f4-1731-4a30-8e37-8e698c01bf5d ((None, [{'url': 'file:///opt/stack/data/glance/images/20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'metadata': {}}])) to volume f25d6730-9ac5-4be1-92eb-ee675212d15c. {{(pid=86000) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 31 15:25:36 devstack sudo[101501]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7260ee9d-9050-4edf-8190-cc681f145a04 tempest-CreateVolumesFromSnapshotTest-200635454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d8027036-ff00-4d25-b420-b1d3e7348ab6" returned: 0 in 0.471s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7260ee9d-9050-4edf-8190-cc681f145a04 tempest-CreateVolumesFromSnapshotTest-200635454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d8027036-ff00-4d25-b420-b1d3e7348ab6 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:36 devstack sudo[101510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d8027036-ff00-4d25-b420-b1d3e7348ab6 Aug 31 15:25:36 devstack sudo[101510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:36 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ab26b2-81f9-4f4a-ae33-a08b94853a7b]: (4, 'raw') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:25:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_b77hxvkf {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:36 devstack sudo[101516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_b77hxvkf Aug 31 15:25:36 devstack sudo[101516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:37 devstack sudo[101510]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7260ee9d-9050-4edf-8190-cc681f145a04 tempest-CreateVolumesFromSnapshotTest-200635454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-d8027036-ff00-4d25-b420-b1d3e7348ab6" returned: 0 in 0.556s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:37 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7260ee9d-9050-4edf-8190-cc681f145a04 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "cinder-quobyte-d8027036-ff00-4d25-b420-b1d3e7348ab6" released by "delete_volume" :: held 1.126s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:25:37 devstack sudo[101516]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_b77hxvkf" returned: 0 in 0.560s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_b77hxvkf {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:37 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-7260ee9d-9050-4edf-8190-cc681f145a04 tempest-CreateVolumesFromSnapshotTest-200635454 None] Created reservations ['85aeeaed-404a-4642-b637-c8993194079b', '817bd42c-7102-4532-a561-75339eaaa630', 'b7221ad5-75a2-4c6a-b00e-4c0c7524d039', '8edfec84-7ed9-4983-8975-13cd21bc5244'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:25:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7260ee9d-9050-4edf-8190-cc681f145a04 tempest-CreateVolumesFromSnapshotTest-200635454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7260ee9d-9050-4edf-8190-cc681f145a04 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:37 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-7260ee9d-9050-4edf-8190-cc681f145a04 tempest-CreateVolumesFromSnapshotTest-200635454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:25:37 devstack sudo[101527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_b77hxvkf Aug 31 15:25:37 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-7260ee9d-9050-4edf-8190-cc681f145a04 tempest-CreateVolumesFromSnapshotTest-200635454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:25:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7260ee9d-9050-4edf-8190-cc681f145a04 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:37 devstack sudo[101527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7260ee9d-9050-4edf-8190-cc681f145a04 tempest-CreateVolumesFromSnapshotTest-200635454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:37 devstack sudo[101533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:25:37 devstack sudo[101533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:37 devstack sudo[101527]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_b77hxvkf" returned: 1 in 0.541s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_b77hxvkf' failed. Not Retrying. {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 31 15:25:37 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0429d4f3-4614-4cd9-bccf-e76d83f63503]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:25:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_4bmh8d2rdevstack@QuobyteHD {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:37 devstack sudo[101533]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7260ee9d-9050-4edf-8190-cc681f145a04 tempest-CreateVolumesFromSnapshotTest-200635454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.563s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:37 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-7260ee9d-9050-4edf-8190-cc681f145a04 tempest-CreateVolumesFromSnapshotTest-200635454 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:25:37 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-7260ee9d-9050-4edf-8190-cc681f145a04 tempest-CreateVolumesFromSnapshotTest-200635454 None] Deleted volume successfully. Aug 31 15:25:37 devstack sudo[101552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_4bmh8d2rdevstack@QuobyteHD Aug 31 15:25:37 devstack sudo[101552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:37 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7260ee9d-9050-4edf-8190-cc681f145a04 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "cinder-d8027036-ff00-4d25-b420-b1d3e7348ab6-delete_volume" released by "delete_volume" :: held 1.986s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:25:38 devstack sudo[101552]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_4bmh8d2rdevstack@QuobyteHD" returned: 0 in 0.565s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:38 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] 20bdf4f4-1731-4a30-8e37-8e698c01bf5d was qcow2, converting to qcow2 {{(pid=86000) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 31 15:25:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_4bmh8d2rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f25d6730-9ac5-4be1-92eb-ee675212d15c {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:38 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-95939b14-1bbd-4ecb-b351-a05f737c7aa5 tempest-CreateVolumesFromSnapshotTest-200635454 None] Acquiring lock "cinder-9cc08fd9-5741-45f3-88bf-eda0a6f7b2cc-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:25:38 devstack sudo[101559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_4bmh8d2rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f25d6730-9ac5-4be1-92eb-ee675212d15c Aug 31 15:25:38 devstack sudo[101559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:38 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-95939b14-1bbd-4ecb-b351-a05f737c7aa5 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "cinder-9cc08fd9-5741-45f3-88bf-eda0a6f7b2cc-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:25:38 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-95939b14-1bbd-4ecb-b351-a05f737c7aa5 tempest-CreateVolumesFromSnapshotTest-200635454 None] Acquiring lock "cinder-quobyte-9cc08fd9-5741-45f3-88bf-eda0a6f7b2cc" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:25:38 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-95939b14-1bbd-4ecb-b351-a05f737c7aa5 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "cinder-quobyte-9cc08fd9-5741-45f3-88bf-eda0a6f7b2cc" acquired by "delete_volume" :: waited 0.028s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:25:38 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb89758-51bc-4386-9550-0e79f699b786]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:25:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-95939b14-1bbd-4ecb-b351-a05f737c7aa5 tempest-CreateVolumesFromSnapshotTest-200635454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9cc08fd9-5741-45f3-88bf-eda0a6f7b2cc {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:38 devstack sudo[101561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9cc08fd9-5741-45f3-88bf-eda0a6f7b2cc Aug 31 15:25:38 devstack sudo[101561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:38 devstack sudo[101561]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-95939b14-1bbd-4ecb-b351-a05f737c7aa5 tempest-CreateVolumesFromSnapshotTest-200635454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9cc08fd9-5741-45f3-88bf-eda0a6f7b2cc" returned: 0 in 0.507s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-95939b14-1bbd-4ecb-b351-a05f737c7aa5 tempest-CreateVolumesFromSnapshotTest-200635454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9cc08fd9-5741-45f3-88bf-eda0a6f7b2cc {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:39 devstack sudo[101571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9cc08fd9-5741-45f3-88bf-eda0a6f7b2cc Aug 31 15:25:39 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:39 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-95939b14-1bbd-4ecb-b351-a05f737c7aa5 tempest-CreateVolumesFromSnapshotTest-200635454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9cc08fd9-5741-45f3-88bf-eda0a6f7b2cc" returned: 0 in 0.361s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:39 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-95939b14-1bbd-4ecb-b351-a05f737c7aa5 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "cinder-quobyte-9cc08fd9-5741-45f3-88bf-eda0a6f7b2cc" released by "delete_volume" :: held 0.943s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:25:39 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-95939b14-1bbd-4ecb-b351-a05f737c7aa5 tempest-CreateVolumesFromSnapshotTest-200635454 None] Created reservations ['9b3226ef-0152-42fa-8d0a-3b072f790c99', 'f73015f6-3d8d-4253-9e64-ec504b924c92', '7a2c3630-544b-4545-b491-cd6d102681d3', 'a49e853d-e527-4cb5-bca5-1645d4f0d9ed'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:25:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-95939b14-1bbd-4ecb-b351-a05f737c7aa5 tempest-CreateVolumesFromSnapshotTest-200635454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-95939b14-1bbd-4ecb-b351-a05f737c7aa5 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:39 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-95939b14-1bbd-4ecb-b351-a05f737c7aa5 tempest-CreateVolumesFromSnapshotTest-200635454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:25:39 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-95939b14-1bbd-4ecb-b351-a05f737c7aa5 tempest-CreateVolumesFromSnapshotTest-200635454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:25:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-95939b14-1bbd-4ecb-b351-a05f737c7aa5 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-95939b14-1bbd-4ecb-b351-a05f737c7aa5 tempest-CreateVolumesFromSnapshotTest-200635454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:39 devstack sudo[101577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:25:39 devstack sudo[101577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:39 devstack sudo[101577]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-95939b14-1bbd-4ecb-b351-a05f737c7aa5 tempest-CreateVolumesFromSnapshotTest-200635454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.347s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:39 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-95939b14-1bbd-4ecb-b351-a05f737c7aa5 tempest-CreateVolumesFromSnapshotTest-200635454 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:25:39 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-95939b14-1bbd-4ecb-b351-a05f737c7aa5 tempest-CreateVolumesFromSnapshotTest-200635454 None] Deleted volume successfully. Aug 31 15:25:40 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-95939b14-1bbd-4ecb-b351-a05f737c7aa5 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "cinder-9cc08fd9-5741-45f3-88bf-eda0a6f7b2cc-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:25:40 devstack sudo[101559]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_4bmh8d2rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f25d6730-9ac5-4be1-92eb-ee675212d15c" returned: 0 in 2.427s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:40 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_4bmh8d2rdevstack@QuobyteHD, size 112.00 MB, duration 2.43 sec, destination /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f25d6730-9ac5-4be1-92eb-ee675212d15c {{(pid=86000) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 31 15:25:40 devstack cinder-volume[86000]: INFO cinder.image.image_utils [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Converted 112.00 MB image at 46.12 MB/s Aug 31 15:25:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f25d6730-9ac5-4be1-92eb-ee675212d15c 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:40 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-11e06f66-c8a2-48e0-ae8a-1156cc5256cc tempest-CreateVolumesFromSnapshotTest-200635454 None] Acquiring lock "cinder-a71d94c9-0339-4a27-9583-1b7d92cbcc31-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:25:40 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-11e06f66-c8a2-48e0-ae8a-1156cc5256cc tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "cinder-a71d94c9-0339-4a27-9583-1b7d92cbcc31-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:25:40 devstack sudo[101581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f25d6730-9ac5-4be1-92eb-ee675212d15c 1G Aug 31 15:25:40 devstack sudo[101581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:40 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-39eb1820-b85f-474d-b7e3-2f9327816c3d tempest-TestStampPattern-603172502 None] Acquiring lock "cinder-07bcb2f9-6d26-412e-b676-6aed3a938bde-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:25:40 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-11e06f66-c8a2-48e0-ae8a-1156cc5256cc tempest-CreateVolumesFromSnapshotTest-200635454 None] Acquiring lock "cinder-quobyte-a71d94c9-0339-4a27-9583-1b7d92cbcc31" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:25:40 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-39eb1820-b85f-474d-b7e3-2f9327816c3d tempest-TestStampPattern-603172502 None] Lock "cinder-07bcb2f9-6d26-412e-b676-6aed3a938bde-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:25:40 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-11e06f66-c8a2-48e0-ae8a-1156cc5256cc tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "cinder-quobyte-a71d94c9-0339-4a27-9583-1b7d92cbcc31" acquired by "delete_volume" :: waited 0.044s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:25:40 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc81d14-86e1-4222-9e72-44b2b65daeb8]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:25:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-11e06f66-c8a2-48e0-ae8a-1156cc5256cc tempest-CreateVolumesFromSnapshotTest-200635454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a71d94c9-0339-4a27-9583-1b7d92cbcc31 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:40 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-39eb1820-b85f-474d-b7e3-2f9327816c3d tempest-TestStampPattern-603172502 None] Acquiring lock "cinder-quobyte-07bcb2f9-6d26-412e-b676-6aed3a938bde" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:25:40 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-39eb1820-b85f-474d-b7e3-2f9327816c3d tempest-TestStampPattern-603172502 None] Lock "cinder-quobyte-07bcb2f9-6d26-412e-b676-6aed3a938bde" acquired by "delete_volume" :: waited 0.027s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:25:41 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab20d6f9-8e16-4958-bd54-e298a417a5ca]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:25:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-39eb1820-b85f-474d-b7e3-2f9327816c3d tempest-TestStampPattern-603172502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:41 devstack sudo[101583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a71d94c9-0339-4a27-9583-1b7d92cbcc31 Aug 31 15:25:41 devstack sudo[101583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:41 devstack sudo[101581]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f25d6730-9ac5-4be1-92eb-ee675212d15c 1G" returned: 0 in 0.470s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:41 devstack cinder-volume[86000]: DEBUG cinder.volume.volume_utils [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Downloaded image 20bdf4f4-1731-4a30-8e37-8e698c01bf5d ((None, [{'url': 'file:///opt/stack/data/glance/images/20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'metadata': {}}])) to volume f25d6730-9ac5-4be1-92eb-ee675212d15c successfully. {{(pid=86000) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 31 15:25:41 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Temporary image 20bdf4f4-1731-4a30-8e37-8e698c01bf5d for user 972de954be064952b24bddfa46a2d487 is deleted. {{(pid=86000) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 31 15:25:41 devstack cinder-volume[86000]: DEBUG cinder.volume.volume_utils [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Marking volume f25d6730-9ac5-4be1-92eb-ee675212d15c as bootable. {{(pid=86000) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 31 15:25:41 devstack sudo[101587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde Aug 31 15:25:41 devstack sudo[101587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:41 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Copying metadata from image 20bdf4f4-1731-4a30-8e37-8e698c01bf5d to f25d6730-9ac5-4be1-92eb-ee675212d15c. {{(pid=86000) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 31 15:25:41 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Creating volume glance metadata for volume f25d6730-9ac5-4be1-92eb-ee675212d15c backed by image 20bdf4f4-1731-4a30-8e37-8e698c01bf5d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86000) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 31 15:25:41 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9233e2c-8f13-4825-ad8e-18cc5300d33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f25d6730-9ac5-4be1-92eb-ee675212d15c', 'volume_size': 1, 'image_id': '20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '567fd89339ed4743bca5bfab8ec3766d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'created_at': datetime.datetime(2026, 8, 31, 13, 6, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 13, 6, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20bdf4f4-1731-4a30-8e37-8e698c01bf5d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:41 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67ce61a1-2a42-48ce-8e95-02618ae0be71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:41 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Volume volume-f25d6730-9ac5-4be1-92eb-ee675212d15c (f25d6730-9ac5-4be1-92eb-ee675212d15c): created successfully Aug 31 15:25:41 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67ce61a1-2a42-48ce-8e95-02618ae0be71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:41 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Flow 'volume_create_manager' (9cd006fd-702b-4c8c-b200-57106ca4a226) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:25:41 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-3d6cd378-7ef4-490c-afec-7856b9d4f136 tempest-VolumesGetTest-722448469 None] Created volume successfully. Aug 31 15:25:41 devstack sudo[101583]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-11e06f66-c8a2-48e0-ae8a-1156cc5256cc tempest-CreateVolumesFromSnapshotTest-200635454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a71d94c9-0339-4a27-9583-1b7d92cbcc31" returned: 0 in 0.493s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-11e06f66-c8a2-48e0-ae8a-1156cc5256cc tempest-CreateVolumesFromSnapshotTest-200635454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a71d94c9-0339-4a27-9583-1b7d92cbcc31 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:41 devstack sudo[101593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a71d94c9-0339-4a27-9583-1b7d92cbcc31 Aug 31 15:25:41 devstack sudo[101593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:41 devstack sudo[101587]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-39eb1820-b85f-474d-b7e3-2f9327816c3d tempest-TestStampPattern-603172502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde" returned: 0 in 0.531s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-39eb1820-b85f-474d-b7e3-2f9327816c3d tempest-TestStampPattern-603172502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:41 devstack sudo[101598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde Aug 31 15:25:41 devstack sudo[101598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:41 devstack sudo[101593]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-11e06f66-c8a2-48e0-ae8a-1156cc5256cc tempest-CreateVolumesFromSnapshotTest-200635454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a71d94c9-0339-4a27-9583-1b7d92cbcc31" returned: 0 in 0.304s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:41 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-11e06f66-c8a2-48e0-ae8a-1156cc5256cc tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "cinder-quobyte-a71d94c9-0339-4a27-9583-1b7d92cbcc31" released by "delete_volume" :: held 0.856s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:25:41 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-11e06f66-c8a2-48e0-ae8a-1156cc5256cc tempest-CreateVolumesFromSnapshotTest-200635454 None] Created reservations ['e7a298dc-4856-41fb-9036-be027b0a9bc0', '29df9959-52c2-4077-acbe-5f80fc706896', '67977eda-acd3-48c2-8d41-aa2292101b87', '1aa93d5c-c0fd-40c5-948f-2d4d39f75175'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:25:41 devstack sudo[101598]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-39eb1820-b85f-474d-b7e3-2f9327816c3d tempest-TestStampPattern-603172502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-07bcb2f9-6d26-412e-b676-6aed3a938bde" returned: 0 in 0.346s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-11e06f66-c8a2-48e0-ae8a-1156cc5256cc tempest-CreateVolumesFromSnapshotTest-200635454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-11e06f66-c8a2-48e0-ae8a-1156cc5256cc tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:41 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-11e06f66-c8a2-48e0-ae8a-1156cc5256cc tempest-CreateVolumesFromSnapshotTest-200635454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:25:41 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-11e06f66-c8a2-48e0-ae8a-1156cc5256cc tempest-CreateVolumesFromSnapshotTest-200635454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:25:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-11e06f66-c8a2-48e0-ae8a-1156cc5256cc tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-11e06f66-c8a2-48e0-ae8a-1156cc5256cc tempest-CreateVolumesFromSnapshotTest-200635454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:41 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-39eb1820-b85f-474d-b7e3-2f9327816c3d tempest-TestStampPattern-603172502 None] Lock "cinder-quobyte-07bcb2f9-6d26-412e-b676-6aed3a938bde" released by "delete_volume" :: held 0.989s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:25:42 devstack sudo[101602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:25:42 devstack sudo[101602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:42 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-398f8c89-553e-4365-9319-e77b010519b1 tempest-CreateVolumesFromSnapshotTest-200635454 None] Acquiring lock "cinder-465d20c4-ddba-42a1-bbc2-e16a37e6ee81-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:25:42 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-398f8c89-553e-4365-9319-e77b010519b1 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "cinder-465d20c4-ddba-42a1-bbc2-e16a37e6ee81-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:25:42 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-39eb1820-b85f-474d-b7e3-2f9327816c3d tempest-TestStampPattern-603172502 None] Created reservations ['ff4ad09a-b055-4f11-89ec-aa99894da6ee', '405af915-d4aa-44b6-9434-27f9b07eb02a', 'def9d434-8203-4825-a2f3-4e74ab2b4ef5', 'f6d16280-b8b9-4f8f-a6b0-716efb92e53a'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:25:42 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-398f8c89-553e-4365-9319-e77b010519b1 tempest-CreateVolumesFromSnapshotTest-200635454 None] Acquiring lock "cinder-quobyte-465d20c4-ddba-42a1-bbc2-e16a37e6ee81" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:25:42 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-398f8c89-553e-4365-9319-e77b010519b1 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "cinder-quobyte-465d20c4-ddba-42a1-bbc2-e16a37e6ee81" acquired by "delete_volume" :: waited 0.039s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:25:42 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3c08bc-a003-43af-8b51-ac91195f534f]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:25:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-398f8c89-553e-4365-9319-e77b010519b1 tempest-CreateVolumesFromSnapshotTest-200635454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-465d20c4-ddba-42a1-bbc2-e16a37e6ee81 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-39eb1820-b85f-474d-b7e3-2f9327816c3d tempest-TestStampPattern-603172502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-39eb1820-b85f-474d-b7e3-2f9327816c3d tempest-TestStampPattern-603172502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:42 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-39eb1820-b85f-474d-b7e3-2f9327816c3d tempest-TestStampPattern-603172502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:25:42 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-39eb1820-b85f-474d-b7e3-2f9327816c3d tempest-TestStampPattern-603172502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:25:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-39eb1820-b85f-474d-b7e3-2f9327816c3d tempest-TestStampPattern-603172502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-39eb1820-b85f-474d-b7e3-2f9327816c3d tempest-TestStampPattern-603172502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:42 devstack sudo[101602]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:42 devstack sudo[101605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:25:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-11e06f66-c8a2-48e0-ae8a-1156cc5256cc tempest-CreateVolumesFromSnapshotTest-200635454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.393s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:42 devstack sudo[101605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:42 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-11e06f66-c8a2-48e0-ae8a-1156cc5256cc tempest-CreateVolumesFromSnapshotTest-200635454 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:25:42 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-11e06f66-c8a2-48e0-ae8a-1156cc5256cc tempest-CreateVolumesFromSnapshotTest-200635454 None] Deleted volume successfully. Aug 31 15:25:42 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-11e06f66-c8a2-48e0-ae8a-1156cc5256cc tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "cinder-a71d94c9-0339-4a27-9583-1b7d92cbcc31-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:25:42 devstack sudo[101604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-465d20c4-ddba-42a1-bbc2-e16a37e6ee81 Aug 31 15:25:42 devstack sudo[101604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:42 devstack sudo[101605]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-39eb1820-b85f-474d-b7e3-2f9327816c3d tempest-TestStampPattern-603172502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.364s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:42 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-39eb1820-b85f-474d-b7e3-2f9327816c3d tempest-TestStampPattern-603172502 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:25:42 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-39eb1820-b85f-474d-b7e3-2f9327816c3d tempest-TestStampPattern-603172502 None] Deleted volume successfully. Aug 31 15:25:42 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-39eb1820-b85f-474d-b7e3-2f9327816c3d tempest-TestStampPattern-603172502 None] Lock "cinder-07bcb2f9-6d26-412e-b676-6aed3a938bde-delete_volume" released by "delete_volume" :: held 1.847s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:25:42 devstack sudo[101604]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-398f8c89-553e-4365-9319-e77b010519b1 tempest-CreateVolumesFromSnapshotTest-200635454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-465d20c4-ddba-42a1-bbc2-e16a37e6ee81" returned: 0 in 0.560s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-398f8c89-553e-4365-9319-e77b010519b1 tempest-CreateVolumesFromSnapshotTest-200635454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-465d20c4-ddba-42a1-bbc2-e16a37e6ee81 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:42 devstack sudo[101613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-465d20c4-ddba-42a1-bbc2-e16a37e6ee81 Aug 31 15:25:42 devstack sudo[101613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:43 devstack sudo[101613]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-398f8c89-553e-4365-9319-e77b010519b1 tempest-CreateVolumesFromSnapshotTest-200635454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-465d20c4-ddba-42a1-bbc2-e16a37e6ee81" returned: 0 in 0.299s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:43 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-398f8c89-553e-4365-9319-e77b010519b1 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "cinder-quobyte-465d20c4-ddba-42a1-bbc2-e16a37e6ee81" released by "delete_volume" :: held 0.929s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:25:43 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb71dad8-3378-402d-b5dc-ab4a19c7e0eb tempest-VolumesGetTest-722448469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:25:43 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-fb71dad8-3378-402d-b5dc-ab4a19c7e0eb tempest-VolumesGetTest-722448469 None] Flow 'volume_create_manager' (02201506-0f46-412e-94f1-2deccb0ce015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:25:43 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-fb71dad8-3378-402d-b5dc-ab4a19c7e0eb tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (209702e8-23c4-4afb-80af-f1c213414db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:43 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-fb71dad8-3378-402d-b5dc-ab4a19c7e0eb tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (209702e8-23c4-4afb-80af-f1c213414db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:25:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2113743752',display_name='tempest-VolumesGetTest-Volume-1095699941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94280853-1796-4dba-a134-6cf47488220d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2d13a635434495f88759f010f2182c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:25:43Z,use_quota=True,user_id='972de954be064952b24bddfa46a2d487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:43 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-fb71dad8-3378-402d-b5dc-ab4a19c7e0eb tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2dd9918-3b84-401b-a58b-3382dbf38762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:43 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-fb71dad8-3378-402d-b5dc-ab4a19c7e0eb tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2dd9918-3b84-401b-a58b-3382dbf38762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:43 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-fb71dad8-3378-402d-b5dc-ab4a19c7e0eb tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0610dc9c-01bc-4129-a773-27c49543ac96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:43 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-fb71dad8-3378-402d-b5dc-ab4a19c7e0eb tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0610dc9c-01bc-4129-a773-27c49543ac96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94280853-1796-4dba-a134-6cf47488220d', 'volume_name': 'volume-94280853-1796-4dba-a134-6cf47488220d', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:43 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-fb71dad8-3378-402d-b5dc-ab4a19c7e0eb tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64948eff-22e4-40b9-b3dc-cf6760df60d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:43 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-fb71dad8-3378-402d-b5dc-ab4a19c7e0eb tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64948eff-22e4-40b9-b3dc-cf6760df60d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:43 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-fb71dad8-3378-402d-b5dc-ab4a19c7e0eb tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feb28b28-1d20-48eb-82b0-98a909530125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:43 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-fb71dad8-3378-402d-b5dc-ab4a19c7e0eb tempest-VolumesGetTest-722448469 None] Volume 94280853-1796-4dba-a134-6cf47488220d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94280853-1796-4dba-a134-6cf47488220d', 'volume_size': 1} Aug 31 15:25:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-fb71dad8-3378-402d-b5dc-ab4a19c7e0eb tempest-VolumesGetTest-722448469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-fb71dad8-3378-402d-b5dc-ab4a19c7e0eb tempest-VolumesGetTest-722448469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:43 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-fb71dad8-3378-402d-b5dc-ab4a19c7e0eb tempest-VolumesGetTest-722448469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:25:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2113743752',display_name='tempest-VolumesGetTest-Volume-1095699941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94280853-1796-4dba-a134-6cf47488220d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2d13a635434495f88759f010f2182c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:25:43Z,use_quota=True,user_id='972de954be064952b24bddfa46a2d487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:25:43 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-fb71dad8-3378-402d-b5dc-ab4a19c7e0eb tempest-VolumesGetTest-722448469 None] Creating volume 94280853-1796-4dba-a134-6cf47488220d {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:25:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-fb71dad8-3378-402d-b5dc-ab4a19c7e0eb tempest-VolumesGetTest-722448469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-fb71dad8-3378-402d-b5dc-ab4a19c7e0eb tempest-VolumesGetTest-722448469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:43 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-fb71dad8-3378-402d-b5dc-ab4a19c7e0eb tempest-VolumesGetTest-722448469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:25:43 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-fb71dad8-3378-402d-b5dc-ab4a19c7e0eb tempest-VolumesGetTest-722448469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:25:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-fb71dad8-3378-402d-b5dc-ab4a19c7e0eb tempest-VolumesGetTest-722448469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:43 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-fb71dad8-3378-402d-b5dc-ab4a19c7e0eb tempest-VolumesGetTest-722448469 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:25:43 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-fb71dad8-3378-402d-b5dc-ab4a19c7e0eb tempest-VolumesGetTest-722448469 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:25:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-fb71dad8-3378-402d-b5dc-ab4a19c7e0eb tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-94280853-1796-4dba-a134-6cf47488220d 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:43 devstack sudo[101616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-94280853-1796-4dba-a134-6cf47488220d 1073741824 Aug 31 15:25:43 devstack sudo[101616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:43 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-398f8c89-553e-4365-9319-e77b010519b1 tempest-CreateVolumesFromSnapshotTest-200635454 None] Created reservations ['193ddc9a-4696-4d15-be4b-a98fdf718382', '1782d0c3-e9f0-42ca-be0c-b1791a4295b5', 'f6173f01-311d-4142-9300-3a39b268c905', '4476a921-6f54-4f37-9a4a-986097e3a76b'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:25:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-398f8c89-553e-4365-9319-e77b010519b1 tempest-CreateVolumesFromSnapshotTest-200635454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-398f8c89-553e-4365-9319-e77b010519b1 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:43 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-398f8c89-553e-4365-9319-e77b010519b1 tempest-CreateVolumesFromSnapshotTest-200635454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:25:43 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-398f8c89-553e-4365-9319-e77b010519b1 tempest-CreateVolumesFromSnapshotTest-200635454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:25:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-398f8c89-553e-4365-9319-e77b010519b1 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-398f8c89-553e-4365-9319-e77b010519b1 tempest-CreateVolumesFromSnapshotTest-200635454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:43 devstack sudo[101619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:25:43 devstack sudo[101619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:43 devstack sudo[101619]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-398f8c89-553e-4365-9319-e77b010519b1 tempest-CreateVolumesFromSnapshotTest-200635454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.271s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:43 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-398f8c89-553e-4365-9319-e77b010519b1 tempest-CreateVolumesFromSnapshotTest-200635454 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:25:43 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-398f8c89-553e-4365-9319-e77b010519b1 tempest-CreateVolumesFromSnapshotTest-200635454 None] Deleted volume successfully. Aug 31 15:25:43 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-398f8c89-553e-4365-9319-e77b010519b1 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "cinder-465d20c4-ddba-42a1-bbc2-e16a37e6ee81-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:25:43 devstack sudo[101616]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-fb71dad8-3378-402d-b5dc-ab4a19c7e0eb tempest-VolumesGetTest-722448469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-94280853-1796-4dba-a134-6cf47488220d 1073741824" returned: 0 in 0.629s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-fb71dad8-3378-402d-b5dc-ab4a19c7e0eb tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-94280853-1796-4dba-a134-6cf47488220d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:43 devstack sudo[101626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-94280853-1796-4dba-a134-6cf47488220d Aug 31 15:25:43 devstack sudo[101626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:44 devstack sudo[101626]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-fb71dad8-3378-402d-b5dc-ab4a19c7e0eb tempest-VolumesGetTest-722448469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-94280853-1796-4dba-a134-6cf47488220d" returned: 0 in 0.277s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:44 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-fb71dad8-3378-402d-b5dc-ab4a19c7e0eb tempest-VolumesGetTest-722448469 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:25:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-fb71dad8-3378-402d-b5dc-ab4a19c7e0eb tempest-VolumesGetTest-722448469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:44 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-fb71dad8-3378-402d-b5dc-ab4a19c7e0eb tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feb28b28-1d20-48eb-82b0-98a909530125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94280853-1796-4dba-a134-6cf47488220d', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:44 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-fb71dad8-3378-402d-b5dc-ab4a19c7e0eb tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0717dda5-c353-4199-836b-852fda34aba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:44 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-fb71dad8-3378-402d-b5dc-ab4a19c7e0eb tempest-VolumesGetTest-722448469 None] Volume volume-94280853-1796-4dba-a134-6cf47488220d (94280853-1796-4dba-a134-6cf47488220d): created successfully Aug 31 15:25:44 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-fb71dad8-3378-402d-b5dc-ab4a19c7e0eb tempest-VolumesGetTest-722448469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0717dda5-c353-4199-836b-852fda34aba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:44 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-fb71dad8-3378-402d-b5dc-ab4a19c7e0eb tempest-VolumesGetTest-722448469 None] Flow 'volume_create_manager' (02201506-0f46-412e-94f1-2deccb0ce015) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:25:44 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-fb71dad8-3378-402d-b5dc-ab4a19c7e0eb tempest-VolumesGetTest-722448469 None] Created volume successfully. Aug 31 15:25:44 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-28c03a5c-4239-4a8b-98cf-6a29d47ab2ac tempest-CreateVolumesFromSnapshotTest-200635454 None] Acquiring lock "cinder-feac0c72-433b-4aee-b41b-e278e2122a1f-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:25:44 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-28c03a5c-4239-4a8b-98cf-6a29d47ab2ac tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "cinder-feac0c72-433b-4aee-b41b-e278e2122a1f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:25:44 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-28c03a5c-4239-4a8b-98cf-6a29d47ab2ac tempest-CreateVolumesFromSnapshotTest-200635454 None] Acquiring lock "cinder-quobyte-feac0c72-433b-4aee-b41b-e278e2122a1f" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:25:44 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-28c03a5c-4239-4a8b-98cf-6a29d47ab2ac tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "cinder-quobyte-feac0c72-433b-4aee-b41b-e278e2122a1f" acquired by "delete_volume" :: waited 0.023s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:25:44 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48c5caf-d63a-44a3-8882-1c23b74ab80c]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:25:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-28c03a5c-4239-4a8b-98cf-6a29d47ab2ac tempest-CreateVolumesFromSnapshotTest-200635454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-feac0c72-433b-4aee-b41b-e278e2122a1f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:44 devstack sudo[101629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-feac0c72-433b-4aee-b41b-e278e2122a1f Aug 31 15:25:44 devstack sudo[101629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:45 devstack sudo[101629]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-28c03a5c-4239-4a8b-98cf-6a29d47ab2ac tempest-CreateVolumesFromSnapshotTest-200635454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-feac0c72-433b-4aee-b41b-e278e2122a1f" returned: 0 in 0.469s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-28c03a5c-4239-4a8b-98cf-6a29d47ab2ac tempest-CreateVolumesFromSnapshotTest-200635454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-feac0c72-433b-4aee-b41b-e278e2122a1f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:45 devstack sudo[101635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-feac0c72-433b-4aee-b41b-e278e2122a1f Aug 31 15:25:45 devstack sudo[101635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:45 devstack cinder-volume[86000]: DEBUG oslo_service.periodic_task [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86000) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:25:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:25:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:25:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:45 devstack sudo[101637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:25:45 devstack sudo[101637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:45 devstack sudo[101635]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-28c03a5c-4239-4a8b-98cf-6a29d47ab2ac tempest-CreateVolumesFromSnapshotTest-200635454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-feac0c72-433b-4aee-b41b-e278e2122a1f" returned: 0 in 0.308s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:45 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-28c03a5c-4239-4a8b-98cf-6a29d47ab2ac tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "cinder-quobyte-feac0c72-433b-4aee-b41b-e278e2122a1f" released by "delete_volume" :: held 0.835s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:25:45 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-28c03a5c-4239-4a8b-98cf-6a29d47ab2ac tempest-CreateVolumesFromSnapshotTest-200635454 None] Created reservations ['881e0cd4-a1e5-4e69-98ce-4477892d0693', '6831afe0-8cea-47e5-9d9f-345b4d865f2a', 'bc43d319-ed47-48a9-8674-ae4b0bff7cf7', '1f8c57ad-8586-4609-a63a-c57c25a1c347'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:25:45 devstack sudo[101637]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.473s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:45 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:25:45 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-417b1fbd-c6ba-44fb-859c-5ac64e9288c8 tempest-VolumesGetTest-722448469 None] Acquiring lock "cinder-94280853-1796-4dba-a134-6cf47488220d-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:25:45 devstack cinder-volume[86000]: DEBUG oslo_service.periodic_task [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running periodic task VolumeManager._thread_info {{(pid=86000) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:25:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] thread count: 28 {{(pid=86000) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 31 15:25:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] thread info: [<_MainThread(MainThread, started 137631281086592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86000) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 31 15:25:45 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-417b1fbd-c6ba-44fb-859c-5ac64e9288c8 tempest-VolumesGetTest-722448469 None] Lock "cinder-94280853-1796-4dba-a134-6cf47488220d-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:25:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-28c03a5c-4239-4a8b-98cf-6a29d47ab2ac tempest-CreateVolumesFromSnapshotTest-200635454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-28c03a5c-4239-4a8b-98cf-6a29d47ab2ac tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-28c03a5c-4239-4a8b-98cf-6a29d47ab2ac tempest-CreateVolumesFromSnapshotTest-200635454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:25:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-28c03a5c-4239-4a8b-98cf-6a29d47ab2ac tempest-CreateVolumesFromSnapshotTest-200635454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:25:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-28c03a5c-4239-4a8b-98cf-6a29d47ab2ac tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-28c03a5c-4239-4a8b-98cf-6a29d47ab2ac tempest-CreateVolumesFromSnapshotTest-200635454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:45 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-923a7fc7-a114-46c6-9032-d884dca5e142 tempest-CreateVolumesFromSnapshotTest-200635454 None] Acquiring lock "cinder-470b8dce-0004-4eaa-9874-7554c37aa963-delete_snapshot" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:25:45 devstack sudo[101641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:25:45 devstack sudo[101641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:45 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-923a7fc7-a114-46c6-9032-d884dca5e142 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "cinder-470b8dce-0004-4eaa-9874-7554c37aa963-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:25:45 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-923a7fc7-a114-46c6-9032-d884dca5e142 tempest-CreateVolumesFromSnapshotTest-200635454 None] Acquiring lock "cinder-quobyte-12f923b3-10b6-4343-a41a-cb05d9bdf345" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:25:45 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-417b1fbd-c6ba-44fb-859c-5ac64e9288c8 tempest-VolumesGetTest-722448469 None] Acquiring lock "cinder-quobyte-94280853-1796-4dba-a134-6cf47488220d" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:25:45 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-923a7fc7-a114-46c6-9032-d884dca5e142 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "cinder-quobyte-12f923b3-10b6-4343-a41a-cb05d9bdf345" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:25:45 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-923a7fc7-a114-46c6-9032-d884dca5e142 tempest-CreateVolumesFromSnapshotTest-200635454 None] Acquiring lock "cinder-quobyte-470b8dce-0004-4eaa-9874-7554c37aa963" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:25:45 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-417b1fbd-c6ba-44fb-859c-5ac64e9288c8 tempest-VolumesGetTest-722448469 None] Lock "cinder-quobyte-94280853-1796-4dba-a134-6cf47488220d" acquired by "delete_volume" :: waited 0.038s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:25:45 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-923a7fc7-a114-46c6-9032-d884dca5e142 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "cinder-quobyte-470b8dce-0004-4eaa-9874-7554c37aa963" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:25:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-923a7fc7-a114-46c6-9032-d884dca5e142 tempest-CreateVolumesFromSnapshotTest-200635454 None] Deleting offline snapshot 470b8dce-0004-4eaa-9874-7554c37aa963 of volume 12f923b3-10b6-4343-a41a-cb05d9bdf345 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:25:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-923a7fc7-a114-46c6-9032-d884dca5e142 tempest-CreateVolumesFromSnapshotTest-200635454 None] snapshot_file for this snap is: volume-12f923b3-10b6-4343-a41a-cb05d9bdf345.470b8dce-0004-4eaa-9874-7554c37aa963 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:25:45 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[78067ef6-7a5d-41c2-8451-d9d749cd525a]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:25:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-417b1fbd-c6ba-44fb-859c-5ac64e9288c8 tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-94280853-1796-4dba-a134-6cf47488220d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:45 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d7656a-fc88-47c5-a353-a313b768c19b]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:25:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-923a7fc7-a114-46c6-9032-d884dca5e142 tempest-CreateVolumesFromSnapshotTest-200635454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345.470b8dce-0004-4eaa-9874-7554c37aa963 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:46 devstack sudo[101641]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-28c03a5c-4239-4a8b-98cf-6a29d47ab2ac tempest-CreateVolumesFromSnapshotTest-200635454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.378s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:46 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-28c03a5c-4239-4a8b-98cf-6a29d47ab2ac tempest-CreateVolumesFromSnapshotTest-200635454 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:25:46 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-28c03a5c-4239-4a8b-98cf-6a29d47ab2ac tempest-CreateVolumesFromSnapshotTest-200635454 None] Deleted volume successfully. Aug 31 15:25:46 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-28c03a5c-4239-4a8b-98cf-6a29d47ab2ac tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "cinder-feac0c72-433b-4aee-b41b-e278e2122a1f-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:25:46 devstack sudo[101643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-94280853-1796-4dba-a134-6cf47488220d Aug 31 15:25:46 devstack sudo[101643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:46 devstack sudo[101644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345.470b8dce-0004-4eaa-9874-7554c37aa963 Aug 31 15:25:46 devstack sudo[101644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:46 devstack sudo[101643]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-417b1fbd-c6ba-44fb-859c-5ac64e9288c8 tempest-VolumesGetTest-722448469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-94280853-1796-4dba-a134-6cf47488220d" returned: 0 in 0.466s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-417b1fbd-c6ba-44fb-859c-5ac64e9288c8 tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-94280853-1796-4dba-a134-6cf47488220d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:46 devstack sudo[101651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-94280853-1796-4dba-a134-6cf47488220d Aug 31 15:25:46 devstack sudo[101651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:46 devstack sudo[101644]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-923a7fc7-a114-46c6-9032-d884dca5e142 tempest-CreateVolumesFromSnapshotTest-200635454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345.470b8dce-0004-4eaa-9874-7554c37aa963" returned: 0 in 0.604s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:46 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-923a7fc7-a114-46c6-9032-d884dca5e142 tempest-CreateVolumesFromSnapshotTest-200635454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12f923b3-10b6-4343-a41a-cb05d9bdf345(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:25:46 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6bb1b9-35b5-44db-96c9-c9fc389758ef]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:25:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-923a7fc7-a114-46c6-9032-d884dca5e142 tempest-CreateVolumesFromSnapshotTest-200635454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:46 devstack sudo[101651]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:46 devstack sudo[101657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345 Aug 31 15:25:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-417b1fbd-c6ba-44fb-859c-5ac64e9288c8 tempest-VolumesGetTest-722448469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-94280853-1796-4dba-a134-6cf47488220d" returned: 0 in 0.363s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:46 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:46 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-417b1fbd-c6ba-44fb-859c-5ac64e9288c8 tempest-VolumesGetTest-722448469 None] Lock "cinder-quobyte-94280853-1796-4dba-a134-6cf47488220d" released by "delete_volume" :: held 0.953s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:25:46 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-417b1fbd-c6ba-44fb-859c-5ac64e9288c8 tempest-VolumesGetTest-722448469 None] Created reservations ['f05dfe52-bce2-441e-a255-5843ba1f50a2', '456810dc-98aa-4e8b-818c-89443b23c586', '484165dd-c3c8-4f30-84be-72d8e454aa75', '4fa4e00a-56cb-4aa0-bebd-002fb29a0b2c'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:25:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-417b1fbd-c6ba-44fb-859c-5ac64e9288c8 tempest-VolumesGetTest-722448469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-417b1fbd-c6ba-44fb-859c-5ac64e9288c8 tempest-VolumesGetTest-722448469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:46 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-417b1fbd-c6ba-44fb-859c-5ac64e9288c8 tempest-VolumesGetTest-722448469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:25:46 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-417b1fbd-c6ba-44fb-859c-5ac64e9288c8 tempest-VolumesGetTest-722448469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:25:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-417b1fbd-c6ba-44fb-859c-5ac64e9288c8 tempest-VolumesGetTest-722448469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-417b1fbd-c6ba-44fb-859c-5ac64e9288c8 tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:47 devstack sudo[101660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:25:47 devstack sudo[101660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:47 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-923a7fc7-a114-46c6-9032-d884dca5e142 tempest-CreateVolumesFromSnapshotTest-200635454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345" returned: 0 in 0.548s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-923a7fc7-a114-46c6-9032-d884dca5e142 tempest-CreateVolumesFromSnapshotTest-200635454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345.470b8dce-0004-4eaa-9874-7554c37aa963 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:47 devstack sudo[101665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345.470b8dce-0004-4eaa-9874-7554c37aa963 Aug 31 15:25:47 devstack sudo[101665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:47 devstack sudo[101660]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-417b1fbd-c6ba-44fb-859c-5ac64e9288c8 tempest-VolumesGetTest-722448469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.345s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:47 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-417b1fbd-c6ba-44fb-859c-5ac64e9288c8 tempest-VolumesGetTest-722448469 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:25:47 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-417b1fbd-c6ba-44fb-859c-5ac64e9288c8 tempest-VolumesGetTest-722448469 None] Deleted volume successfully. Aug 31 15:25:47 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-417b1fbd-c6ba-44fb-859c-5ac64e9288c8 tempest-VolumesGetTest-722448469 None] Lock "cinder-94280853-1796-4dba-a134-6cf47488220d-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:25:47 devstack sudo[101665]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-923a7fc7-a114-46c6-9032-d884dca5e142 tempest-CreateVolumesFromSnapshotTest-200635454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345.470b8dce-0004-4eaa-9874-7554c37aa963" returned: 0 in 0.488s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-923a7fc7-a114-46c6-9032-d884dca5e142 tempest-CreateVolumesFromSnapshotTest-200635454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345.470b8dce-0004-4eaa-9874-7554c37aa963 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:47 devstack sudo[101672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345.470b8dce-0004-4eaa-9874-7554c37aa963 Aug 31 15:25:47 devstack sudo[101672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:47 devstack sudo[101672]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-923a7fc7-a114-46c6-9032-d884dca5e142 tempest-CreateVolumesFromSnapshotTest-200635454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345.470b8dce-0004-4eaa-9874-7554c37aa963" returned: 0 in 0.325s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:48 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-923a7fc7-a114-46c6-9032-d884dca5e142 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "cinder-quobyte-470b8dce-0004-4eaa-9874-7554c37aa963" released by "_delete_snapshot" :: held 2.138s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:25:48 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-923a7fc7-a114-46c6-9032-d884dca5e142 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "cinder-quobyte-12f923b3-10b6-4343-a41a-cb05d9bdf345" released by "delete_snapshot" :: held 2.202s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:25:48 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4bf5d5db-0da9-4cb8-a646-bbc561c977d8 tempest-VolumesGetTest-722448469 None] Acquiring lock "cinder-f25d6730-9ac5-4be1-92eb-ee675212d15c-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:25:48 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4bf5d5db-0da9-4cb8-a646-bbc561c977d8 tempest-VolumesGetTest-722448469 None] Lock "cinder-f25d6730-9ac5-4be1-92eb-ee675212d15c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:25:48 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4bf5d5db-0da9-4cb8-a646-bbc561c977d8 tempest-VolumesGetTest-722448469 None] Acquiring lock "cinder-quobyte-f25d6730-9ac5-4be1-92eb-ee675212d15c" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:25:48 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4bf5d5db-0da9-4cb8-a646-bbc561c977d8 tempest-VolumesGetTest-722448469 None] Lock "cinder-quobyte-f25d6730-9ac5-4be1-92eb-ee675212d15c" acquired by "delete_volume" :: waited 0.034s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:25:48 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-923a7fc7-a114-46c6-9032-d884dca5e142 tempest-CreateVolumesFromSnapshotTest-200635454 None] Created reservations ['d88f5183-26b7-40b0-b461-9aed62778b24', '22832029-d6c4-4156-ad92-2e6a733303e4', 'bc3efc70-a793-462e-9723-9cd836bbfded', 'b02b511b-31e5-49b3-a8c5-239c4d5fe4cd'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:25:48 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d4963e-602f-498e-936d-4a9c6c123dd5]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:25:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4bf5d5db-0da9-4cb8-a646-bbc561c977d8 tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f25d6730-9ac5-4be1-92eb-ee675212d15c {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:48 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-923a7fc7-a114-46c6-9032-d884dca5e142 tempest-CreateVolumesFromSnapshotTest-200635454 None] Delete snapshot completed successfully. Aug 31 15:25:48 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-923a7fc7-a114-46c6-9032-d884dca5e142 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "cinder-470b8dce-0004-4eaa-9874-7554c37aa963-delete_snapshot" released by "delete_snapshot" :: held 2.496s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:25:48 devstack sudo[101675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f25d6730-9ac5-4be1-92eb-ee675212d15c Aug 31 15:25:48 devstack sudo[101675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:48 devstack sudo[101675]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4bf5d5db-0da9-4cb8-a646-bbc561c977d8 tempest-VolumesGetTest-722448469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f25d6730-9ac5-4be1-92eb-ee675212d15c" returned: 0 in 0.407s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4bf5d5db-0da9-4cb8-a646-bbc561c977d8 tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f25d6730-9ac5-4be1-92eb-ee675212d15c {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:48 devstack sudo[101680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f25d6730-9ac5-4be1-92eb-ee675212d15c Aug 31 15:25:48 devstack sudo[101680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:48 devstack sudo[101680]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4bf5d5db-0da9-4cb8-a646-bbc561c977d8 tempest-VolumesGetTest-722448469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f25d6730-9ac5-4be1-92eb-ee675212d15c" returned: 0 in 0.288s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:48 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4bf5d5db-0da9-4cb8-a646-bbc561c977d8 tempest-VolumesGetTest-722448469 None] Lock "cinder-quobyte-f25d6730-9ac5-4be1-92eb-ee675212d15c" released by "delete_volume" :: held 0.754s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:25:48 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-4bf5d5db-0da9-4cb8-a646-bbc561c977d8 tempest-VolumesGetTest-722448469 None] Created reservations ['eece62e0-4506-4684-9ec3-b126efe5e792', 'f27e6332-5c45-42b6-9bb8-14cd98cb6039', '74ac3675-d703-4667-aa19-b85411f543e4', '63ca4672-f34d-4375-a95b-4d262f20c029'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:25:49 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-650eb702-d8c7-486d-ac94-15386b3d9333 tempest-CreateVolumesFromSnapshotTest-200635454 None] Acquiring lock "cinder-12f923b3-10b6-4343-a41a-cb05d9bdf345-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:25:49 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-650eb702-d8c7-486d-ac94-15386b3d9333 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "cinder-12f923b3-10b6-4343-a41a-cb05d9bdf345-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:25:49 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-650eb702-d8c7-486d-ac94-15386b3d9333 tempest-CreateVolumesFromSnapshotTest-200635454 None] Acquiring lock "cinder-quobyte-12f923b3-10b6-4343-a41a-cb05d9bdf345" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:25:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4bf5d5db-0da9-4cb8-a646-bbc561c977d8 tempest-VolumesGetTest-722448469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4bf5d5db-0da9-4cb8-a646-bbc561c977d8 tempest-VolumesGetTest-722448469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:49 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4bf5d5db-0da9-4cb8-a646-bbc561c977d8 tempest-VolumesGetTest-722448469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:25:49 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4bf5d5db-0da9-4cb8-a646-bbc561c977d8 tempest-VolumesGetTest-722448469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:25:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4bf5d5db-0da9-4cb8-a646-bbc561c977d8 tempest-VolumesGetTest-722448469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4bf5d5db-0da9-4cb8-a646-bbc561c977d8 tempest-VolumesGetTest-722448469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:49 devstack sudo[101683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:25:49 devstack sudo[101683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:49 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-650eb702-d8c7-486d-ac94-15386b3d9333 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "cinder-quobyte-12f923b3-10b6-4343-a41a-cb05d9bdf345" acquired by "delete_volume" :: waited 0.046s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:25:49 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8737a3-8ec7-4507-b76d-1d856012ef8b]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:25:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-650eb702-d8c7-486d-ac94-15386b3d9333 tempest-CreateVolumesFromSnapshotTest-200635454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:49 devstack sudo[101685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345 Aug 31 15:25:49 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:49 devstack sudo[101683]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4bf5d5db-0da9-4cb8-a646-bbc561c977d8 tempest-VolumesGetTest-722448469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.367s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:49 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-4bf5d5db-0da9-4cb8-a646-bbc561c977d8 tempest-VolumesGetTest-722448469 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:25:49 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-4bf5d5db-0da9-4cb8-a646-bbc561c977d8 tempest-VolumesGetTest-722448469 None] Deleted volume successfully. Aug 31 15:25:49 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4bf5d5db-0da9-4cb8-a646-bbc561c977d8 tempest-VolumesGetTest-722448469 None] Lock "cinder-f25d6730-9ac5-4be1-92eb-ee675212d15c-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:25:49 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-650eb702-d8c7-486d-ac94-15386b3d9333 tempest-CreateVolumesFromSnapshotTest-200635454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345" returned: 0 in 0.470s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-650eb702-d8c7-486d-ac94-15386b3d9333 tempest-CreateVolumesFromSnapshotTest-200635454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:49 devstack sudo[101692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345 Aug 31 15:25:49 devstack sudo[101692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:50 devstack sudo[101692]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-650eb702-d8c7-486d-ac94-15386b3d9333 tempest-CreateVolumesFromSnapshotTest-200635454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-12f923b3-10b6-4343-a41a-cb05d9bdf345" returned: 0 in 0.452s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:50 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-650eb702-d8c7-486d-ac94-15386b3d9333 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "cinder-quobyte-12f923b3-10b6-4343-a41a-cb05d9bdf345" released by "delete_volume" :: held 1.018s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:25:50 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-650eb702-d8c7-486d-ac94-15386b3d9333 tempest-CreateVolumesFromSnapshotTest-200635454 None] Created reservations ['86d9928d-9219-4f41-9eb2-a060c678a1ba', 'b5fb465c-21f7-40cd-a3d7-4de06a384794', 'f028a92c-b42e-4ae7-b4a1-80d742887849', '7c5d713f-6952-4677-a786-16074744c80d'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:25:50 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:25:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Flow 'volume_create_manager' (45224d70-960f-4e2a-9597-c3ee689346b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:25:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c4e0fe7-c7f7-411f-a96b-cc0e216fd41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-650eb702-d8c7-486d-ac94-15386b3d9333 tempest-CreateVolumesFromSnapshotTest-200635454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-650eb702-d8c7-486d-ac94-15386b3d9333 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:50 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-650eb702-d8c7-486d-ac94-15386b3d9333 tempest-CreateVolumesFromSnapshotTest-200635454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:25:50 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-650eb702-d8c7-486d-ac94-15386b3d9333 tempest-CreateVolumesFromSnapshotTest-200635454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:25:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-650eb702-d8c7-486d-ac94-15386b3d9333 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-650eb702-d8c7-486d-ac94-15386b3d9333 tempest-CreateVolumesFromSnapshotTest-200635454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c4e0fe7-c7f7-411f-a96b-cc0e216fd41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-315065073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=377b42d6-0086-4561-a536-34876380339c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69216c9779334030b0156c167f9358e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:25:50Z,use_quota=True,user_id='8c421af3b1144c288abde88130822e3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86e9152a-5bb9-439a-9620-bcba33814c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:50 devstack sudo[101696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:25:50 devstack sudo[101696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86e9152a-5bb9-439a-9620-bcba33814c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1704e25f-61ec-4c26-bd06-e62e4247a3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:50 devstack cinder-volume[86000]: DEBUG cinder.image.glance [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Creating Keystone auth plugin from conf {{(pid=86000) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 31 15:25:50 devstack sudo[101696]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-650eb702-d8c7-486d-ac94-15386b3d9333 tempest-CreateVolumesFromSnapshotTest-200635454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.280s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:50 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-650eb702-d8c7-486d-ac94-15386b3d9333 tempest-CreateVolumesFromSnapshotTest-200635454 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:25:50 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-650eb702-d8c7-486d-ac94-15386b3d9333 tempest-CreateVolumesFromSnapshotTest-200635454 None] Deleted volume successfully. Aug 31 15:25:50 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-650eb702-d8c7-486d-ac94-15386b3d9333 tempest-CreateVolumesFromSnapshotTest-200635454 None] Lock "cinder-12f923b3-10b6-4343-a41a-cb05d9bdf345-delete_volume" released by "delete_volume" :: held 1.731s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:25:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1704e25f-61ec-4c26-bd06-e62e4247a3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '377b42d6-0086-4561-a536-34876380339c', 'volume_name': 'volume-377b42d6-0086-4561-a536-34876380339c', 'volume_size': 1, 'image_id': '20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '567fd89339ed4743bca5bfab8ec3766d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'created_at': datetime.datetime(2026, 8, 31, 13, 6, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 13, 6, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20bdf4f4-1731-4a30-8e37-8e698c01bf5d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4756876-c996-462e-b6c2-3058e3537f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4756876-c996-462e-b6c2-3058e3537f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1052906-775e-4256-b2ff-7734a3cb942a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:50 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Volume 377b42d6-0086-4561-a536-34876380339c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-377b42d6-0086-4561-a536-34876380339c', 'volume_size': 1, 'image_id': '20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '567fd89339ed4743bca5bfab8ec3766d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'created_at': datetime.datetime(2026, 8, 31, 13, 6, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 13, 6, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20bdf4f4-1731-4a30-8e37-8e698c01bf5d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 31 15:25:50 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Trying to clone 377b42d6-0086-4561-a536-34876380339c from image 20bdf4f4-1731-4a30-8e37-8e698c01bf5d at location (None, [{'url': 'file:///opt/stack/data/glance/images/20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'metadata': {}}]). {{(pid=86000) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 31 15:25:51 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_0w88ayr_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86000) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 31 15:25:51 devstack cinder-volume[86000]: INFO cinder.image.image_utils [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Image download 20.69 MB at 20.69 MB/s Aug 31 15:25:51 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cd914e-ce78-41fc-9d86-e1088e7f0850]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:25:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_0w88ayr_devstack@QuobyteHD {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:51 devstack sudo[101701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_0w88ayr_devstack@QuobyteHD Aug 31 15:25:51 devstack sudo[101701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:51 devstack sudo[101701]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_0w88ayr_devstack@QuobyteHD" returned: 0 in 0.406s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:51 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Temporary image 20bdf4f4-1731-4a30-8e37-8e698c01bf5d is fetched for user 8c421af3b1144c288abde88130822e3f. {{(pid=86000) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 31 15:25:51 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e7cd66-1696-4911-9e40-3f0597f06220]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:25:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_0w88ayr_devstack@QuobyteHD {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:52 devstack sudo[101706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_0w88ayr_devstack@QuobyteHD Aug 31 15:25:52 devstack sudo[101706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:52 devstack sudo[101706]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_0w88ayr_devstack@QuobyteHD" returned: 0 in 0.539s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:52 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-315065073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=377b42d6-0086-4561-a536-34876380339c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69216c9779334030b0156c167f9358e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:25:50Z,use_quota=True,user_id='8c421af3b1144c288abde88130822e3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:25:52 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Creating volume 377b42d6-0086-4561-a536-34876380339c {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:25:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:52 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:25:52 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:25:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:52 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:25:52 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:25:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-377b42d6-0086-4561-a536-34876380339c 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:52 devstack sudo[101711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-377b42d6-0086-4561-a536-34876380339c 1073741824 Aug 31 15:25:52 devstack sudo[101711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:53 devstack sudo[101711]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-377b42d6-0086-4561-a536-34876380339c 1073741824" returned: 0 in 0.630s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-377b42d6-0086-4561-a536-34876380339c {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:53 devstack sudo[101718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-377b42d6-0086-4561-a536-34876380339c Aug 31 15:25:53 devstack sudo[101718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:53 devstack sudo[101718]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-377b42d6-0086-4561-a536-34876380339c" returned: 0 in 0.396s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:53 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:25:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:53 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd6587a3-0c78-47c2-a6b1-dcfbe522b179 tempest-VolumesListTestJSON-1523751690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:25:53 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-bd6587a3-0c78-47c2-a6b1-dcfbe522b179 tempest-VolumesListTestJSON-1523751690 None] Flow 'volume_create_manager' (fd0568f7-591e-4d4c-a01e-002582481a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:25:53 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-bd6587a3-0c78-47c2-a6b1-dcfbe522b179 tempest-VolumesListTestJSON-1523751690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d3b3fe7-f70f-46c2-a2b7-ad93eb479dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:53 devstack cinder-volume[86000]: DEBUG cinder.volume.volume_utils [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Attempting download of 20bdf4f4-1731-4a30-8e37-8e698c01bf5d ((None, [{'url': 'file:///opt/stack/data/glance/images/20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'metadata': {}}])) to volume 377b42d6-0086-4561-a536-34876380339c. {{(pid=86000) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 31 15:25:53 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-bd6587a3-0c78-47c2-a6b1-dcfbe522b179 tempest-VolumesListTestJSON-1523751690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d3b3fe7-f70f-46c2-a2b7-ad93eb479dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:25:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-523590103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3b70027-fd77-4af1-b546-223431d92dae,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='25dd7441ef4c44e0956a8b480cf93943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:25:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:25:54Z,use_quota=True,user_id='0980da89ffdb4345ab118fbf14defffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:53 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-bd6587a3-0c78-47c2-a6b1-dcfbe522b179 tempest-VolumesListTestJSON-1523751690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee5c154c-d4d7-4e2d-b368-609e7101a248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:53 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-bd6587a3-0c78-47c2-a6b1-dcfbe522b179 tempest-VolumesListTestJSON-1523751690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee5c154c-d4d7-4e2d-b368-609e7101a248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:53 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-bd6587a3-0c78-47c2-a6b1-dcfbe522b179 tempest-VolumesListTestJSON-1523751690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbaeb80f-9418-471c-a4af-4deaf64160ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:53 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-bd6587a3-0c78-47c2-a6b1-dcfbe522b179 tempest-VolumesListTestJSON-1523751690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbaeb80f-9418-471c-a4af-4deaf64160ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3b70027-fd77-4af1-b546-223431d92dae', 'volume_name': 'volume-f3b70027-fd77-4af1-b546-223431d92dae', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:53 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-bd6587a3-0c78-47c2-a6b1-dcfbe522b179 tempest-VolumesListTestJSON-1523751690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (742ca901-0be2-4634-9672-3387e6dfbcdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:53 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-bd6587a3-0c78-47c2-a6b1-dcfbe522b179 tempest-VolumesListTestJSON-1523751690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (742ca901-0be2-4634-9672-3387e6dfbcdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:53 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-bd6587a3-0c78-47c2-a6b1-dcfbe522b179 tempest-VolumesListTestJSON-1523751690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff858d4a-1c2d-4212-a93d-57eaf5e6b982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:53 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-bd6587a3-0c78-47c2-a6b1-dcfbe522b179 tempest-VolumesListTestJSON-1523751690 None] Volume f3b70027-fd77-4af1-b546-223431d92dae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3b70027-fd77-4af1-b546-223431d92dae', 'volume_size': 1} Aug 31 15:25:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bd6587a3-0c78-47c2-a6b1-dcfbe522b179 tempest-VolumesListTestJSON-1523751690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bd6587a3-0c78-47c2-a6b1-dcfbe522b179 tempest-VolumesListTestJSON-1523751690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:53 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-bd6587a3-0c78-47c2-a6b1-dcfbe522b179 tempest-VolumesListTestJSON-1523751690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:25:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-523590103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3b70027-fd77-4af1-b546-223431d92dae,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='25dd7441ef4c44e0956a8b480cf93943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:25:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:25:54Z,use_quota=True,user_id='0980da89ffdb4345ab118fbf14defffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:25:53 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-bd6587a3-0c78-47c2-a6b1-dcfbe522b179 tempest-VolumesListTestJSON-1523751690 None] Creating volume f3b70027-fd77-4af1-b546-223431d92dae {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:25:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bd6587a3-0c78-47c2-a6b1-dcfbe522b179 tempest-VolumesListTestJSON-1523751690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bd6587a3-0c78-47c2-a6b1-dcfbe522b179 tempest-VolumesListTestJSON-1523751690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:53 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-bd6587a3-0c78-47c2-a6b1-dcfbe522b179 tempest-VolumesListTestJSON-1523751690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:25:53 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-bd6587a3-0c78-47c2-a6b1-dcfbe522b179 tempest-VolumesListTestJSON-1523751690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:25:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bd6587a3-0c78-47c2-a6b1-dcfbe522b179 tempest-VolumesListTestJSON-1523751690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:53 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-bd6587a3-0c78-47c2-a6b1-dcfbe522b179 tempest-VolumesListTestJSON-1523751690 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:25:53 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-bd6587a3-0c78-47c2-a6b1-dcfbe522b179 tempest-VolumesListTestJSON-1523751690 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:25:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bd6587a3-0c78-47c2-a6b1-dcfbe522b179 tempest-VolumesListTestJSON-1523751690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f3b70027-fd77-4af1-b546-223431d92dae 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:53 devstack sudo[101721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f3b70027-fd77-4af1-b546-223431d92dae 1073741824 Aug 31 15:25:53 devstack sudo[101721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:53 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[13182b81-fae1-4ff8-8748-94d3e0ab100b]: (4, 'raw') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:25:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_d9ibdafo {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:53 devstack sudo[101723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_d9ibdafo Aug 31 15:25:53 devstack sudo[101723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:54 devstack sudo[101723]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_d9ibdafo" returned: 0 in 0.365s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_d9ibdafo {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:54 devstack sudo[101721]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bd6587a3-0c78-47c2-a6b1-dcfbe522b179 tempest-VolumesListTestJSON-1523751690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f3b70027-fd77-4af1-b546-223431d92dae 1073741824" returned: 0 in 0.577s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:54 devstack sudo[101731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_d9ibdafo Aug 31 15:25:54 devstack sudo[101731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bd6587a3-0c78-47c2-a6b1-dcfbe522b179 tempest-VolumesListTestJSON-1523751690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f3b70027-fd77-4af1-b546-223431d92dae {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:54 devstack sudo[101733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f3b70027-fd77-4af1-b546-223431d92dae Aug 31 15:25:54 devstack sudo[101733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:54 devstack sudo[101731]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_d9ibdafo" returned: 1 in 0.416s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_d9ibdafo' failed. Not Retrying. {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 31 15:25:54 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a5d244-9db6-4d8d-ab5a-ac8c9fbba648]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:25:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_0w88ayr_devstack@QuobyteHD {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:54 devstack sudo[101733]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bd6587a3-0c78-47c2-a6b1-dcfbe522b179 tempest-VolumesListTestJSON-1523751690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f3b70027-fd77-4af1-b546-223431d92dae" returned: 0 in 0.285s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:54 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-bd6587a3-0c78-47c2-a6b1-dcfbe522b179 tempest-VolumesListTestJSON-1523751690 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:25:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bd6587a3-0c78-47c2-a6b1-dcfbe522b179 tempest-VolumesListTestJSON-1523751690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:54 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-bd6587a3-0c78-47c2-a6b1-dcfbe522b179 tempest-VolumesListTestJSON-1523751690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff858d4a-1c2d-4212-a93d-57eaf5e6b982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3b70027-fd77-4af1-b546-223431d92dae', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:54 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-bd6587a3-0c78-47c2-a6b1-dcfbe522b179 tempest-VolumesListTestJSON-1523751690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54738de4-ad66-427c-8450-e6c060b70481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:54 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-bd6587a3-0c78-47c2-a6b1-dcfbe522b179 tempest-VolumesListTestJSON-1523751690 None] Volume volume-f3b70027-fd77-4af1-b546-223431d92dae (f3b70027-fd77-4af1-b546-223431d92dae): created successfully Aug 31 15:25:54 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-bd6587a3-0c78-47c2-a6b1-dcfbe522b179 tempest-VolumesListTestJSON-1523751690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54738de4-ad66-427c-8450-e6c060b70481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:54 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-bd6587a3-0c78-47c2-a6b1-dcfbe522b179 tempest-VolumesListTestJSON-1523751690 None] Flow 'volume_create_manager' (fd0568f7-591e-4d4c-a01e-002582481a83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:25:54 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-bd6587a3-0c78-47c2-a6b1-dcfbe522b179 tempest-VolumesListTestJSON-1523751690 None] Created volume successfully. Aug 31 15:25:54 devstack sudo[101738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_0w88ayr_devstack@QuobyteHD Aug 31 15:25:54 devstack sudo[101738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:54 devstack sudo[101738]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_0w88ayr_devstack@QuobyteHD" returned: 0 in 0.370s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:54 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] 20bdf4f4-1731-4a30-8e37-8e698c01bf5d was qcow2, converting to qcow2 {{(pid=86000) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 31 15:25:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_0w88ayr_devstack@QuobyteHD /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-377b42d6-0086-4561-a536-34876380339c {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:54 devstack sudo[101743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_0w88ayr_devstack@QuobyteHD /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-377b42d6-0086-4561-a536-34876380339c Aug 31 15:25:54 devstack sudo[101743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:55 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e40800b-95c6-490e-9161-3f41aaadfe40 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:25:55 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7e40800b-95c6-490e-9161-3f41aaadfe40 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Flow 'volume_create_manager' (da4507d1-98a1-4c2c-872c-6921a123fde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:25:55 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7e40800b-95c6-490e-9161-3f41aaadfe40 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a71bbe1-a6af-46cb-afdb-3df46b1c8e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:55 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7e40800b-95c6-490e-9161-3f41aaadfe40 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a71bbe1-a6af-46cb-afdb-3df46b1c8e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-62132909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c73c0407-6719-4f9f-952d-1001d59cc2f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a774ba9a15a4233a428da1dc5882cf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:25:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:25:55Z,use_quota=True,user_id='736397e2c4bb4a488b885ea3eb5bea9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:55 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7e40800b-95c6-490e-9161-3f41aaadfe40 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (839b5d1a-5211-43c7-88d9-302dc85d141a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:55 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7e40800b-95c6-490e-9161-3f41aaadfe40 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (839b5d1a-5211-43c7-88d9-302dc85d141a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:55 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7e40800b-95c6-490e-9161-3f41aaadfe40 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a43a9f9-a189-44ae-b271-33b6bdde98d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:55 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7e40800b-95c6-490e-9161-3f41aaadfe40 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a43a9f9-a189-44ae-b271-33b6bdde98d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c73c0407-6719-4f9f-952d-1001d59cc2f9', 'volume_name': 'volume-c73c0407-6719-4f9f-952d-1001d59cc2f9', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:55 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7e40800b-95c6-490e-9161-3f41aaadfe40 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ec18974-9201-43a7-a654-5247e2130a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:55 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7e40800b-95c6-490e-9161-3f41aaadfe40 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ec18974-9201-43a7-a654-5247e2130a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:55 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7e40800b-95c6-490e-9161-3f41aaadfe40 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bfb43b4-62a5-4412-8826-c0a21c6a930f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:55 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-7e40800b-95c6-490e-9161-3f41aaadfe40 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Volume c73c0407-6719-4f9f-952d-1001d59cc2f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c73c0407-6719-4f9f-952d-1001d59cc2f9', 'volume_size': 1} Aug 31 15:25:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7e40800b-95c6-490e-9161-3f41aaadfe40 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7e40800b-95c6-490e-9161-3f41aaadfe40 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:55 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-7e40800b-95c6-490e-9161-3f41aaadfe40 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-62132909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c73c0407-6719-4f9f-952d-1001d59cc2f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a774ba9a15a4233a428da1dc5882cf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:25:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:25:55Z,use_quota=True,user_id='736397e2c4bb4a488b885ea3eb5bea9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:25:55 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-7e40800b-95c6-490e-9161-3f41aaadfe40 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Creating volume c73c0407-6719-4f9f-952d-1001d59cc2f9 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:25:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7e40800b-95c6-490e-9161-3f41aaadfe40 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7e40800b-95c6-490e-9161-3f41aaadfe40 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:55 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-7e40800b-95c6-490e-9161-3f41aaadfe40 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:25:55 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-7e40800b-95c6-490e-9161-3f41aaadfe40 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:25:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7e40800b-95c6-490e-9161-3f41aaadfe40 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:55 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-7e40800b-95c6-490e-9161-3f41aaadfe40 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:25:55 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-7e40800b-95c6-490e-9161-3f41aaadfe40 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:25:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7e40800b-95c6-490e-9161-3f41aaadfe40 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c73c0407-6719-4f9f-952d-1001d59cc2f9 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:55 devstack sudo[101749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c73c0407-6719-4f9f-952d-1001d59cc2f9 1073741824 Aug 31 15:25:55 devstack sudo[101749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:56 devstack sudo[101749]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7e40800b-95c6-490e-9161-3f41aaadfe40 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c73c0407-6719-4f9f-952d-1001d59cc2f9 1073741824" returned: 0 in 0.638s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7e40800b-95c6-490e-9161-3f41aaadfe40 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c73c0407-6719-4f9f-952d-1001d59cc2f9 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:56 devstack sudo[101760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c73c0407-6719-4f9f-952d-1001d59cc2f9 Aug 31 15:25:56 devstack sudo[101760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:56 devstack sudo[101760]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:56 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-19440b9f-3f9b-4a8c-815d-3fb7f38799f9 tempest-VolumesListTestJSON-1523751690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:25:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-19440b9f-3f9b-4a8c-815d-3fb7f38799f9 tempest-VolumesListTestJSON-1523751690 None] Flow 'volume_create_manager' (6e00f456-e3bb-4265-a347-1bb5451632d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:25:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-19440b9f-3f9b-4a8c-815d-3fb7f38799f9 tempest-VolumesListTestJSON-1523751690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4315eb98-665c-4236-ab64-347a8e3524d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7e40800b-95c6-490e-9161-3f41aaadfe40 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c73c0407-6719-4f9f-952d-1001d59cc2f9" returned: 0 in 0.406s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-7e40800b-95c6-490e-9161-3f41aaadfe40 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:25:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7e40800b-95c6-490e-9161-3f41aaadfe40 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-19440b9f-3f9b-4a8c-815d-3fb7f38799f9 tempest-VolumesListTestJSON-1523751690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4315eb98-665c-4236-ab64-347a8e3524d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1239486577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d77d24c-9720-4557-92f3-59deda8a96d5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='25dd7441ef4c44e0956a8b480cf93943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:25:56Z,use_quota=True,user_id='0980da89ffdb4345ab118fbf14defffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-19440b9f-3f9b-4a8c-815d-3fb7f38799f9 tempest-VolumesListTestJSON-1523751690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6897d8cd-11c4-41a5-baf4-e0148dc7c934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-19440b9f-3f9b-4a8c-815d-3fb7f38799f9 tempest-VolumesListTestJSON-1523751690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6897d8cd-11c4-41a5-baf4-e0148dc7c934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-19440b9f-3f9b-4a8c-815d-3fb7f38799f9 tempest-VolumesListTestJSON-1523751690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3db310c4-6a7d-4ce0-8ee7-ff2d03c39f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-19440b9f-3f9b-4a8c-815d-3fb7f38799f9 tempest-VolumesListTestJSON-1523751690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3db310c4-6a7d-4ce0-8ee7-ff2d03c39f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d77d24c-9720-4557-92f3-59deda8a96d5', 'volume_name': 'volume-2d77d24c-9720-4557-92f3-59deda8a96d5', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-19440b9f-3f9b-4a8c-815d-3fb7f38799f9 tempest-VolumesListTestJSON-1523751690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8df7cc40-5674-46b7-8ea0-13b4713591f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-19440b9f-3f9b-4a8c-815d-3fb7f38799f9 tempest-VolumesListTestJSON-1523751690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8df7cc40-5674-46b7-8ea0-13b4713591f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-19440b9f-3f9b-4a8c-815d-3fb7f38799f9 tempest-VolumesListTestJSON-1523751690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3667da4a-cf84-41ec-a8eb-61c23847d134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:56 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-19440b9f-3f9b-4a8c-815d-3fb7f38799f9 tempest-VolumesListTestJSON-1523751690 None] Volume 2d77d24c-9720-4557-92f3-59deda8a96d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d77d24c-9720-4557-92f3-59deda8a96d5', 'volume_size': 1} Aug 31 15:25:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-19440b9f-3f9b-4a8c-815d-3fb7f38799f9 tempest-VolumesListTestJSON-1523751690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-19440b9f-3f9b-4a8c-815d-3fb7f38799f9 tempest-VolumesListTestJSON-1523751690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-19440b9f-3f9b-4a8c-815d-3fb7f38799f9 tempest-VolumesListTestJSON-1523751690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1239486577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d77d24c-9720-4557-92f3-59deda8a96d5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='25dd7441ef4c44e0956a8b480cf93943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:25:56Z,use_quota=True,user_id='0980da89ffdb4345ab118fbf14defffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:25:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-19440b9f-3f9b-4a8c-815d-3fb7f38799f9 tempest-VolumesListTestJSON-1523751690 None] Creating volume 2d77d24c-9720-4557-92f3-59deda8a96d5 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:25:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-19440b9f-3f9b-4a8c-815d-3fb7f38799f9 tempest-VolumesListTestJSON-1523751690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-19440b9f-3f9b-4a8c-815d-3fb7f38799f9 tempest-VolumesListTestJSON-1523751690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-19440b9f-3f9b-4a8c-815d-3fb7f38799f9 tempest-VolumesListTestJSON-1523751690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:25:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-19440b9f-3f9b-4a8c-815d-3fb7f38799f9 tempest-VolumesListTestJSON-1523751690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:25:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-19440b9f-3f9b-4a8c-815d-3fb7f38799f9 tempest-VolumesListTestJSON-1523751690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-19440b9f-3f9b-4a8c-815d-3fb7f38799f9 tempest-VolumesListTestJSON-1523751690 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:25:56 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-19440b9f-3f9b-4a8c-815d-3fb7f38799f9 tempest-VolumesListTestJSON-1523751690 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:25:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-19440b9f-3f9b-4a8c-815d-3fb7f38799f9 tempest-VolumesListTestJSON-1523751690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2d77d24c-9720-4557-92f3-59deda8a96d5 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7e40800b-95c6-490e-9161-3f41aaadfe40 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bfb43b4-62a5-4412-8826-c0a21c6a930f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c73c0407-6719-4f9f-952d-1001d59cc2f9', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7e40800b-95c6-490e-9161-3f41aaadfe40 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a655065-05a2-43ed-bf85-4e217255bca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:56 devstack sudo[101764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2d77d24c-9720-4557-92f3-59deda8a96d5 1073741824 Aug 31 15:25:56 devstack sudo[101764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:56 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-7e40800b-95c6-490e-9161-3f41aaadfe40 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Volume volume-c73c0407-6719-4f9f-952d-1001d59cc2f9 (c73c0407-6719-4f9f-952d-1001d59cc2f9): created successfully Aug 31 15:25:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7e40800b-95c6-490e-9161-3f41aaadfe40 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a655065-05a2-43ed-bf85-4e217255bca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7e40800b-95c6-490e-9161-3f41aaadfe40 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Flow 'volume_create_manager' (da4507d1-98a1-4c2c-872c-6921a123fde4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:25:56 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-7e40800b-95c6-490e-9161-3f41aaadfe40 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Created volume successfully. Aug 31 15:25:57 devstack sudo[101743]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_0w88ayr_devstack@QuobyteHD /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-377b42d6-0086-4561-a536-34876380339c" returned: 0 in 2.092s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:57 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_20bdf4f4-1731-4a30-8e37-8e698c01bf5d_0w88ayr_devstack@QuobyteHD, size 112.00 MB, duration 2.09 sec, destination /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-377b42d6-0086-4561-a536-34876380339c {{(pid=86000) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 31 15:25:57 devstack cinder-volume[86000]: INFO cinder.image.image_utils [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Converted 112.00 MB image at 53.50 MB/s Aug 31 15:25:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-377b42d6-0086-4561-a536-34876380339c 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:57 devstack sudo[101770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-377b42d6-0086-4561-a536-34876380339c 1G Aug 31 15:25:57 devstack sudo[101770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:57 devstack sudo[101764]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-19440b9f-3f9b-4a8c-815d-3fb7f38799f9 tempest-VolumesListTestJSON-1523751690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2d77d24c-9720-4557-92f3-59deda8a96d5 1073741824" returned: 0 in 0.564s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-19440b9f-3f9b-4a8c-815d-3fb7f38799f9 tempest-VolumesListTestJSON-1523751690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2d77d24c-9720-4557-92f3-59deda8a96d5 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:57 devstack sudo[101772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2d77d24c-9720-4557-92f3-59deda8a96d5 Aug 31 15:25:57 devstack sudo[101772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:57 devstack sudo[101770]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-377b42d6-0086-4561-a536-34876380339c 1G" returned: 0 in 0.380s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:57 devstack cinder-volume[86000]: DEBUG cinder.volume.volume_utils [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Downloaded image 20bdf4f4-1731-4a30-8e37-8e698c01bf5d ((None, [{'url': 'file:///opt/stack/data/glance/images/20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'metadata': {}}])) to volume 377b42d6-0086-4561-a536-34876380339c successfully. {{(pid=86000) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 31 15:25:57 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Temporary image 20bdf4f4-1731-4a30-8e37-8e698c01bf5d for user 8c421af3b1144c288abde88130822e3f is deleted. {{(pid=86000) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 31 15:25:57 devstack cinder-volume[86000]: DEBUG cinder.volume.volume_utils [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Marking volume 377b42d6-0086-4561-a536-34876380339c as bootable. {{(pid=86000) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 31 15:25:57 devstack sudo[101772]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:57 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Copying metadata from image 20bdf4f4-1731-4a30-8e37-8e698c01bf5d to 377b42d6-0086-4561-a536-34876380339c. {{(pid=86000) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 31 15:25:57 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Creating volume glance metadata for volume 377b42d6-0086-4561-a536-34876380339c backed by image 20bdf4f4-1731-4a30-8e37-8e698c01bf5d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86000) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 31 15:25:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-19440b9f-3f9b-4a8c-815d-3fb7f38799f9 tempest-VolumesListTestJSON-1523751690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2d77d24c-9720-4557-92f3-59deda8a96d5" returned: 0 in 0.296s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:57 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-19440b9f-3f9b-4a8c-815d-3fb7f38799f9 tempest-VolumesListTestJSON-1523751690 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:25:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-19440b9f-3f9b-4a8c-815d-3fb7f38799f9 tempest-VolumesListTestJSON-1523751690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-19440b9f-3f9b-4a8c-815d-3fb7f38799f9 tempest-VolumesListTestJSON-1523751690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3667da4a-cf84-41ec-a8eb-61c23847d134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d77d24c-9720-4557-92f3-59deda8a96d5', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-19440b9f-3f9b-4a8c-815d-3fb7f38799f9 tempest-VolumesListTestJSON-1523751690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1d7a58c-a995-409b-ab51-225d7651e925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:57 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-19440b9f-3f9b-4a8c-815d-3fb7f38799f9 tempest-VolumesListTestJSON-1523751690 None] Volume volume-2d77d24c-9720-4557-92f3-59deda8a96d5 (2d77d24c-9720-4557-92f3-59deda8a96d5): created successfully Aug 31 15:25:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-19440b9f-3f9b-4a8c-815d-3fb7f38799f9 tempest-VolumesListTestJSON-1523751690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1d7a58c-a995-409b-ab51-225d7651e925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-19440b9f-3f9b-4a8c-815d-3fb7f38799f9 tempest-VolumesListTestJSON-1523751690 None] Flow 'volume_create_manager' (6e00f456-e3bb-4265-a347-1bb5451632d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:25:57 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-19440b9f-3f9b-4a8c-815d-3fb7f38799f9 tempest-VolumesListTestJSON-1523751690 None] Created volume successfully. Aug 31 15:25:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1052906-775e-4256-b2ff-7734a3cb942a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-377b42d6-0086-4561-a536-34876380339c', 'volume_size': 1, 'image_id': '20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '567fd89339ed4743bca5bfab8ec3766d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20bdf4f4-1731-4a30-8e37-8e698c01bf5d', 'created_at': datetime.datetime(2026, 8, 31, 13, 6, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 13, 6, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20bdf4f4-1731-4a30-8e37-8e698c01bf5d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ee45ce5-b985-4622-a4e0-2b0c9cdc9bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:57 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Volume volume-377b42d6-0086-4561-a536-34876380339c (377b42d6-0086-4561-a536-34876380339c): created successfully Aug 31 15:25:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ee45ce5-b985-4622-a4e0-2b0c9cdc9bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Flow 'volume_create_manager' (45224d70-960f-4e2a-9597-c3ee689346b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:25:57 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-f4373a08-8c7b-4de1-b79d-9c989bdce59e tempest-TestShelveInstance-784750763 None] Created volume successfully. Aug 31 15:25:58 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-70d52791-ab5d-4d0d-a4aa-def8080f7936 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:25:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-70d52791-ab5d-4d0d-a4aa-def8080f7936 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Flow 'volume_create_manager' (bda16ee3-08a4-441a-9cb2-e8b04cd1bf41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:25:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-70d52791-ab5d-4d0d-a4aa-def8080f7936 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8381897b-2f85-4bd6-a90a-d5c6195c7a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-70d52791-ab5d-4d0d-a4aa-def8080f7936 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8381897b-2f85-4bd6-a90a-d5c6195c7a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-716227335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef6606c8-fcc6-4945-a9a9-6647316c8e0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a774ba9a15a4233a428da1dc5882cf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:25:58Z,use_quota=True,user_id='736397e2c4bb4a488b885ea3eb5bea9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-70d52791-ab5d-4d0d-a4aa-def8080f7936 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e20bdea-14e1-48ef-b6c3-748ebf09ca32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-70d52791-ab5d-4d0d-a4aa-def8080f7936 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e20bdea-14e1-48ef-b6c3-748ebf09ca32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-70d52791-ab5d-4d0d-a4aa-def8080f7936 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba05992b-46c5-4124-8fc3-1ef946e1005d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-70d52791-ab5d-4d0d-a4aa-def8080f7936 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba05992b-46c5-4124-8fc3-1ef946e1005d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef6606c8-fcc6-4945-a9a9-6647316c8e0e', 'volume_name': 'volume-ef6606c8-fcc6-4945-a9a9-6647316c8e0e', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-70d52791-ab5d-4d0d-a4aa-def8080f7936 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6cd2303-38e8-43d0-9901-baa93ca5f788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-70d52791-ab5d-4d0d-a4aa-def8080f7936 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6cd2303-38e8-43d0-9901-baa93ca5f788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-70d52791-ab5d-4d0d-a4aa-def8080f7936 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b1a5696-ac4d-4b9a-9b3b-45ff3533e263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:58 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-70d52791-ab5d-4d0d-a4aa-def8080f7936 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Volume ef6606c8-fcc6-4945-a9a9-6647316c8e0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef6606c8-fcc6-4945-a9a9-6647316c8e0e', 'volume_size': 1} Aug 31 15:25:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-70d52791-ab5d-4d0d-a4aa-def8080f7936 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-70d52791-ab5d-4d0d-a4aa-def8080f7936 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:58 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-70d52791-ab5d-4d0d-a4aa-def8080f7936 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-716227335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef6606c8-fcc6-4945-a9a9-6647316c8e0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a774ba9a15a4233a428da1dc5882cf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:25:58Z,use_quota=True,user_id='736397e2c4bb4a488b885ea3eb5bea9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:25:58 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-70d52791-ab5d-4d0d-a4aa-def8080f7936 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Creating volume ef6606c8-fcc6-4945-a9a9-6647316c8e0e {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:25:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-70d52791-ab5d-4d0d-a4aa-def8080f7936 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-70d52791-ab5d-4d0d-a4aa-def8080f7936 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:58 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-70d52791-ab5d-4d0d-a4aa-def8080f7936 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:25:58 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-70d52791-ab5d-4d0d-a4aa-def8080f7936 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:25:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-70d52791-ab5d-4d0d-a4aa-def8080f7936 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:58 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-70d52791-ab5d-4d0d-a4aa-def8080f7936 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:25:58 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-70d52791-ab5d-4d0d-a4aa-def8080f7936 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:25:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-70d52791-ab5d-4d0d-a4aa-def8080f7936 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ef6606c8-fcc6-4945-a9a9-6647316c8e0e 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:58 devstack sudo[101779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ef6606c8-fcc6-4945-a9a9-6647316c8e0e 1073741824 Aug 31 15:25:58 devstack sudo[101779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:58 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca81fda8-8fc5-4662-b8c9-f1674196e00f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:25:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ca81fda8-8fc5-4662-b8c9-f1674196e00f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Flow 'volume_create_manager' (a0720c29-ee1f-432d-9872-ea256db5d03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:25:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ca81fda8-8fc5-4662-b8c9-f1674196e00f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (336f49ed-f1cc-4eb3-8166-4293d3fee76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ca81fda8-8fc5-4662-b8c9-f1674196e00f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (336f49ed-f1cc-4eb3-8166-4293d3fee76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-498453098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5256c43-7ecd-48a2-88e5-7624a6670df7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a774ba9a15a4233a428da1dc5882cf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:25:58Z,use_quota=True,user_id='736397e2c4bb4a488b885ea3eb5bea9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ca81fda8-8fc5-4662-b8c9-f1674196e00f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4672e36f-9d87-43fc-bc49-d9fd342437ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ca81fda8-8fc5-4662-b8c9-f1674196e00f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4672e36f-9d87-43fc-bc49-d9fd342437ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ca81fda8-8fc5-4662-b8c9-f1674196e00f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47b3d927-8b1c-4866-8b1b-226eb0533859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ca81fda8-8fc5-4662-b8c9-f1674196e00f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47b3d927-8b1c-4866-8b1b-226eb0533859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5256c43-7ecd-48a2-88e5-7624a6670df7', 'volume_name': 'volume-a5256c43-7ecd-48a2-88e5-7624a6670df7', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ca81fda8-8fc5-4662-b8c9-f1674196e00f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a38b2cf-c35c-444d-ba52-be186de63e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ca81fda8-8fc5-4662-b8c9-f1674196e00f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a38b2cf-c35c-444d-ba52-be186de63e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ca81fda8-8fc5-4662-b8c9-f1674196e00f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab266cd7-ff04-40c0-bea5-7ed8a2272867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:58 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-ca81fda8-8fc5-4662-b8c9-f1674196e00f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Volume a5256c43-7ecd-48a2-88e5-7624a6670df7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5256c43-7ecd-48a2-88e5-7624a6670df7', 'volume_size': 1} Aug 31 15:25:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ca81fda8-8fc5-4662-b8c9-f1674196e00f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:58 devstack sudo[101779]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-70d52791-ab5d-4d0d-a4aa-def8080f7936 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ef6606c8-fcc6-4945-a9a9-6647316c8e0e 1073741824" returned: 0 in 0.785s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-70d52791-ab5d-4d0d-a4aa-def8080f7936 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ef6606c8-fcc6-4945-a9a9-6647316c8e0e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:59 devstack sudo[101785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ef6606c8-fcc6-4945-a9a9-6647316c8e0e Aug 31 15:25:59 devstack sudo[101785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:59 devstack sudo[101785]: pam_unix(sudo:session): session closed for user root Aug 31 15:25:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-70d52791-ab5d-4d0d-a4aa-def8080f7936 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ef6606c8-fcc6-4945-a9a9-6647316c8e0e" returned: 0 in 0.499s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:25:59 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-70d52791-ab5d-4d0d-a4aa-def8080f7936 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] <== create_volume: return (1372ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:25:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-70d52791-ab5d-4d0d-a4aa-def8080f7936 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.377s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ca81fda8-8fc5-4662-b8c9-f1674196e00f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.870s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:59 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-ca81fda8-8fc5-4662-b8c9-f1674196e00f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-498453098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5256c43-7ecd-48a2-88e5-7624a6670df7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a774ba9a15a4233a428da1dc5882cf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:25:58Z,use_quota=True,user_id='736397e2c4bb4a488b885ea3eb5bea9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:25:59 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-ca81fda8-8fc5-4662-b8c9-f1674196e00f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Creating volume a5256c43-7ecd-48a2-88e5-7624a6670df7 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:25:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ca81fda8-8fc5-4662-b8c9-f1674196e00f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:25:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ca81fda8-8fc5-4662-b8c9-f1674196e00f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:25:59 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-ca81fda8-8fc5-4662-b8c9-f1674196e00f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:25:59 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-ca81fda8-8fc5-4662-b8c9-f1674196e00f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:25:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ca81fda8-8fc5-4662-b8c9-f1674196e00f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:25:59 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-ca81fda8-8fc5-4662-b8c9-f1674196e00f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:25:59 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-ca81fda8-8fc5-4662-b8c9-f1674196e00f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:25:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ca81fda8-8fc5-4662-b8c9-f1674196e00f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a5256c43-7ecd-48a2-88e5-7624a6670df7 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:25:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-70d52791-ab5d-4d0d-a4aa-def8080f7936 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b1a5696-ac4d-4b9a-9b3b-45ff3533e263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef6606c8-fcc6-4945-a9a9-6647316c8e0e', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-70d52791-ab5d-4d0d-a4aa-def8080f7936 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da4ac03a-8d51-461c-8859-6ee0df6ff11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:59 devstack sudo[101788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a5256c43-7ecd-48a2-88e5-7624a6670df7 1073741824 Aug 31 15:25:59 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:25:59 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-70d52791-ab5d-4d0d-a4aa-def8080f7936 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Volume volume-ef6606c8-fcc6-4945-a9a9-6647316c8e0e (ef6606c8-fcc6-4945-a9a9-6647316c8e0e): created successfully Aug 31 15:25:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-70d52791-ab5d-4d0d-a4aa-def8080f7936 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da4ac03a-8d51-461c-8859-6ee0df6ff11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-70d52791-ab5d-4d0d-a4aa-def8080f7936 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Flow 'volume_create_manager' (bda16ee3-08a4-441a-9cb2-e8b04cd1bf41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:25:59 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-70d52791-ab5d-4d0d-a4aa-def8080f7936 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Created volume successfully. Aug 31 15:25:59 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-79032696-e25e-4c5b-88f5-8af39feae645 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:25:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-79032696-e25e-4c5b-88f5-8af39feae645 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Flow 'volume_create_manager' (23762649-e4a5-4b53-aea9-dcdb00cfd64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:25:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-79032696-e25e-4c5b-88f5-8af39feae645 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a6a372f-8043-41df-80d9-86216018907d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-79032696-e25e-4c5b-88f5-8af39feae645 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a6a372f-8043-41df-80d9-86216018907d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-804006328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4df100e1-0efa-4181-8916-942c8c0063ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a774ba9a15a4233a428da1dc5882cf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:25:59Z,use_quota=True,user_id='736397e2c4bb4a488b885ea3eb5bea9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-79032696-e25e-4c5b-88f5-8af39feae645 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09dd28e6-6baf-4b43-b219-462ced6fe3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-79032696-e25e-4c5b-88f5-8af39feae645 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09dd28e6-6baf-4b43-b219-462ced6fe3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-79032696-e25e-4c5b-88f5-8af39feae645 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0727fd9-9ec8-411b-a8be-a458e799b467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-79032696-e25e-4c5b-88f5-8af39feae645 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0727fd9-9ec8-411b-a8be-a458e799b467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4df100e1-0efa-4181-8916-942c8c0063ac', 'volume_name': 'volume-4df100e1-0efa-4181-8916-942c8c0063ac', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-79032696-e25e-4c5b-88f5-8af39feae645 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d1a52f1-5ae0-437a-b4b7-12ef411ea265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-79032696-e25e-4c5b-88f5-8af39feae645 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d1a52f1-5ae0-437a-b4b7-12ef411ea265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:25:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-79032696-e25e-4c5b-88f5-8af39feae645 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33c2092b-f0c6-46de-9953-d14248cd2089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:25:59 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-79032696-e25e-4c5b-88f5-8af39feae645 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Volume 4df100e1-0efa-4181-8916-942c8c0063ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4df100e1-0efa-4181-8916-942c8c0063ac', 'volume_size': 1} Aug 31 15:25:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-79032696-e25e-4c5b-88f5-8af39feae645 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:00 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b2f7847-49a0-4b10-8ddf-53737583746f tempest-VolumesListTestJSON-1523751690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:26:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1b2f7847-49a0-4b10-8ddf-53737583746f tempest-VolumesListTestJSON-1523751690 None] Flow 'volume_create_manager' (895b442a-5fcd-4cd6-abda-eb800cdec02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:26:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1b2f7847-49a0-4b10-8ddf-53737583746f tempest-VolumesListTestJSON-1523751690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb4ea22-3d83-4c92-9071-abbf52d21476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1b2f7847-49a0-4b10-8ddf-53737583746f tempest-VolumesListTestJSON-1523751690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb4ea22-3d83-4c92-9071-abbf52d21476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1615241741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4c7d3b6-ae4e-4cef-98d8-95e011d3c61e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='25dd7441ef4c44e0956a8b480cf93943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:26:00Z,use_quota=True,user_id='0980da89ffdb4345ab118fbf14defffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1b2f7847-49a0-4b10-8ddf-53737583746f tempest-VolumesListTestJSON-1523751690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9e09101-86ce-4a72-8267-969c26768176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1b2f7847-49a0-4b10-8ddf-53737583746f tempest-VolumesListTestJSON-1523751690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9e09101-86ce-4a72-8267-969c26768176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1b2f7847-49a0-4b10-8ddf-53737583746f tempest-VolumesListTestJSON-1523751690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8191495-4f23-459c-ae8d-0881ae81d097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1b2f7847-49a0-4b10-8ddf-53737583746f tempest-VolumesListTestJSON-1523751690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8191495-4f23-459c-ae8d-0881ae81d097) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4c7d3b6-ae4e-4cef-98d8-95e011d3c61e', 'volume_name': 'volume-e4c7d3b6-ae4e-4cef-98d8-95e011d3c61e', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1b2f7847-49a0-4b10-8ddf-53737583746f tempest-VolumesListTestJSON-1523751690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d08801db-7309-4081-afd3-876b7f849669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1b2f7847-49a0-4b10-8ddf-53737583746f tempest-VolumesListTestJSON-1523751690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d08801db-7309-4081-afd3-876b7f849669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1b2f7847-49a0-4b10-8ddf-53737583746f tempest-VolumesListTestJSON-1523751690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (652c8ea1-be4d-4828-abb9-7cadc30b0c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:00 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-1b2f7847-49a0-4b10-8ddf-53737583746f tempest-VolumesListTestJSON-1523751690 None] Volume e4c7d3b6-ae4e-4cef-98d8-95e011d3c61e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4c7d3b6-ae4e-4cef-98d8-95e011d3c61e', 'volume_size': 1} Aug 31 15:26:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1b2f7847-49a0-4b10-8ddf-53737583746f tempest-VolumesListTestJSON-1523751690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:00 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ca81fda8-8fc5-4662-b8c9-f1674196e00f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a5256c43-7ecd-48a2-88e5-7624a6670df7 1073741824" returned: 0 in 0.956s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:00 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-699129b7-ed64-41b3-a611-928da699c34f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:26:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-699129b7-ed64-41b3-a611-928da699c34f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Flow 'volume_create_manager' (024f44ff-f169-4910-9ac0-ae14699a2473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:26:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-699129b7-ed64-41b3-a611-928da699c34f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1545b891-1d5c-4246-b167-acc222151efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:00 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcdeacbd-2896-4dfc-a228-5638b3252357 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:26:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dcdeacbd-2896-4dfc-a228-5638b3252357 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Flow 'volume_create_manager' (f8d55eae-ae16-49dc-9153-39842faf346a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:26:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dcdeacbd-2896-4dfc-a228-5638b3252357 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0af37b25-2005-46fc-acf8-14e71cee66c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-699129b7-ed64-41b3-a611-928da699c34f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1545b891-1d5c-4246-b167-acc222151efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1821693593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab51af5c-f1d0-458b-a857-683642b504a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a774ba9a15a4233a428da1dc5882cf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:26:00Z,use_quota=True,user_id='736397e2c4bb4a488b885ea3eb5bea9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-699129b7-ed64-41b3-a611-928da699c34f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bf486ab-ce52-4028-8b9e-3a60aa235ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-699129b7-ed64-41b3-a611-928da699c34f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bf486ab-ce52-4028-8b9e-3a60aa235ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-699129b7-ed64-41b3-a611-928da699c34f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66acd2fd-e523-4c63-b655-aac86fa7ce30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-699129b7-ed64-41b3-a611-928da699c34f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66acd2fd-e523-4c63-b655-aac86fa7ce30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab51af5c-f1d0-458b-a857-683642b504a6', 'volume_name': 'volume-ab51af5c-f1d0-458b-a857-683642b504a6', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-699129b7-ed64-41b3-a611-928da699c34f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b2e4cec-5043-4373-9e3f-2d70cdebfece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-699129b7-ed64-41b3-a611-928da699c34f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b2e4cec-5043-4373-9e3f-2d70cdebfece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-699129b7-ed64-41b3-a611-928da699c34f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2c9f5b0-86ba-45fa-85dc-f6e4515a86b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:00 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-699129b7-ed64-41b3-a611-928da699c34f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Volume ab51af5c-f1d0-458b-a857-683642b504a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab51af5c-f1d0-458b-a857-683642b504a6', 'volume_size': 1} Aug 31 15:26:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-699129b7-ed64-41b3-a611-928da699c34f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dcdeacbd-2896-4dfc-a228-5638b3252357 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0af37b25-2005-46fc-acf8-14e71cee66c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-599061432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed587291-4d75-4087-a138-495e5c023aff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a774ba9a15a4233a428da1dc5882cf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:26:00Z,use_quota=True,user_id='736397e2c4bb4a488b885ea3eb5bea9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dcdeacbd-2896-4dfc-a228-5638b3252357 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3713baf-c4b2-4f2f-bc13-56b9eb8c1bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dcdeacbd-2896-4dfc-a228-5638b3252357 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3713baf-c4b2-4f2f-bc13-56b9eb8c1bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dcdeacbd-2896-4dfc-a228-5638b3252357 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d95916c6-aac3-4656-9da0-a73b86170823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dcdeacbd-2896-4dfc-a228-5638b3252357 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d95916c6-aac3-4656-9da0-a73b86170823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed587291-4d75-4087-a138-495e5c023aff', 'volume_name': 'volume-ed587291-4d75-4087-a138-495e5c023aff', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dcdeacbd-2896-4dfc-a228-5638b3252357 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a723d1e-442c-44e5-8d7f-60a58d0b5808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dcdeacbd-2896-4dfc-a228-5638b3252357 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a723d1e-442c-44e5-8d7f-60a58d0b5808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dcdeacbd-2896-4dfc-a228-5638b3252357 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02e6737c-717b-4d3b-99af-36923e188380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:00 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-dcdeacbd-2896-4dfc-a228-5638b3252357 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Volume ed587291-4d75-4087-a138-495e5c023aff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed587291-4d75-4087-a138-495e5c023aff', 'volume_size': 1} Aug 31 15:26:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-dcdeacbd-2896-4dfc-a228-5638b3252357 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ca81fda8-8fc5-4662-b8c9-f1674196e00f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a5256c43-7ecd-48a2-88e5-7624a6670df7 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:00 devstack sudo[101801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a5256c43-7ecd-48a2-88e5-7624a6670df7 Aug 31 15:26:00 devstack sudo[101801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:00 devstack sudo[101801]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ca81fda8-8fc5-4662-b8c9-f1674196e00f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a5256c43-7ecd-48a2-88e5-7624a6670df7" returned: 0 in 0.328s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:00 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-ca81fda8-8fc5-4662-b8c9-f1674196e00f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] <== create_volume: return (1501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:26:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ca81fda8-8fc5-4662-b8c9-f1674196e00f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-79032696-e25e-4c5b-88f5-8af39feae645 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.136s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:01 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-79032696-e25e-4c5b-88f5-8af39feae645 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-804006328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4df100e1-0efa-4181-8916-942c8c0063ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a774ba9a15a4233a428da1dc5882cf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:25:59Z,use_quota=True,user_id='736397e2c4bb4a488b885ea3eb5bea9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:26:01 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-79032696-e25e-4c5b-88f5-8af39feae645 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Creating volume 4df100e1-0efa-4181-8916-942c8c0063ac {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:26:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-79032696-e25e-4c5b-88f5-8af39feae645 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-79032696-e25e-4c5b-88f5-8af39feae645 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:01 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-79032696-e25e-4c5b-88f5-8af39feae645 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:26:01 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-79032696-e25e-4c5b-88f5-8af39feae645 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:26:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-79032696-e25e-4c5b-88f5-8af39feae645 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:01 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-79032696-e25e-4c5b-88f5-8af39feae645 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:26:01 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-79032696-e25e-4c5b-88f5-8af39feae645 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:26:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-79032696-e25e-4c5b-88f5-8af39feae645 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4df100e1-0efa-4181-8916-942c8c0063ac 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:01 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ca81fda8-8fc5-4662-b8c9-f1674196e00f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab266cd7-ff04-40c0-bea5-7ed8a2272867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5256c43-7ecd-48a2-88e5-7624a6670df7', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:01 devstack sudo[101804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4df100e1-0efa-4181-8916-942c8c0063ac 1073741824 Aug 31 15:26:01 devstack sudo[101804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:01 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ca81fda8-8fc5-4662-b8c9-f1674196e00f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08387a14-c0b1-4fdb-a47a-e62dfd0d9d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:01 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-ca81fda8-8fc5-4662-b8c9-f1674196e00f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Volume volume-a5256c43-7ecd-48a2-88e5-7624a6670df7 (a5256c43-7ecd-48a2-88e5-7624a6670df7): created successfully Aug 31 15:26:01 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ca81fda8-8fc5-4662-b8c9-f1674196e00f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08387a14-c0b1-4fdb-a47a-e62dfd0d9d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:01 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ca81fda8-8fc5-4662-b8c9-f1674196e00f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Flow 'volume_create_manager' (a0720c29-ee1f-432d-9872-ea256db5d03c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:26:01 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-ca81fda8-8fc5-4662-b8c9-f1674196e00f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Created volume successfully. Aug 31 15:26:01 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7caa994-c71d-41b6-bd9f-26f7a50a496b tempest-VolumeDependencyTests-1985494117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:26:01 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c7caa994-c71d-41b6-bd9f-26f7a50a496b tempest-VolumeDependencyTests-1985494117 None] Flow 'volume_create_manager' (456cc26a-d408-4cb7-aa61-83f8d312255e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:26:01 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c7caa994-c71d-41b6-bd9f-26f7a50a496b tempest-VolumeDependencyTests-1985494117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df18a855-a857-48b3-8f29-725418cc6bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:01 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c7caa994-c71d-41b6-bd9f-26f7a50a496b tempest-VolumeDependencyTests-1985494117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df18a855-a857-48b3-8f29-725418cc6bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1276951013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eea97087-9826-4566-8803-929cc5fceecb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76a31c8c010140b3b796fa5f51db71ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:26:01Z,use_quota=True,user_id='60d593416e414a0887796c12df221bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:01 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c7caa994-c71d-41b6-bd9f-26f7a50a496b tempest-VolumeDependencyTests-1985494117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de0db999-42af-4710-9604-3147ad975a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:01 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c7caa994-c71d-41b6-bd9f-26f7a50a496b tempest-VolumeDependencyTests-1985494117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de0db999-42af-4710-9604-3147ad975a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:01 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c7caa994-c71d-41b6-bd9f-26f7a50a496b tempest-VolumeDependencyTests-1985494117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d61c698-2e56-449f-b93e-b85f9668a42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:01 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c7caa994-c71d-41b6-bd9f-26f7a50a496b tempest-VolumeDependencyTests-1985494117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d61c698-2e56-449f-b93e-b85f9668a42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eea97087-9826-4566-8803-929cc5fceecb', 'volume_name': 'volume-eea97087-9826-4566-8803-929cc5fceecb', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:01 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c7caa994-c71d-41b6-bd9f-26f7a50a496b tempest-VolumeDependencyTests-1985494117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bd03b35-d648-46ce-8cc9-cc2cae7548f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:01 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c7caa994-c71d-41b6-bd9f-26f7a50a496b tempest-VolumeDependencyTests-1985494117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bd03b35-d648-46ce-8cc9-cc2cae7548f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:01 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c7caa994-c71d-41b6-bd9f-26f7a50a496b tempest-VolumeDependencyTests-1985494117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (499afc52-2151-445b-b8d7-47304326b627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:01 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-c7caa994-c71d-41b6-bd9f-26f7a50a496b tempest-VolumeDependencyTests-1985494117 None] Volume eea97087-9826-4566-8803-929cc5fceecb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eea97087-9826-4566-8803-929cc5fceecb', 'volume_size': 1} Aug 31 15:26:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c7caa994-c71d-41b6-bd9f-26f7a50a496b tempest-VolumeDependencyTests-1985494117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:01 devstack sudo[101804]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-79032696-e25e-4c5b-88f5-8af39feae645 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4df100e1-0efa-4181-8916-942c8c0063ac 1073741824" returned: 0 in 0.650s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-79032696-e25e-4c5b-88f5-8af39feae645 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4df100e1-0efa-4181-8916-942c8c0063ac {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:01 devstack sudo[101818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4df100e1-0efa-4181-8916-942c8c0063ac Aug 31 15:26:01 devstack sudo[101818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-2da4d964-5f66-48c8-98bc-506b8270de3b req-581ea211-5858-4e1e-b757-6ec12fc9d2b7 tempest-TestShelveInstance-784750763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:01 devstack sudo[101818]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-79032696-e25e-4c5b-88f5-8af39feae645 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4df100e1-0efa-4181-8916-942c8c0063ac" returned: 0 in 0.259s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:01 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-79032696-e25e-4c5b-88f5-8af39feae645 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:26:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-79032696-e25e-4c5b-88f5-8af39feae645 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1b2f7847-49a0-4b10-8ddf-53737583746f tempest-VolumesListTestJSON-1523751690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.554s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:01 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1b2f7847-49a0-4b10-8ddf-53737583746f tempest-VolumesListTestJSON-1523751690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1615241741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4c7d3b6-ae4e-4cef-98d8-95e011d3c61e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='25dd7441ef4c44e0956a8b480cf93943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:26:00Z,use_quota=True,user_id='0980da89ffdb4345ab118fbf14defffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:26:01 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-1b2f7847-49a0-4b10-8ddf-53737583746f tempest-VolumesListTestJSON-1523751690 None] Creating volume e4c7d3b6-ae4e-4cef-98d8-95e011d3c61e {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:26:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1b2f7847-49a0-4b10-8ddf-53737583746f tempest-VolumesListTestJSON-1523751690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1b2f7847-49a0-4b10-8ddf-53737583746f tempest-VolumesListTestJSON-1523751690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:01 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1b2f7847-49a0-4b10-8ddf-53737583746f tempest-VolumesListTestJSON-1523751690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:26:01 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1b2f7847-49a0-4b10-8ddf-53737583746f tempest-VolumesListTestJSON-1523751690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:26:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1b2f7847-49a0-4b10-8ddf-53737583746f tempest-VolumesListTestJSON-1523751690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:01 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1b2f7847-49a0-4b10-8ddf-53737583746f tempest-VolumesListTestJSON-1523751690 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:26:01 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-1b2f7847-49a0-4b10-8ddf-53737583746f tempest-VolumesListTestJSON-1523751690 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:26:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1b2f7847-49a0-4b10-8ddf-53737583746f tempest-VolumesListTestJSON-1523751690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e4c7d3b6-ae4e-4cef-98d8-95e011d3c61e 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:02 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-79032696-e25e-4c5b-88f5-8af39feae645 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33c2092b-f0c6-46de-9953-d14248cd2089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4df100e1-0efa-4181-8916-942c8c0063ac', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:02 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-79032696-e25e-4c5b-88f5-8af39feae645 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eae4c6f8-64f5-45ac-b907-aedc08630805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:02 devstack sudo[101821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e4c7d3b6-ae4e-4cef-98d8-95e011d3c61e 1073741824 Aug 31 15:26:02 devstack sudo[101821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:02 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-79032696-e25e-4c5b-88f5-8af39feae645 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Volume volume-4df100e1-0efa-4181-8916-942c8c0063ac (4df100e1-0efa-4181-8916-942c8c0063ac): created successfully Aug 31 15:26:02 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-79032696-e25e-4c5b-88f5-8af39feae645 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eae4c6f8-64f5-45ac-b907-aedc08630805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:02 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-79032696-e25e-4c5b-88f5-8af39feae645 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Flow 'volume_create_manager' (23762649-e4a5-4b53-aea9-dcdb00cfd64b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:26:02 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-79032696-e25e-4c5b-88f5-8af39feae645 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Created volume successfully. Aug 31 15:26:02 devstack sudo[101821]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1b2f7847-49a0-4b10-8ddf-53737583746f tempest-VolumesListTestJSON-1523751690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e4c7d3b6-ae4e-4cef-98d8-95e011d3c61e 1073741824" returned: 0 in 0.563s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1b2f7847-49a0-4b10-8ddf-53737583746f tempest-VolumesListTestJSON-1523751690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e4c7d3b6-ae4e-4cef-98d8-95e011d3c61e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:02 devstack sudo[101827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e4c7d3b6-ae4e-4cef-98d8-95e011d3c61e Aug 31 15:26:02 devstack sudo[101827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:02 devstack sudo[101827]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1b2f7847-49a0-4b10-8ddf-53737583746f tempest-VolumesListTestJSON-1523751690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e4c7d3b6-ae4e-4cef-98d8-95e011d3c61e" returned: 0 in 0.258s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:02 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1b2f7847-49a0-4b10-8ddf-53737583746f tempest-VolumesListTestJSON-1523751690 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:26:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1b2f7847-49a0-4b10-8ddf-53737583746f tempest-VolumesListTestJSON-1523751690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-699129b7-ed64-41b3-a611-928da699c34f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.244s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:02 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-699129b7-ed64-41b3-a611-928da699c34f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1821693593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab51af5c-f1d0-458b-a857-683642b504a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a774ba9a15a4233a428da1dc5882cf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:26:00Z,use_quota=True,user_id='736397e2c4bb4a488b885ea3eb5bea9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:26:02 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-699129b7-ed64-41b3-a611-928da699c34f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Creating volume ab51af5c-f1d0-458b-a857-683642b504a6 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:26:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-699129b7-ed64-41b3-a611-928da699c34f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-699129b7-ed64-41b3-a611-928da699c34f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:02 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-699129b7-ed64-41b3-a611-928da699c34f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:26:02 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-699129b7-ed64-41b3-a611-928da699c34f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:26:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-699129b7-ed64-41b3-a611-928da699c34f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:02 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-699129b7-ed64-41b3-a611-928da699c34f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:26:02 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-699129b7-ed64-41b3-a611-928da699c34f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:26:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-699129b7-ed64-41b3-a611-928da699c34f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ab51af5c-f1d0-458b-a857-683642b504a6 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:02 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1b2f7847-49a0-4b10-8ddf-53737583746f tempest-VolumesListTestJSON-1523751690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (652c8ea1-be4d-4828-abb9-7cadc30b0c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4c7d3b6-ae4e-4cef-98d8-95e011d3c61e', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:02 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1b2f7847-49a0-4b10-8ddf-53737583746f tempest-VolumesListTestJSON-1523751690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c6cbfed-1087-4844-a313-cd4814080baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:02 devstack sudo[101830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ab51af5c-f1d0-458b-a857-683642b504a6 1073741824 Aug 31 15:26:02 devstack sudo[101830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:02 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-1b2f7847-49a0-4b10-8ddf-53737583746f tempest-VolumesListTestJSON-1523751690 None] Volume volume-e4c7d3b6-ae4e-4cef-98d8-95e011d3c61e (e4c7d3b6-ae4e-4cef-98d8-95e011d3c61e): created successfully Aug 31 15:26:02 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1b2f7847-49a0-4b10-8ddf-53737583746f tempest-VolumesListTestJSON-1523751690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c6cbfed-1087-4844-a313-cd4814080baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:02 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1b2f7847-49a0-4b10-8ddf-53737583746f tempest-VolumesListTestJSON-1523751690 None] Flow 'volume_create_manager' (895b442a-5fcd-4cd6-abda-eb800cdec02a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:26:02 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-1b2f7847-49a0-4b10-8ddf-53737583746f tempest-VolumesListTestJSON-1523751690 None] Created volume successfully. Aug 31 15:26:03 devstack sudo[101830]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-699129b7-ed64-41b3-a611-928da699c34f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ab51af5c-f1d0-458b-a857-683642b504a6 1073741824" returned: 0 in 0.453s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-699129b7-ed64-41b3-a611-928da699c34f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ab51af5c-f1d0-458b-a857-683642b504a6 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:03 devstack sudo[101836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ab51af5c-f1d0-458b-a857-683642b504a6 Aug 31 15:26:03 devstack sudo[101836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:03 devstack sudo[101836]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-699129b7-ed64-41b3-a611-928da699c34f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ab51af5c-f1d0-458b-a857-683642b504a6" returned: 0 in 0.305s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:03 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-699129b7-ed64-41b3-a611-928da699c34f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:26:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-699129b7-ed64-41b3-a611-928da699c34f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-dcdeacbd-2896-4dfc-a228-5638b3252357 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.015s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:03 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-dcdeacbd-2896-4dfc-a228-5638b3252357 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-599061432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed587291-4d75-4087-a138-495e5c023aff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a774ba9a15a4233a428da1dc5882cf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:26:00Z,use_quota=True,user_id='736397e2c4bb4a488b885ea3eb5bea9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:26:03 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-dcdeacbd-2896-4dfc-a228-5638b3252357 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Creating volume ed587291-4d75-4087-a138-495e5c023aff {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:26:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-dcdeacbd-2896-4dfc-a228-5638b3252357 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-dcdeacbd-2896-4dfc-a228-5638b3252357 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:03 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-dcdeacbd-2896-4dfc-a228-5638b3252357 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:26:03 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-dcdeacbd-2896-4dfc-a228-5638b3252357 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:26:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-dcdeacbd-2896-4dfc-a228-5638b3252357 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:03 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-dcdeacbd-2896-4dfc-a228-5638b3252357 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:26:03 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-dcdeacbd-2896-4dfc-a228-5638b3252357 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:26:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-dcdeacbd-2896-4dfc-a228-5638b3252357 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ed587291-4d75-4087-a138-495e5c023aff 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:03 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-699129b7-ed64-41b3-a611-928da699c34f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2c9f5b0-86ba-45fa-85dc-f6e4515a86b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab51af5c-f1d0-458b-a857-683642b504a6', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:03 devstack sudo[101840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ed587291-4d75-4087-a138-495e5c023aff 1073741824 Aug 31 15:26:03 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-699129b7-ed64-41b3-a611-928da699c34f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94a68c66-13f0-42d1-bd69-a60eee037eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:03 devstack sudo[101840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:03 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-699129b7-ed64-41b3-a611-928da699c34f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Volume volume-ab51af5c-f1d0-458b-a857-683642b504a6 (ab51af5c-f1d0-458b-a857-683642b504a6): created successfully Aug 31 15:26:03 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-699129b7-ed64-41b3-a611-928da699c34f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94a68c66-13f0-42d1-bd69-a60eee037eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:03 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-699129b7-ed64-41b3-a611-928da699c34f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Flow 'volume_create_manager' (024f44ff-f169-4910-9ac0-ae14699a2473) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:26:03 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-699129b7-ed64-41b3-a611-928da699c34f tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Created volume successfully. Aug 31 15:26:04 devstack sudo[101840]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-dcdeacbd-2896-4dfc-a228-5638b3252357 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ed587291-4d75-4087-a138-495e5c023aff 1073741824" returned: 0 in 0.511s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-dcdeacbd-2896-4dfc-a228-5638b3252357 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ed587291-4d75-4087-a138-495e5c023aff {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:04 devstack sudo[101846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ed587291-4d75-4087-a138-495e5c023aff Aug 31 15:26:04 devstack sudo[101846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:04 devstack sudo[101846]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-dcdeacbd-2896-4dfc-a228-5638b3252357 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ed587291-4d75-4087-a138-495e5c023aff" returned: 0 in 0.275s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:04 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-dcdeacbd-2896-4dfc-a228-5638b3252357 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:26:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-dcdeacbd-2896-4dfc-a228-5638b3252357 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c7caa994-c71d-41b6-bd9f-26f7a50a496b tempest-VolumeDependencyTests-1985494117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.948s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:04 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c7caa994-c71d-41b6-bd9f-26f7a50a496b tempest-VolumeDependencyTests-1985494117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1276951013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eea97087-9826-4566-8803-929cc5fceecb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76a31c8c010140b3b796fa5f51db71ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:26:01Z,use_quota=True,user_id='60d593416e414a0887796c12df221bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:26:04 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-c7caa994-c71d-41b6-bd9f-26f7a50a496b tempest-VolumeDependencyTests-1985494117 None] Creating volume eea97087-9826-4566-8803-929cc5fceecb {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:26:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c7caa994-c71d-41b6-bd9f-26f7a50a496b tempest-VolumeDependencyTests-1985494117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c7caa994-c71d-41b6-bd9f-26f7a50a496b tempest-VolumeDependencyTests-1985494117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:04 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c7caa994-c71d-41b6-bd9f-26f7a50a496b tempest-VolumeDependencyTests-1985494117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:26:04 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c7caa994-c71d-41b6-bd9f-26f7a50a496b tempest-VolumeDependencyTests-1985494117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:26:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c7caa994-c71d-41b6-bd9f-26f7a50a496b tempest-VolumeDependencyTests-1985494117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:04 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c7caa994-c71d-41b6-bd9f-26f7a50a496b tempest-VolumeDependencyTests-1985494117 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:26:04 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-c7caa994-c71d-41b6-bd9f-26f7a50a496b tempest-VolumeDependencyTests-1985494117 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:26:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c7caa994-c71d-41b6-bd9f-26f7a50a496b tempest-VolumeDependencyTests-1985494117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:04 devstack sudo[101849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb 1073741824 Aug 31 15:26:04 devstack sudo[101849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dcdeacbd-2896-4dfc-a228-5638b3252357 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02e6737c-717b-4d3b-99af-36923e188380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed587291-4d75-4087-a138-495e5c023aff', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dcdeacbd-2896-4dfc-a228-5638b3252357 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (252d2c2e-4920-4224-97f3-8e3c741d58c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:04 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-dcdeacbd-2896-4dfc-a228-5638b3252357 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Volume volume-ed587291-4d75-4087-a138-495e5c023aff (ed587291-4d75-4087-a138-495e5c023aff): created successfully Aug 31 15:26:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dcdeacbd-2896-4dfc-a228-5638b3252357 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (252d2c2e-4920-4224-97f3-8e3c741d58c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dcdeacbd-2896-4dfc-a228-5638b3252357 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Flow 'volume_create_manager' (f8d55eae-ae16-49dc-9153-39842faf346a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:26:04 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-dcdeacbd-2896-4dfc-a228-5638b3252357 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Created volume successfully. Aug 31 15:26:05 devstack sudo[101849]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:05 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-fcf03a1f-bc19-488f-8af8-436b7025f4ee tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Acquiring lock "cinder-ed587291-4d75-4087-a138-495e5c023aff-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:26:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c7caa994-c71d-41b6-bd9f-26f7a50a496b tempest-VolumeDependencyTests-1985494117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb 1073741824" returned: 0 in 0.521s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:05 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-fcf03a1f-bc19-488f-8af8-436b7025f4ee tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "cinder-ed587291-4d75-4087-a138-495e5c023aff-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:26:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c7caa994-c71d-41b6-bd9f-26f7a50a496b tempest-VolumeDependencyTests-1985494117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:05 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-fcf03a1f-bc19-488f-8af8-436b7025f4ee tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Acquiring lock "cinder-quobyte-ed587291-4d75-4087-a138-495e5c023aff" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:26:05 devstack sudo[101855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb Aug 31 15:26:05 devstack sudo[101855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:05 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-fcf03a1f-bc19-488f-8af8-436b7025f4ee tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "cinder-quobyte-ed587291-4d75-4087-a138-495e5c023aff" acquired by "delete_volume" :: waited 0.018s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:26:05 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a506794-faab-4c6d-91c9-0a034a91ae01]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:26:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-fcf03a1f-bc19-488f-8af8-436b7025f4ee tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ed587291-4d75-4087-a138-495e5c023aff {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:05 devstack sudo[101857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ed587291-4d75-4087-a138-495e5c023aff Aug 31 15:26:05 devstack sudo[101857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:05 devstack sudo[101855]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c7caa994-c71d-41b6-bd9f-26f7a50a496b tempest-VolumeDependencyTests-1985494117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb" returned: 0 in 0.295s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:05 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c7caa994-c71d-41b6-bd9f-26f7a50a496b tempest-VolumeDependencyTests-1985494117 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:26:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c7caa994-c71d-41b6-bd9f-26f7a50a496b tempest-VolumeDependencyTests-1985494117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-2da4d964-5f66-48c8-98bc-506b8270de3b req-581ea211-5858-4e1e-b757-6ec12fc9d2b7 tempest-TestShelveInstance-784750763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.614s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c7caa994-c71d-41b6-bd9f-26f7a50a496b tempest-VolumeDependencyTests-1985494117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (499afc52-2151-445b-b8d7-47304326b627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eea97087-9826-4566-8803-929cc5fceecb', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c7caa994-c71d-41b6-bd9f-26f7a50a496b tempest-VolumeDependencyTests-1985494117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7100efa2-6ac2-4eb4-bba4-55d9eab71f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-2da4d964-5f66-48c8-98bc-506b8270de3b req-581ea211-5858-4e1e-b757-6ec12fc9d2b7 tempest-TestShelveInstance-784750763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:05 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-c7caa994-c71d-41b6-bd9f-26f7a50a496b tempest-VolumeDependencyTests-1985494117 None] Volume volume-eea97087-9826-4566-8803-929cc5fceecb (eea97087-9826-4566-8803-929cc5fceecb): created successfully Aug 31 15:26:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c7caa994-c71d-41b6-bd9f-26f7a50a496b tempest-VolumeDependencyTests-1985494117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7100efa2-6ac2-4eb4-bba4-55d9eab71f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c7caa994-c71d-41b6-bd9f-26f7a50a496b tempest-VolumeDependencyTests-1985494117 None] Flow 'volume_create_manager' (456cc26a-d408-4cb7-aa61-83f8d312255e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:26:05 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-c7caa994-c71d-41b6-bd9f-26f7a50a496b tempest-VolumeDependencyTests-1985494117 None] Created volume successfully. Aug 31 15:26:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-2da4d964-5f66-48c8-98bc-506b8270de3b req-581ea211-5858-4e1e-b757-6ec12fc9d2b7 tempest-TestShelveInstance-784750763 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77', 'name': 'volume-377b42d6-0086-4561-a536-34876380339c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7cf28684-4c3a-4ae6-846c-2dd6382d7e2c', 'enforce_multipath': True} {{(pid=86000) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 31 15:26:05 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-2da4d964-5f66-48c8-98bc-506b8270de3b req-581ea211-5858-4e1e-b757-6ec12fc9d2b7 tempest-TestShelveInstance-784750763 None] attachment_update completed successfully. Aug 31 15:26:05 devstack sudo[101857]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-fcf03a1f-bc19-488f-8af8-436b7025f4ee tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ed587291-4d75-4087-a138-495e5c023aff" returned: 0 in 0.416s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-fcf03a1f-bc19-488f-8af8-436b7025f4ee tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ed587291-4d75-4087-a138-495e5c023aff {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:05 devstack sudo[101863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ed587291-4d75-4087-a138-495e5c023aff Aug 31 15:26:05 devstack sudo[101863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:05 devstack sudo[101863]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-fcf03a1f-bc19-488f-8af8-436b7025f4ee tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ed587291-4d75-4087-a138-495e5c023aff" returned: 0 in 0.360s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:05 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-fcf03a1f-bc19-488f-8af8-436b7025f4ee tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "cinder-quobyte-ed587291-4d75-4087-a138-495e5c023aff" released by "delete_volume" :: held 0.852s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:26:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6086606f-131f-4157-84de-b68fe30d3a52 tempest-VolumeDependencyTests-1985494117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6086606f-131f-4157-84de-b68fe30d3a52 tempest-VolumeDependencyTests-1985494117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:06 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-6086606f-131f-4157-84de-b68fe30d3a52 tempest-VolumeDependencyTests-1985494117 None] Creating offline snapshot 6d5290b1-1c31-48d1-8de4-d8ff127c7163 of volume eea97087-9826-4566-8803-929cc5fceecb {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:26:06 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-fcf03a1f-bc19-488f-8af8-436b7025f4ee tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Created reservations ['bd79bb97-9503-4021-afb1-cc643aa30e30', '042faf47-a2c4-4200-a1cb-dfeafbec7b35', 'b773b8ee-0236-45a0-a575-4b49ea757948', '850d656d-bba9-4a2a-a160-49123af93795'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:26:06 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e667bc-c57a-497c-9633-40d0ba6103b5]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:26:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6086606f-131f-4157-84de-b68fe30d3a52 tempest-VolumeDependencyTests-1985494117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:06 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-dc64ccfc-e165-4287-a0a6-e9319f57d7d7 tempest-VolumesListTestJSON-1523751690 None] Acquiring lock "cinder-e4c7d3b6-ae4e-4cef-98d8-95e011d3c61e-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:26:06 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-dc64ccfc-e165-4287-a0a6-e9319f57d7d7 tempest-VolumesListTestJSON-1523751690 None] Lock "cinder-e4c7d3b6-ae4e-4cef-98d8-95e011d3c61e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:26:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-fcf03a1f-bc19-488f-8af8-436b7025f4ee tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-fcf03a1f-bc19-488f-8af8-436b7025f4ee tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:06 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-fcf03a1f-bc19-488f-8af8-436b7025f4ee tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:26:06 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-fcf03a1f-bc19-488f-8af8-436b7025f4ee tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:26:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-fcf03a1f-bc19-488f-8af8-436b7025f4ee tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-fcf03a1f-bc19-488f-8af8-436b7025f4ee tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:06 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-dc64ccfc-e165-4287-a0a6-e9319f57d7d7 tempest-VolumesListTestJSON-1523751690 None] Acquiring lock "cinder-quobyte-e4c7d3b6-ae4e-4cef-98d8-95e011d3c61e" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:26:06 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-dc64ccfc-e165-4287-a0a6-e9319f57d7d7 tempest-VolumesListTestJSON-1523751690 None] Lock "cinder-quobyte-e4c7d3b6-ae4e-4cef-98d8-95e011d3c61e" acquired by "delete_volume" :: waited 0.016s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:26:06 devstack sudo[101932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:26:06 devstack sudo[101932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:06 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[79409898-27d5-4c4b-8d69-14f9b3b0ca02]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:26:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-dc64ccfc-e165-4287-a0a6-e9319f57d7d7 tempest-VolumesListTestJSON-1523751690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e4c7d3b6-ae4e-4cef-98d8-95e011d3c61e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:06 devstack sudo[101894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb Aug 31 15:26:06 devstack sudo[101894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:06 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-bdcb4757-2a47-4960-bef2-bb3b761a7348 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Acquiring lock "cinder-ab51af5c-f1d0-458b-a857-683642b504a6-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:26:06 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-bdcb4757-2a47-4960-bef2-bb3b761a7348 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "cinder-ab51af5c-f1d0-458b-a857-683642b504a6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:26:06 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-bdcb4757-2a47-4960-bef2-bb3b761a7348 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Acquiring lock "cinder-quobyte-ab51af5c-f1d0-458b-a857-683642b504a6" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:26:06 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-bdcb4757-2a47-4960-bef2-bb3b761a7348 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "cinder-quobyte-ab51af5c-f1d0-458b-a857-683642b504a6" acquired by "delete_volume" :: waited 0.023s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:26:06 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafcaee7-0a52-426b-84eb-6667d4080be8]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:26:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bdcb4757-2a47-4960-bef2-bb3b761a7348 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ab51af5c-f1d0-458b-a857-683642b504a6 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:06 devstack sudo[101936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e4c7d3b6-ae4e-4cef-98d8-95e011d3c61e Aug 31 15:26:06 devstack sudo[101936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:06 devstack sudo[101948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ab51af5c-f1d0-458b-a857-683642b504a6 Aug 31 15:26:06 devstack sudo[101948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:06 devstack sudo[101932]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-fcf03a1f-bc19-488f-8af8-436b7025f4ee tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.613s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:06 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-fcf03a1f-bc19-488f-8af8-436b7025f4ee tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:26:06 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-fcf03a1f-bc19-488f-8af8-436b7025f4ee tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Deleted volume successfully. Aug 31 15:26:06 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-fcf03a1f-bc19-488f-8af8-436b7025f4ee tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "cinder-ed587291-4d75-4087-a138-495e5c023aff-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:26:07 devstack sudo[101894]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6086606f-131f-4157-84de-b68fe30d3a52 tempest-VolumeDependencyTests-1985494117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb" returned: 0 in 0.977s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6086606f-131f-4157-84de-b68fe30d3a52 tempest-VolumeDependencyTests-1985494117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb.6d5290b1-1c31-48d1-8de4-d8ff127c7163 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:07 devstack sudo[102300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb.6d5290b1-1c31-48d1-8de4-d8ff127c7163 1G Aug 31 15:26:07 devstack sudo[102300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:07 devstack sudo[101936]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-dc64ccfc-e165-4287-a0a6-e9319f57d7d7 tempest-VolumesListTestJSON-1523751690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e4c7d3b6-ae4e-4cef-98d8-95e011d3c61e" returned: 0 in 0.860s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-dc64ccfc-e165-4287-a0a6-e9319f57d7d7 tempest-VolumesListTestJSON-1523751690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e4c7d3b6-ae4e-4cef-98d8-95e011d3c61e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:07 devstack sudo[102309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e4c7d3b6-ae4e-4cef-98d8-95e011d3c61e Aug 31 15:26:07 devstack sudo[102309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:07 devstack sudo[101948]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bdcb4757-2a47-4960-bef2-bb3b761a7348 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ab51af5c-f1d0-458b-a857-683642b504a6" returned: 0 in 0.776s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bdcb4757-2a47-4960-bef2-bb3b761a7348 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ab51af5c-f1d0-458b-a857-683642b504a6 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:07 devstack sudo[102316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ab51af5c-f1d0-458b-a857-683642b504a6 Aug 31 15:26:07 devstack sudo[102316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:07 devstack sudo[102309]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-dc64ccfc-e165-4287-a0a6-e9319f57d7d7 tempest-VolumesListTestJSON-1523751690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e4c7d3b6-ae4e-4cef-98d8-95e011d3c61e" returned: 0 in 0.665s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:07 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-dc64ccfc-e165-4287-a0a6-e9319f57d7d7 tempest-VolumesListTestJSON-1523751690 None] Lock "cinder-quobyte-e4c7d3b6-ae4e-4cef-98d8-95e011d3c61e" released by "delete_volume" :: held 1.608s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:26:07 devstack sudo[102300]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:07 devstack sudo[102316]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6086606f-131f-4157-84de-b68fe30d3a52 tempest-VolumeDependencyTests-1985494117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb.6d5290b1-1c31-48d1-8de4-d8ff127c7163 1G" returned: 0 in 0.849s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6086606f-131f-4157-84de-b68fe30d3a52 tempest-VolumeDependencyTests-1985494117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eea97087-9826-4566-8803-929cc5fceecb -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb.6d5290b1-1c31-48d1-8de4-d8ff127c7163 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bdcb4757-2a47-4960-bef2-bb3b761a7348 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ab51af5c-f1d0-458b-a857-683642b504a6" returned: 0 in 0.639s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:08 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-bdcb4757-2a47-4960-bef2-bb3b761a7348 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "cinder-quobyte-ab51af5c-f1d0-458b-a857-683642b504a6" released by "delete_volume" :: held 1.491s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:26:08 devstack sudo[102341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eea97087-9826-4566-8803-929cc5fceecb -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb.6d5290b1-1c31-48d1-8de4-d8ff127c7163 Aug 31 15:26:08 devstack sudo[102341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:08 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-dc64ccfc-e165-4287-a0a6-e9319f57d7d7 tempest-VolumesListTestJSON-1523751690 None] Created reservations ['4354ef33-947a-4fcc-b028-ebfed3853f94', '366a2cf6-11a2-45d6-94a1-016112ca0946', 'bb173303-73b1-4c61-a76d-4922219ba8f4', '874dca82-d85d-4e21-947c-dfa8bbec6c51'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:26:08 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-bdcb4757-2a47-4960-bef2-bb3b761a7348 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Created reservations ['1eadae5a-24e5-42db-8a29-26ec603e15d1', '2e7e3242-1fe6-4ca5-b74b-0ee64dbb5685', '12461fd4-7a38-402b-af75-99d56edc76ed', '705a1baf-a560-46c3-aa55-d1a7fddb60dc'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:26:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-dc64ccfc-e165-4287-a0a6-e9319f57d7d7 tempest-VolumesListTestJSON-1523751690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-dc64ccfc-e165-4287-a0a6-e9319f57d7d7 tempest-VolumesListTestJSON-1523751690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:08 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-dc64ccfc-e165-4287-a0a6-e9319f57d7d7 tempest-VolumesListTestJSON-1523751690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:26:08 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-dc64ccfc-e165-4287-a0a6-e9319f57d7d7 tempest-VolumesListTestJSON-1523751690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:26:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-dc64ccfc-e165-4287-a0a6-e9319f57d7d7 tempest-VolumesListTestJSON-1523751690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-dc64ccfc-e165-4287-a0a6-e9319f57d7d7 tempest-VolumesListTestJSON-1523751690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:08 devstack sudo[102343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:26:08 devstack sudo[102343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bdcb4757-2a47-4960-bef2-bb3b761a7348 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bdcb4757-2a47-4960-bef2-bb3b761a7348 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:08 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-bdcb4757-2a47-4960-bef2-bb3b761a7348 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:26:08 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-bdcb4757-2a47-4960-bef2-bb3b761a7348 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:26:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bdcb4757-2a47-4960-bef2-bb3b761a7348 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bdcb4757-2a47-4960-bef2-bb3b761a7348 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:08 devstack sudo[102345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:26:08 devstack sudo[102345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:08 devstack sudo[102341]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6086606f-131f-4157-84de-b68fe30d3a52 tempest-VolumeDependencyTests-1985494117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eea97087-9826-4566-8803-929cc5fceecb -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb.6d5290b1-1c31-48d1-8de4-d8ff127c7163" returned: 0 in 0.416s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:08 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-6086606f-131f-4157-84de-b68fe30d3a52 tempest-VolumeDependencyTests-1985494117 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb.6d5290b1-1c31-48d1-8de4-d8ff127c7163 is being set with open permissions: ugo+rw Aug 31 15:26:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6086606f-131f-4157-84de-b68fe30d3a52 tempest-VolumeDependencyTests-1985494117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb.6d5290b1-1c31-48d1-8de4-d8ff127c7163 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:08 devstack sudo[102351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb.6d5290b1-1c31-48d1-8de4-d8ff127c7163 Aug 31 15:26:08 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:08 devstack sudo[102343]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-dc64ccfc-e165-4287-a0a6-e9319f57d7d7 tempest-VolumesListTestJSON-1523751690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.300s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:08 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-dc64ccfc-e165-4287-a0a6-e9319f57d7d7 tempest-VolumesListTestJSON-1523751690 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:26:08 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-dc64ccfc-e165-4287-a0a6-e9319f57d7d7 tempest-VolumesListTestJSON-1523751690 None] Deleted volume successfully. Aug 31 15:26:08 devstack sudo[102345]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:08 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-dc64ccfc-e165-4287-a0a6-e9319f57d7d7 tempest-VolumesListTestJSON-1523751690 None] Lock "cinder-e4c7d3b6-ae4e-4cef-98d8-95e011d3c61e-delete_volume" released by "delete_volume" :: held 2.259s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:26:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bdcb4757-2a47-4960-bef2-bb3b761a7348 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.293s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:08 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-bdcb4757-2a47-4960-bef2-bb3b761a7348 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:26:08 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-bdcb4757-2a47-4960-bef2-bb3b761a7348 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Deleted volume successfully. Aug 31 15:26:08 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-bdcb4757-2a47-4960-bef2-bb3b761a7348 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "cinder-ab51af5c-f1d0-458b-a857-683642b504a6-delete_volume" released by "delete_volume" :: held 2.099s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:26:08 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-58be04c8-48c2-48d4-932d-a43a84c8cf86 tempest-VolumesListTestJSON-1523751690 None] Acquiring lock "cinder-2d77d24c-9720-4557-92f3-59deda8a96d5-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:26:08 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6086606f-131f-4157-84de-b68fe30d3a52 tempest-VolumeDependencyTests-1985494117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb.6d5290b1-1c31-48d1-8de4-d8ff127c7163" returned: 0 in 0.342s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:08 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-58be04c8-48c2-48d4-932d-a43a84c8cf86 tempest-VolumesListTestJSON-1523751690 None] Lock "cinder-2d77d24c-9720-4557-92f3-59deda8a96d5-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:26:08 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-58be04c8-48c2-48d4-932d-a43a84c8cf86 tempest-VolumesListTestJSON-1523751690 None] Acquiring lock "cinder-quobyte-2d77d24c-9720-4557-92f3-59deda8a96d5" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:26:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6086606f-131f-4157-84de-b68fe30d3a52 tempest-VolumeDependencyTests-1985494117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:08 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-df6139e5-72ce-4713-b8ed-7930601d4756 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Acquiring lock "cinder-4df100e1-0efa-4181-8916-942c8c0063ac-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:26:08 devstack sudo[102358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb.info Aug 31 15:26:08 devstack sudo[102358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:08 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-58be04c8-48c2-48d4-932d-a43a84c8cf86 tempest-VolumesListTestJSON-1523751690 None] Lock "cinder-quobyte-2d77d24c-9720-4557-92f3-59deda8a96d5" acquired by "delete_volume" :: waited 0.122s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:26:09 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-df6139e5-72ce-4713-b8ed-7930601d4756 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "cinder-4df100e1-0efa-4181-8916-942c8c0063ac-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:26:09 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b7da85-9d13-4cf8-8ecc-199d8252e58b]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:26:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-58be04c8-48c2-48d4-932d-a43a84c8cf86 tempest-VolumesListTestJSON-1523751690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2d77d24c-9720-4557-92f3-59deda8a96d5 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:09 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-df6139e5-72ce-4713-b8ed-7930601d4756 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Acquiring lock "cinder-quobyte-4df100e1-0efa-4181-8916-942c8c0063ac" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:26:09 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-df6139e5-72ce-4713-b8ed-7930601d4756 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "cinder-quobyte-4df100e1-0efa-4181-8916-942c8c0063ac" acquired by "delete_volume" :: waited 0.030s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:26:09 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb949f8-b69b-4350-854a-172e5fe1ab19]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:26:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-df6139e5-72ce-4713-b8ed-7930601d4756 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4df100e1-0efa-4181-8916-942c8c0063ac {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:09 devstack sudo[102360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2d77d24c-9720-4557-92f3-59deda8a96d5 Aug 31 15:26:09 devstack sudo[102360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:09 devstack sudo[102358]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6086606f-131f-4157-84de-b68fe30d3a52 tempest-VolumeDependencyTests-1985494117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb.info" returned: 0 in 0.631s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:09 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-6086606f-131f-4157-84de-b68fe30d3a52 tempest-VolumeDependencyTests-1985494117 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb.info is being set with open permissions: ugo+rw Aug 31 15:26:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6086606f-131f-4157-84de-b68fe30d3a52 tempest-VolumeDependencyTests-1985494117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:09 devstack sudo[102361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4df100e1-0efa-4181-8916-942c8c0063ac Aug 31 15:26:09 devstack sudo[102361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:09 devstack sudo[102364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb.info Aug 31 15:26:09 devstack sudo[102364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:09 devstack sudo[102360]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-58be04c8-48c2-48d4-932d-a43a84c8cf86 tempest-VolumesListTestJSON-1523751690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2d77d24c-9720-4557-92f3-59deda8a96d5" returned: 0 in 0.695s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-58be04c8-48c2-48d4-932d-a43a84c8cf86 tempest-VolumesListTestJSON-1523751690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2d77d24c-9720-4557-92f3-59deda8a96d5 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:09 devstack sudo[102364]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6086606f-131f-4157-84de-b68fe30d3a52 tempest-VolumeDependencyTests-1985494117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb.info" returned: 0 in 0.291s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6086606f-131f-4157-84de-b68fe30d3a52 tempest-VolumeDependencyTests-1985494117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.716s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:09 devstack sudo[102373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2d77d24c-9720-4557-92f3-59deda8a96d5 Aug 31 15:26:09 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:09 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-6086606f-131f-4157-84de-b68fe30d3a52 tempest-VolumeDependencyTests-1985494117 None] Create snapshot completed successfully Aug 31 15:26:09 devstack sudo[102361]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-df6139e5-72ce-4713-b8ed-7930601d4756 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4df100e1-0efa-4181-8916-942c8c0063ac" returned: 0 in 0.655s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-df6139e5-72ce-4713-b8ed-7930601d4756 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4df100e1-0efa-4181-8916-942c8c0063ac {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:09 devstack sudo[102378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4df100e1-0efa-4181-8916-942c8c0063ac Aug 31 15:26:09 devstack sudo[102378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:10 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-58be04c8-48c2-48d4-932d-a43a84c8cf86 tempest-VolumesListTestJSON-1523751690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2d77d24c-9720-4557-92f3-59deda8a96d5" returned: 0 in 0.340s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:10 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-58be04c8-48c2-48d4-932d-a43a84c8cf86 tempest-VolumesListTestJSON-1523751690 None] Lock "cinder-quobyte-2d77d24c-9720-4557-92f3-59deda8a96d5" released by "delete_volume" :: held 1.156s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:26:10 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-58be04c8-48c2-48d4-932d-a43a84c8cf86 tempest-VolumesListTestJSON-1523751690 None] Created reservations ['e8bdd50f-f738-4cc3-a4dd-22fa24cc02eb', '5500cf20-b862-485d-9632-41e65027dc40', '973fa478-c5df-41ce-8579-93220934b607', 'e2bb4a2b-df71-42f6-9a23-17562e682b08'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:26:10 devstack sudo[102378]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-df6139e5-72ce-4713-b8ed-7930601d4756 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4df100e1-0efa-4181-8916-942c8c0063ac" returned: 0 in 0.308s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:10 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-df6139e5-72ce-4713-b8ed-7930601d4756 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "cinder-quobyte-4df100e1-0efa-4181-8916-942c8c0063ac" released by "delete_volume" :: held 1.043s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:26:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-58be04c8-48c2-48d4-932d-a43a84c8cf86 tempest-VolumesListTestJSON-1523751690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-58be04c8-48c2-48d4-932d-a43a84c8cf86 tempest-VolumesListTestJSON-1523751690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:10 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-58be04c8-48c2-48d4-932d-a43a84c8cf86 tempest-VolumesListTestJSON-1523751690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:26:10 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-58be04c8-48c2-48d4-932d-a43a84c8cf86 tempest-VolumesListTestJSON-1523751690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:26:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-58be04c8-48c2-48d4-932d-a43a84c8cf86 tempest-VolumesListTestJSON-1523751690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-58be04c8-48c2-48d4-932d-a43a84c8cf86 tempest-VolumesListTestJSON-1523751690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:10 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-df6139e5-72ce-4713-b8ed-7930601d4756 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Created reservations ['d862516f-6b7e-4b5f-8c1a-d53a1a25dba1', '33e135b7-4047-4aae-a83d-6b5f2adb7d28', '6ffe1cab-748e-413b-b055-b29c03d497bd', 'e5195f90-33a9-42a4-836a-a9a8ec1a3c43'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:26:10 devstack sudo[102382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:26:10 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-df6139e5-72ce-4713-b8ed-7930601d4756 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-df6139e5-72ce-4713-b8ed-7930601d4756 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:10 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-df6139e5-72ce-4713-b8ed-7930601d4756 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:26:10 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-df6139e5-72ce-4713-b8ed-7930601d4756 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:26:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-df6139e5-72ce-4713-b8ed-7930601d4756 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-df6139e5-72ce-4713-b8ed-7930601d4756 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:10 devstack sudo[102384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:26:10 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:10 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-58be04c8-48c2-48d4-932d-a43a84c8cf86 tempest-VolumesListTestJSON-1523751690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.440s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:10 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-58be04c8-48c2-48d4-932d-a43a84c8cf86 tempest-VolumesListTestJSON-1523751690 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:26:10 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-58be04c8-48c2-48d4-932d-a43a84c8cf86 tempest-VolumesListTestJSON-1523751690 None] Deleted volume successfully. Aug 31 15:26:10 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-58be04c8-48c2-48d4-932d-a43a84c8cf86 tempest-VolumesListTestJSON-1523751690 None] Lock "cinder-2d77d24c-9720-4557-92f3-59deda8a96d5-delete_volume" released by "delete_volume" :: held 2.017s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:26:10 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-df6139e5-72ce-4713-b8ed-7930601d4756 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.477s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:10 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-df6139e5-72ce-4713-b8ed-7930601d4756 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:26:10 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-df6139e5-72ce-4713-b8ed-7930601d4756 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Deleted volume successfully. Aug 31 15:26:10 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-df6139e5-72ce-4713-b8ed-7930601d4756 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "cinder-4df100e1-0efa-4181-8916-942c8c0063ac-delete_volume" released by "delete_volume" :: held 1.972s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:26:11 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:26:11 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-091975ec-b909-489e-b8b3-0118dafd4f7b tempest-VolumesListTestJSON-1523751690 None] Acquiring lock "cinder-f3b70027-fd77-4af1-b546-223431d92dae-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:26:11 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Flow 'volume_create_manager' (68b5c021-d0b3-4577-a137-109c5369e524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:26:11 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (280fe2eb-bc8b-44f8-b688-d906eeb61291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:11 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-55fe00c5-64da-4cc6-954b-697f272e300a tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Acquiring lock "cinder-a5256c43-7ecd-48a2-88e5-7624a6670df7-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:26:11 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (280fe2eb-bc8b-44f8-b688-d906eeb61291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:26:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1993217315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fbe7a90-ada7-4313-b5bd-3ca138022169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76a31c8c010140b3b796fa5f51db71ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6d5290b1-1c31-48d1-8de4-d8ff127c7163,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:26:11Z,use_quota=True,user_id='60d593416e414a0887796c12df221bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:11 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc32a00e-3518-4a96-ad4d-832a3005a678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:11 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc32a00e-3518-4a96-ad4d-832a3005a678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:11 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1117616-5a51-4f61-a257-ec14b4d9e8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:11 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1117616-5a51-4f61-a257-ec14b4d9e8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4fbe7a90-ada7-4313-b5bd-3ca138022169', 'volume_name': 'volume-4fbe7a90-ada7-4313-b5bd-3ca138022169', 'volume_size': 1, 'snapshot_id': '6d5290b1-1c31-48d1-8de4-d8ff127c7163'}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:11 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bec4e163-529a-477a-b2b4-6bcf41ec8f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:11 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bec4e163-529a-477a-b2b4-6bcf41ec8f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:11 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa579f5-f1ee-4889-a2cb-adec937b7a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:11 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Volume 4fbe7a90-ada7-4313-b5bd-3ca138022169: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4fbe7a90-ada7-4313-b5bd-3ca138022169', 'volume_size': 1, 'snapshot_id': '6d5290b1-1c31-48d1-8de4-d8ff127c7163'} Aug 31 15:26:11 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-091975ec-b909-489e-b8b3-0118dafd4f7b tempest-VolumesListTestJSON-1523751690 None] Lock "cinder-f3b70027-fd77-4af1-b546-223431d92dae-delete_volume" acquired by "delete_volume" :: waited 0.166s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:26:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:11 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Acquiring lock "cinder-quobyte-6d5290b1-1c31-48d1-8de4-d8ff127c7163-4fbe7a90-ada7-4313-b5bd-3ca138022169" by "_create_volume_from_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:26:11 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-55fe00c5-64da-4cc6-954b-697f272e300a tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "cinder-a5256c43-7ecd-48a2-88e5-7624a6670df7-delete_volume" acquired by "delete_volume" :: waited 0.112s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:26:11 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Lock "cinder-quobyte-6d5290b1-1c31-48d1-8de4-d8ff127c7163-4fbe7a90-ada7-4313-b5bd-3ca138022169" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:26:11 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Creating volume 4fbe7a90-ada7-4313-b5bd-3ca138022169 from snapshot 6d5290b1-1c31-48d1-8de4-d8ff127c7163 {{(pid=86000) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 31 15:26:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:11 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:26:11 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:26:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:11 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:26:11 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Acquiring lock "cinder-quobyte-4fbe7a90-ada7-4313-b5bd-3ca138022169" by "_copy_volume_from_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:26:11 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-091975ec-b909-489e-b8b3-0118dafd4f7b tempest-VolumesListTestJSON-1523751690 None] Acquiring lock "cinder-quobyte-f3b70027-fd77-4af1-b546-223431d92dae" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:26:11 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-55fe00c5-64da-4cc6-954b-697f272e300a tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Acquiring lock "cinder-quobyte-a5256c43-7ecd-48a2-88e5-7624a6670df7" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:26:11 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Lock "cinder-quobyte-4fbe7a90-ada7-4313-b5bd-3ca138022169" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:26:11 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] snapshot: 6d5290b1-1c31-48d1-8de4-d8ff127c7163, volume: 4fbe7a90-ada7-4313-b5bd-3ca138022169, {{(pid=86000) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 31 15:26:11 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-091975ec-b909-489e-b8b3-0118dafd4f7b tempest-VolumesListTestJSON-1523751690 None] Lock "cinder-quobyte-f3b70027-fd77-4af1-b546-223431d92dae" acquired by "delete_volume" :: waited 0.029s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:26:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:11 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:26:11 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:26:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:11 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f5a2ec-8c57-4231-b959-c0abe731039a]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:26:11 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-55fe00c5-64da-4cc6-954b-697f272e300a tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "cinder-quobyte-a5256c43-7ecd-48a2-88e5-7624a6670df7" acquired by "delete_volume" :: waited 0.077s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:26:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-091975ec-b909-489e-b8b3-0118dafd4f7b tempest-VolumesListTestJSON-1523751690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f3b70027-fd77-4af1-b546-223431d92dae {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:11 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[690b4d0b-eeb6-45cc-b73a-7eda57ad1e4d]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:26:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb.6d5290b1-1c31-48d1-8de4-d8ff127c7163 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:11 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c92357-c93a-4137-a04b-90f579ea6fac]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:26:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-55fe00c5-64da-4cc6-954b-697f272e300a tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a5256c43-7ecd-48a2-88e5-7624a6670df7 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:11 devstack sudo[102390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a5256c43-7ecd-48a2-88e5-7624a6670df7 Aug 31 15:26:11 devstack sudo[102390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:11 devstack sudo[102388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f3b70027-fd77-4af1-b546-223431d92dae Aug 31 15:26:11 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:11 devstack sudo[102389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb.6d5290b1-1c31-48d1-8de4-d8ff127c7163 Aug 31 15:26:11 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:12 devstack sudo[102390]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-55fe00c5-64da-4cc6-954b-697f272e300a tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a5256c43-7ecd-48a2-88e5-7624a6670df7" returned: 0 in 0.452s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-55fe00c5-64da-4cc6-954b-697f272e300a tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a5256c43-7ecd-48a2-88e5-7624a6670df7 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:12 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a5256c43-7ecd-48a2-88e5-7624a6670df7 Aug 31 15:26:12 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:12 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-091975ec-b909-489e-b8b3-0118dafd4f7b tempest-VolumesListTestJSON-1523751690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f3b70027-fd77-4af1-b546-223431d92dae" returned: 0 in 0.603s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-091975ec-b909-489e-b8b3-0118dafd4f7b tempest-VolumesListTestJSON-1523751690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f3b70027-fd77-4af1-b546-223431d92dae {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:12 devstack sudo[102405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f3b70027-fd77-4af1-b546-223431d92dae Aug 31 15:26:12 devstack sudo[102405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:12 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb.6d5290b1-1c31-48d1-8de4-d8ff127c7163" returned: 0 in 0.805s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:12 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eea97087-9826-4566-8803-929cc5fceecb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:26:12 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d58890-084d-47de-bc50-c98fe5bd766b]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:26:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:12 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-55fe00c5-64da-4cc6-954b-697f272e300a tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a5256c43-7ecd-48a2-88e5-7624a6670df7" returned: 0 in 0.497s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:12 devstack sudo[102405]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-091975ec-b909-489e-b8b3-0118dafd4f7b tempest-VolumesListTestJSON-1523751690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f3b70027-fd77-4af1-b546-223431d92dae" returned: 0 in 0.400s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:12 devstack sudo[102408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb Aug 31 15:26:12 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-55fe00c5-64da-4cc6-954b-697f272e300a tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "cinder-quobyte-a5256c43-7ecd-48a2-88e5-7624a6670df7" released by "delete_volume" :: held 1.028s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:26:12 devstack sudo[102408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:12 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-091975ec-b909-489e-b8b3-0118dafd4f7b tempest-VolumesListTestJSON-1523751690 None] Lock "cinder-quobyte-f3b70027-fd77-4af1-b546-223431d92dae" released by "delete_volume" :: held 1.123s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:26:12 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-55fe00c5-64da-4cc6-954b-697f272e300a tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Created reservations ['3c80cb7d-1f6d-40df-951c-7b2947f19779', '9fba7d50-296e-4e5f-bdd3-81e4252b6670', 'ae177283-7617-4508-8407-4019d1b6d8fa', 'fc53ed60-6803-4475-a555-5ea6a37fe5ed'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:26:12 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-091975ec-b909-489e-b8b3-0118dafd4f7b tempest-VolumesListTestJSON-1523751690 None] Created reservations ['6b9d0d73-1c7d-4992-808c-2ff8ce7f24ed', '839758ab-5329-4348-a5e0-0d0e3560f0a0', '2a4ecd72-4e06-4760-919b-92b7abe1a4fe', '11c76a35-6f2a-4ca1-a349-dde0afe7137c'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:26:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-091975ec-b909-489e-b8b3-0118dafd4f7b tempest-VolumesListTestJSON-1523751690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-091975ec-b909-489e-b8b3-0118dafd4f7b tempest-VolumesListTestJSON-1523751690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:12 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-091975ec-b909-489e-b8b3-0118dafd4f7b tempest-VolumesListTestJSON-1523751690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:26:12 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-091975ec-b909-489e-b8b3-0118dafd4f7b tempest-VolumesListTestJSON-1523751690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:26:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-091975ec-b909-489e-b8b3-0118dafd4f7b tempest-VolumesListTestJSON-1523751690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-091975ec-b909-489e-b8b3-0118dafd4f7b tempest-VolumesListTestJSON-1523751690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:13 devstack sudo[102414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:26:13 devstack sudo[102414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-55fe00c5-64da-4cc6-954b-697f272e300a tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-55fe00c5-64da-4cc6-954b-697f272e300a tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:13 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-55fe00c5-64da-4cc6-954b-697f272e300a tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:26:13 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-55fe00c5-64da-4cc6-954b-697f272e300a tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:26:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-55fe00c5-64da-4cc6-954b-697f272e300a tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-55fe00c5-64da-4cc6-954b-697f272e300a tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:13 devstack sudo[102417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:26:13 devstack sudo[102417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:13 devstack sudo[102408]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb" returned: 0 in 0.606s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:13 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb {{(pid=86000) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 31 15:26:13 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Creating direct copy from snapshot {{(pid=86000) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 31 15:26:13 devstack cinder-volume[86000]: DEBUG cinder.utils [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Path /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4fbe7a90-ada7-4313-b5bd-3ca138022169 not found in is_blk_device check {{(pid=86000) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 31 15:26:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4fbe7a90-ada7-4313-b5bd-3ca138022169 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:13 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4fbe7a90-ada7-4313-b5bd-3ca138022169 Aug 31 15:26:13 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:13 devstack sudo[102414]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-091975ec-b909-489e-b8b3-0118dafd4f7b tempest-VolumesListTestJSON-1523751690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.387s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:13 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-091975ec-b909-489e-b8b3-0118dafd4f7b tempest-VolumesListTestJSON-1523751690 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:26:13 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-091975ec-b909-489e-b8b3-0118dafd4f7b tempest-VolumesListTestJSON-1523751690 None] Deleted volume successfully. Aug 31 15:26:13 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-091975ec-b909-489e-b8b3-0118dafd4f7b tempest-VolumesListTestJSON-1523751690 None] Lock "cinder-f3b70027-fd77-4af1-b546-223431d92dae-delete_volume" released by "delete_volume" :: held 1.948s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:26:13 devstack sudo[102417]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-55fe00c5-64da-4cc6-954b-697f272e300a tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.462s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:13 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-55fe00c5-64da-4cc6-954b-697f272e300a tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:26:13 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-55fe00c5-64da-4cc6-954b-697f272e300a tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Deleted volume successfully. Aug 31 15:26:13 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-55fe00c5-64da-4cc6-954b-697f272e300a tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "cinder-a5256c43-7ecd-48a2-88e5-7624a6670df7-delete_volume" released by "delete_volume" :: held 2.033s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:26:13 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4a6b46ff-b243-443a-97ed-682afc842423 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Acquiring lock "cinder-ef6606c8-fcc6-4945-a9a9-6647316c8e0e-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:26:13 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4a6b46ff-b243-443a-97ed-682afc842423 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "cinder-ef6606c8-fcc6-4945-a9a9-6647316c8e0e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:26:13 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4a6b46ff-b243-443a-97ed-682afc842423 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Acquiring lock "cinder-quobyte-ef6606c8-fcc6-4945-a9a9-6647316c8e0e" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:26:13 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4a6b46ff-b243-443a-97ed-682afc842423 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "cinder-quobyte-ef6606c8-fcc6-4945-a9a9-6647316c8e0e" acquired by "delete_volume" :: waited 0.025s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:26:13 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9823ba2e-8c23-4716-824b-4f52173f184c]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:26:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4a6b46ff-b243-443a-97ed-682afc842423 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ef6606c8-fcc6-4945-a9a9-6647316c8e0e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:14 devstack sudo[102427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ef6606c8-fcc6-4945-a9a9-6647316c8e0e Aug 31 15:26:14 devstack sudo[102427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:15 devstack sudo[102427]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4a6b46ff-b243-443a-97ed-682afc842423 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ef6606c8-fcc6-4945-a9a9-6647316c8e0e" returned: 0 in 1.469s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4a6b46ff-b243-443a-97ed-682afc842423 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ef6606c8-fcc6-4945-a9a9-6647316c8e0e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:15 devstack sudo[102438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ef6606c8-fcc6-4945-a9a9-6647316c8e0e Aug 31 15:26:15 devstack sudo[102438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:16 devstack sudo[102438]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4a6b46ff-b243-443a-97ed-682afc842423 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ef6606c8-fcc6-4945-a9a9-6647316c8e0e" returned: 0 in 0.713s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:16 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4a6b46ff-b243-443a-97ed-682afc842423 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "cinder-quobyte-ef6606c8-fcc6-4945-a9a9-6647316c8e0e" released by "delete_volume" :: held 2.306s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:26:16 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-4a6b46ff-b243-443a-97ed-682afc842423 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Created reservations ['3690ae3d-c332-46ac-8353-fb0ef7117b26', 'f8443e37-8fdc-47c0-8632-2f5075e1fc52', 'a5f13168-d9b6-4409-8f07-301eb3654655', '0c6ddd4d-053d-4a77-822a-f7cd74a33ca2'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:26:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4a6b46ff-b243-443a-97ed-682afc842423 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4a6b46ff-b243-443a-97ed-682afc842423 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:16 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4a6b46ff-b243-443a-97ed-682afc842423 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:26:16 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4a6b46ff-b243-443a-97ed-682afc842423 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:26:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4a6b46ff-b243-443a-97ed-682afc842423 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4a6b46ff-b243-443a-97ed-682afc842423 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:16 devstack sudo[102441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:26:16 devstack sudo[102441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:18 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a960684f-89f5-4b8e-ba4a-9603added463 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Acquiring lock "cinder-c73c0407-6719-4f9f-952d-1001d59cc2f9-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:26:18 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a960684f-89f5-4b8e-ba4a-9603added463 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "cinder-c73c0407-6719-4f9f-952d-1001d59cc2f9-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:26:18 devstack sudo[102441]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4a6b46ff-b243-443a-97ed-682afc842423 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 1.473s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:18 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-4a6b46ff-b243-443a-97ed-682afc842423 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:26:18 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-4a6b46ff-b243-443a-97ed-682afc842423 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Deleted volume successfully. Aug 31 15:26:18 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4a6b46ff-b243-443a-97ed-682afc842423 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "cinder-ef6606c8-fcc6-4945-a9a9-6647316c8e0e-delete_volume" released by "delete_volume" :: held 4.577s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:26:18 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a960684f-89f5-4b8e-ba4a-9603added463 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Acquiring lock "cinder-quobyte-c73c0407-6719-4f9f-952d-1001d59cc2f9" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:26:18 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a960684f-89f5-4b8e-ba4a-9603added463 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "cinder-quobyte-c73c0407-6719-4f9f-952d-1001d59cc2f9" acquired by "delete_volume" :: waited 0.054s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:26:18 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[138734b2-1beb-4f9d-adc9-a255efcf0ebd]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:26:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a960684f-89f5-4b8e-ba4a-9603added463 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c73c0407-6719-4f9f-952d-1001d59cc2f9 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:19 devstack sudo[102445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c73c0407-6719-4f9f-952d-1001d59cc2f9 Aug 31 15:26:19 devstack sudo[102445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:19 devstack sudo[102445]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a960684f-89f5-4b8e-ba4a-9603added463 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c73c0407-6719-4f9f-952d-1001d59cc2f9" returned: 0 in 1.240s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a960684f-89f5-4b8e-ba4a-9603added463 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c73c0407-6719-4f9f-952d-1001d59cc2f9 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:19 devstack sudo[102453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c73c0407-6719-4f9f-952d-1001d59cc2f9 Aug 31 15:26:19 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:20 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a960684f-89f5-4b8e-ba4a-9603added463 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c73c0407-6719-4f9f-952d-1001d59cc2f9" returned: 0 in 1.069s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:21 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a960684f-89f5-4b8e-ba4a-9603added463 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "cinder-quobyte-c73c0407-6719-4f9f-952d-1001d59cc2f9" released by "delete_volume" :: held 2.495s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:26:21 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:SELECT=189,cinder:UPDATE=249,cinder:INSERT=78,cinder:DELETE=20 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:26:21 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-a960684f-89f5-4b8e-ba4a-9603added463 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Created reservations ['d15b49f9-037a-4b6e-afe9-ddd36cff6236', '058084b2-7b47-4fe4-8014-ec1d724effb5', 'd427868e-6961-410e-b802-6dd1cc2337c2', 'aa9254ec-c299-46d7-a385-9ca35bd77801'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:26:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-a960684f-89f5-4b8e-ba4a-9603added463 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-a960684f-89f5-4b8e-ba4a-9603added463 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:21 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-a960684f-89f5-4b8e-ba4a-9603added463 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:26:21 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-a960684f-89f5-4b8e-ba4a-9603added463 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:26:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-a960684f-89f5-4b8e-ba4a-9603added463 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a960684f-89f5-4b8e-ba4a-9603added463 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:21 devstack sudo[102459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:26:21 devstack sudo[102459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4fbe7a90-ada7-4313-b5bd-3ca138022169" returned: 0 in 8.936s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:22 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb, size 1024.00 MB, duration 8.94 sec, destination /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4fbe7a90-ada7-4313-b5bd-3ca138022169 {{(pid=86000) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 31 15:26:22 devstack cinder-volume[86000]: INFO cinder.image.image_utils [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Converted 1024.00 MB image at 114.56 MB/s Aug 31 15:26:22 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4fbe7a90-ada7-4313-b5bd-3ca138022169 is being set with open permissions: ugo+rw Aug 31 15:26:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4fbe7a90-ada7-4313-b5bd-3ca138022169 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:22 devstack sudo[102462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4fbe7a90-ada7-4313-b5bd-3ca138022169 Aug 31 15:26:22 devstack sudo[102462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:22 devstack sudo[102459]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a960684f-89f5-4b8e-ba4a-9603added463 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.691s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:22 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-a960684f-89f5-4b8e-ba4a-9603added463 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:26:22 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-a960684f-89f5-4b8e-ba4a-9603added463 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Deleted volume successfully. Aug 31 15:26:22 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a960684f-89f5-4b8e-ba4a-9603added463 tempest-CreateVolumesFromSourceVolumeTest-1936685457 None] Lock "cinder-c73c0407-6719-4f9f-952d-1001d59cc2f9-delete_volume" released by "delete_volume" :: held 4.118s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:26:22 devstack sudo[102462]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4fbe7a90-ada7-4313-b5bd-3ca138022169" returned: 0 in 0.327s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:22 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Lock "cinder-quobyte-4fbe7a90-ada7-4313-b5bd-3ca138022169" released by "_copy_volume_from_snapshot" :: held 10.857s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:26:22 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Lock "cinder-quobyte-6d5290b1-1c31-48d1-8de4-d8ff127c7163-4fbe7a90-ada7-4313-b5bd-3ca138022169" released by "_create_volume_from_snapshot" :: held 10.947s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:26:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.985s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa579f5-f1ee-4889-a2cb-adec937b7a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fbe7a90-ada7-4313-b5bd-3ca138022169', 'volume_size': 1, 'snapshot_id': '6d5290b1-1c31-48d1-8de4-d8ff127c7163'}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (460ca3bd-ebf3-47b6-919f-019edad8bbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:22 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Volume volume-4fbe7a90-ada7-4313-b5bd-3ca138022169 (4fbe7a90-ada7-4313-b5bd-3ca138022169): created successfully Aug 31 15:26:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (460ca3bd-ebf3-47b6-919f-019edad8bbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Flow 'volume_create_manager' (68b5c021-d0b3-4577-a137-109c5369e524) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:26:22 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-40c11086-6daf-4f8d-ba84-90621752914e tempest-VolumeDependencyTests-1985494117 None] Created volume successfully. Aug 31 15:26:23 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4ae87428-c349-4e07-9acb-7eda1fc829cf tempest-VolumeDependencyTests-1985494117 None] Acquiring lock "cinder-6d5290b1-1c31-48d1-8de4-d8ff127c7163-delete_snapshot" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:26:23 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-464590a9-4f7a-42e1-83a7-4ebfc8490b4d tempest-VolumesNegativeTest-581059551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:26:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-464590a9-4f7a-42e1-83a7-4ebfc8490b4d tempest-VolumesNegativeTest-581059551 None] Flow 'volume_create_manager' (6b0d5118-14c4-41e2-ab90-867148285c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:26:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-464590a9-4f7a-42e1-83a7-4ebfc8490b4d tempest-VolumesNegativeTest-581059551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bfc3961-3db1-4822-81fa-e4ce5240ad7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:23 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4ae87428-c349-4e07-9acb-7eda1fc829cf tempest-VolumeDependencyTests-1985494117 None] Lock "cinder-6d5290b1-1c31-48d1-8de4-d8ff127c7163-delete_snapshot" acquired by "delete_snapshot" :: waited 0.073s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:26:23 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4ae87428-c349-4e07-9acb-7eda1fc829cf tempest-VolumeDependencyTests-1985494117 None] Acquiring lock "cinder-quobyte-eea97087-9826-4566-8803-929cc5fceecb" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:26:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-464590a9-4f7a-42e1-83a7-4ebfc8490b4d tempest-VolumesNegativeTest-581059551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bfc3961-3db1-4822-81fa-e4ce5240ad7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1016937400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ec25396-ea07-492c-9063-239182934ae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c37eb2da700417f90de9ef043a00aec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:26:23Z,use_quota=True,user_id='13f3992b8965439dbbd1b38a0274e42a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-464590a9-4f7a-42e1-83a7-4ebfc8490b4d tempest-VolumesNegativeTest-581059551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a537f57a-34b3-45bc-9ae1-bdb4198f069c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-464590a9-4f7a-42e1-83a7-4ebfc8490b4d tempest-VolumesNegativeTest-581059551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a537f57a-34b3-45bc-9ae1-bdb4198f069c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-464590a9-4f7a-42e1-83a7-4ebfc8490b4d tempest-VolumesNegativeTest-581059551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad88a20a-7b4b-431f-a23d-a74a40c57728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-464590a9-4f7a-42e1-83a7-4ebfc8490b4d tempest-VolumesNegativeTest-581059551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad88a20a-7b4b-431f-a23d-a74a40c57728) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ec25396-ea07-492c-9063-239182934ae9', 'volume_name': 'volume-2ec25396-ea07-492c-9063-239182934ae9', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-464590a9-4f7a-42e1-83a7-4ebfc8490b4d tempest-VolumesNegativeTest-581059551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5541574f-5b80-4d77-9903-88a34d521966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-464590a9-4f7a-42e1-83a7-4ebfc8490b4d tempest-VolumesNegativeTest-581059551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5541574f-5b80-4d77-9903-88a34d521966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-464590a9-4f7a-42e1-83a7-4ebfc8490b4d tempest-VolumesNegativeTest-581059551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3f23238-5d18-4a0b-9b1c-c5426f8d3c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:23 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-464590a9-4f7a-42e1-83a7-4ebfc8490b4d tempest-VolumesNegativeTest-581059551 None] Volume 2ec25396-ea07-492c-9063-239182934ae9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ec25396-ea07-492c-9063-239182934ae9', 'volume_size': 1} Aug 31 15:26:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-464590a9-4f7a-42e1-83a7-4ebfc8490b4d tempest-VolumesNegativeTest-581059551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-464590a9-4f7a-42e1-83a7-4ebfc8490b4d tempest-VolumesNegativeTest-581059551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:23 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-464590a9-4f7a-42e1-83a7-4ebfc8490b4d tempest-VolumesNegativeTest-581059551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1016937400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ec25396-ea07-492c-9063-239182934ae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c37eb2da700417f90de9ef043a00aec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:26:23Z,use_quota=True,user_id='13f3992b8965439dbbd1b38a0274e42a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:26:23 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-464590a9-4f7a-42e1-83a7-4ebfc8490b4d tempest-VolumesNegativeTest-581059551 None] Creating volume 2ec25396-ea07-492c-9063-239182934ae9 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:26:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-464590a9-4f7a-42e1-83a7-4ebfc8490b4d tempest-VolumesNegativeTest-581059551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-464590a9-4f7a-42e1-83a7-4ebfc8490b4d tempest-VolumesNegativeTest-581059551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:23 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-464590a9-4f7a-42e1-83a7-4ebfc8490b4d tempest-VolumesNegativeTest-581059551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:26:23 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-464590a9-4f7a-42e1-83a7-4ebfc8490b4d tempest-VolumesNegativeTest-581059551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:26:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-464590a9-4f7a-42e1-83a7-4ebfc8490b4d tempest-VolumesNegativeTest-581059551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:23 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-464590a9-4f7a-42e1-83a7-4ebfc8490b4d tempest-VolumesNegativeTest-581059551 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:26:23 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-464590a9-4f7a-42e1-83a7-4ebfc8490b4d tempest-VolumesNegativeTest-581059551 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:26:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-464590a9-4f7a-42e1-83a7-4ebfc8490b4d tempest-VolumesNegativeTest-581059551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2ec25396-ea07-492c-9063-239182934ae9 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:23 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4ae87428-c349-4e07-9acb-7eda1fc829cf tempest-VolumeDependencyTests-1985494117 None] Lock "cinder-quobyte-eea97087-9826-4566-8803-929cc5fceecb" acquired by "delete_snapshot" :: waited 0.113s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:26:23 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4ae87428-c349-4e07-9acb-7eda1fc829cf tempest-VolumeDependencyTests-1985494117 None] Acquiring lock "cinder-quobyte-6d5290b1-1c31-48d1-8de4-d8ff127c7163" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:26:23 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4ae87428-c349-4e07-9acb-7eda1fc829cf tempest-VolumeDependencyTests-1985494117 None] Lock "cinder-quobyte-6d5290b1-1c31-48d1-8de4-d8ff127c7163" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:26:23 devstack sudo[102466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2ec25396-ea07-492c-9063-239182934ae9 1073741824 Aug 31 15:26:23 devstack sudo[102466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:23 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-4ae87428-c349-4e07-9acb-7eda1fc829cf tempest-VolumeDependencyTests-1985494117 None] Deleting offline snapshot 6d5290b1-1c31-48d1-8de4-d8ff127c7163 of volume eea97087-9826-4566-8803-929cc5fceecb {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:26:23 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-4ae87428-c349-4e07-9acb-7eda1fc829cf tempest-VolumeDependencyTests-1985494117 None] snapshot_file for this snap is: volume-eea97087-9826-4566-8803-929cc5fceecb.6d5290b1-1c31-48d1-8de4-d8ff127c7163 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:26:23 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e534e6-dea3-463a-b5db-913b5858be01]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:26:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4ae87428-c349-4e07-9acb-7eda1fc829cf tempest-VolumeDependencyTests-1985494117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb.6d5290b1-1c31-48d1-8de4-d8ff127c7163 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:23 devstack sudo[102468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb.6d5290b1-1c31-48d1-8de4-d8ff127c7163 Aug 31 15:26:23 devstack sudo[102468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:24 devstack sudo[102466]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-464590a9-4f7a-42e1-83a7-4ebfc8490b4d tempest-VolumesNegativeTest-581059551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2ec25396-ea07-492c-9063-239182934ae9 1073741824" returned: 0 in 0.546s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:24 devstack sudo[102468]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4ae87428-c349-4e07-9acb-7eda1fc829cf tempest-VolumeDependencyTests-1985494117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb.6d5290b1-1c31-48d1-8de4-d8ff127c7163" returned: 0 in 0.449s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:24 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-4ae87428-c349-4e07-9acb-7eda1fc829cf tempest-VolumeDependencyTests-1985494117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eea97087-9826-4566-8803-929cc5fceecb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:26:24 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb4af12-147c-49f2-9c46-9854b27ca7dc]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:26:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4ae87428-c349-4e07-9acb-7eda1fc829cf tempest-VolumeDependencyTests-1985494117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-464590a9-4f7a-42e1-83a7-4ebfc8490b4d tempest-VolumesNegativeTest-581059551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2ec25396-ea07-492c-9063-239182934ae9 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:24 devstack sudo[102512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2ec25396-ea07-492c-9063-239182934ae9 Aug 31 15:26:24 devstack sudo[102512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:24 devstack sudo[102491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb Aug 31 15:26:24 devstack sudo[102491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:24 devstack sudo[102512]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-464590a9-4f7a-42e1-83a7-4ebfc8490b4d tempest-VolumesNegativeTest-581059551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2ec25396-ea07-492c-9063-239182934ae9" returned: 0 in 0.386s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:24 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-464590a9-4f7a-42e1-83a7-4ebfc8490b4d tempest-VolumesNegativeTest-581059551 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:26:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-464590a9-4f7a-42e1-83a7-4ebfc8490b4d tempest-VolumesNegativeTest-581059551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:24 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-464590a9-4f7a-42e1-83a7-4ebfc8490b4d tempest-VolumesNegativeTest-581059551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3f23238-5d18-4a0b-9b1c-c5426f8d3c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ec25396-ea07-492c-9063-239182934ae9', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:24 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-464590a9-4f7a-42e1-83a7-4ebfc8490b4d tempest-VolumesNegativeTest-581059551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abc21d3e-5d8e-473c-b580-902b38e2274f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:24 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-464590a9-4f7a-42e1-83a7-4ebfc8490b4d tempest-VolumesNegativeTest-581059551 None] Volume volume-2ec25396-ea07-492c-9063-239182934ae9 (2ec25396-ea07-492c-9063-239182934ae9): created successfully Aug 31 15:26:24 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-464590a9-4f7a-42e1-83a7-4ebfc8490b4d tempest-VolumesNegativeTest-581059551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abc21d3e-5d8e-473c-b580-902b38e2274f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:24 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-464590a9-4f7a-42e1-83a7-4ebfc8490b4d tempest-VolumesNegativeTest-581059551 None] Flow 'volume_create_manager' (6b0d5118-14c4-41e2-ab90-867148285c3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:26:24 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-464590a9-4f7a-42e1-83a7-4ebfc8490b4d tempest-VolumesNegativeTest-581059551 None] Created volume successfully. Aug 31 15:26:25 devstack sudo[102491]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4ae87428-c349-4e07-9acb-7eda1fc829cf tempest-VolumeDependencyTests-1985494117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb" returned: 0 in 0.907s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4ae87428-c349-4e07-9acb-7eda1fc829cf tempest-VolumeDependencyTests-1985494117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb.6d5290b1-1c31-48d1-8de4-d8ff127c7163 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:25 devstack sudo[102526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb.6d5290b1-1c31-48d1-8de4-d8ff127c7163 Aug 31 15:26:25 devstack sudo[102526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:25 devstack sudo[102526]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4ae87428-c349-4e07-9acb-7eda1fc829cf tempest-VolumeDependencyTests-1985494117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb.6d5290b1-1c31-48d1-8de4-d8ff127c7163" returned: 0 in 0.491s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4ae87428-c349-4e07-9acb-7eda1fc829cf tempest-VolumeDependencyTests-1985494117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb.6d5290b1-1c31-48d1-8de4-d8ff127c7163 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:25 devstack sudo[102532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb.6d5290b1-1c31-48d1-8de4-d8ff127c7163 Aug 31 15:26:25 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:25 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4ae87428-c349-4e07-9acb-7eda1fc829cf tempest-VolumeDependencyTests-1985494117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb.6d5290b1-1c31-48d1-8de4-d8ff127c7163" returned: 0 in 0.384s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:25 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4ae87428-c349-4e07-9acb-7eda1fc829cf tempest-VolumeDependencyTests-1985494117 None] Lock "cinder-quobyte-6d5290b1-1c31-48d1-8de4-d8ff127c7163" released by "_delete_snapshot" :: held 2.405s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:26:25 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4ae87428-c349-4e07-9acb-7eda1fc829cf tempest-VolumeDependencyTests-1985494117 None] Lock "cinder-quobyte-eea97087-9826-4566-8803-929cc5fceecb" released by "delete_snapshot" :: held 2.445s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:26:26 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-4ae87428-c349-4e07-9acb-7eda1fc829cf tempest-VolumeDependencyTests-1985494117 None] Created reservations ['5675a416-be85-45c3-b1e0-d807460235e2', '4916f24d-02b5-461e-b0a7-489543fbaa5d', 'd4f3e2b1-9aa2-49ea-9e04-cb27898dac23', '09733e14-741f-4cf2-b6c2-447bab63ecb3'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:26:26 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-4ae87428-c349-4e07-9acb-7eda1fc829cf tempest-VolumeDependencyTests-1985494117 None] Delete snapshot completed successfully. Aug 31 15:26:26 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4ae87428-c349-4e07-9acb-7eda1fc829cf tempest-VolumeDependencyTests-1985494117 None] Lock "cinder-6d5290b1-1c31-48d1-8de4-d8ff127c7163-delete_snapshot" released by "delete_snapshot" :: held 2.727s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:26:26 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b0609e10-2be2-4d46-9749-2032be5023e1 tempest-VolumeDependencyTests-1985494117 None] Acquiring lock "cinder-eea97087-9826-4566-8803-929cc5fceecb-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:26:26 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b0609e10-2be2-4d46-9749-2032be5023e1 tempest-VolumeDependencyTests-1985494117 None] Lock "cinder-eea97087-9826-4566-8803-929cc5fceecb-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:26:26 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b0609e10-2be2-4d46-9749-2032be5023e1 tempest-VolumeDependencyTests-1985494117 None] Acquiring lock "cinder-quobyte-eea97087-9826-4566-8803-929cc5fceecb" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:26:26 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b0609e10-2be2-4d46-9749-2032be5023e1 tempest-VolumeDependencyTests-1985494117 None] Lock "cinder-quobyte-eea97087-9826-4566-8803-929cc5fceecb" acquired by "delete_volume" :: waited 0.035s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:26:26 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[23143f59-e838-45d0-b52d-93b12c5fa079]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:26:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b0609e10-2be2-4d46-9749-2032be5023e1 tempest-VolumeDependencyTests-1985494117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:27 devstack sudo[102570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb Aug 31 15:26:27 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:27 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb22fe51-b85e-4278-8729-f8066c7ecc40 tempest-ProjectReaderTests-482304182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:26:27 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:27 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb22fe51-b85e-4278-8729-f8066c7ecc40 tempest-ProjectReaderTests-482304182 None] Flow 'volume_create_manager' (dac2bb0b-1ed3-4df1-bbbd-f65f9a7f78b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:26:27 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb22fe51-b85e-4278-8729-f8066c7ecc40 tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69257a34-2b55-4dd9-a146-6c91f68044eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b0609e10-2be2-4d46-9749-2032be5023e1 tempest-VolumeDependencyTests-1985494117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb" returned: 0 in 0.566s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b0609e10-2be2-4d46-9749-2032be5023e1 tempest-VolumeDependencyTests-1985494117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:27 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb22fe51-b85e-4278-8729-f8066c7ecc40 tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69257a34-2b55-4dd9-a146-6c91f68044eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-28384373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=debfe2ef-ca55-43f5-88e5-3ce0683e3bfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='401baf65d58c4e8face5e39dbd41361d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:26:27Z,use_quota=True,user_id='08b254fde3d74c4eaaf228798bc43139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:27 devstack sudo[102575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb Aug 31 15:26:27 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:27 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb22fe51-b85e-4278-8729-f8066c7ecc40 tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78e72cb1-df37-44eb-8988-5761852e5e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:27 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb22fe51-b85e-4278-8729-f8066c7ecc40 tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78e72cb1-df37-44eb-8988-5761852e5e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:27 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb22fe51-b85e-4278-8729-f8066c7ecc40 tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eba5a746-1807-4851-90e9-8721f5f65d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:27 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb22fe51-b85e-4278-8729-f8066c7ecc40 tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eba5a746-1807-4851-90e9-8721f5f65d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'debfe2ef-ca55-43f5-88e5-3ce0683e3bfc', 'volume_name': 'volume-debfe2ef-ca55-43f5-88e5-3ce0683e3bfc', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:27 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb22fe51-b85e-4278-8729-f8066c7ecc40 tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (452c832d-bcf3-45eb-b411-3c43e86a560b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:27 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb22fe51-b85e-4278-8729-f8066c7ecc40 tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (452c832d-bcf3-45eb-b411-3c43e86a560b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:27 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb22fe51-b85e-4278-8729-f8066c7ecc40 tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ea0af21-1346-4ca2-8118-fd08cbc9f043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:27 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-eb22fe51-b85e-4278-8729-f8066c7ecc40 tempest-ProjectReaderTests-482304182 None] Volume debfe2ef-ca55-43f5-88e5-3ce0683e3bfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-debfe2ef-ca55-43f5-88e5-3ce0683e3bfc', 'volume_size': 1} Aug 31 15:26:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-eb22fe51-b85e-4278-8729-f8066c7ecc40 tempest-ProjectReaderTests-482304182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-eb22fe51-b85e-4278-8729-f8066c7ecc40 tempest-ProjectReaderTests-482304182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:27 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-eb22fe51-b85e-4278-8729-f8066c7ecc40 tempest-ProjectReaderTests-482304182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-28384373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=debfe2ef-ca55-43f5-88e5-3ce0683e3bfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='401baf65d58c4e8face5e39dbd41361d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:26:27Z,use_quota=True,user_id='08b254fde3d74c4eaaf228798bc43139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:26:27 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-eb22fe51-b85e-4278-8729-f8066c7ecc40 tempest-ProjectReaderTests-482304182 None] Creating volume debfe2ef-ca55-43f5-88e5-3ce0683e3bfc {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:26:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-eb22fe51-b85e-4278-8729-f8066c7ecc40 tempest-ProjectReaderTests-482304182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-eb22fe51-b85e-4278-8729-f8066c7ecc40 tempest-ProjectReaderTests-482304182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:27 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-eb22fe51-b85e-4278-8729-f8066c7ecc40 tempest-ProjectReaderTests-482304182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:26:27 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-eb22fe51-b85e-4278-8729-f8066c7ecc40 tempest-ProjectReaderTests-482304182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:26:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-eb22fe51-b85e-4278-8729-f8066c7ecc40 tempest-ProjectReaderTests-482304182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:27 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-eb22fe51-b85e-4278-8729-f8066c7ecc40 tempest-ProjectReaderTests-482304182 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:26:27 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-eb22fe51-b85e-4278-8729-f8066c7ecc40 tempest-ProjectReaderTests-482304182 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:26:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-eb22fe51-b85e-4278-8729-f8066c7ecc40 tempest-ProjectReaderTests-482304182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-debfe2ef-ca55-43f5-88e5-3ce0683e3bfc 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:27 devstack sudo[102577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-debfe2ef-ca55-43f5-88e5-3ce0683e3bfc 1073741824 Aug 31 15:26:27 devstack sudo[102577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:27 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b0609e10-2be2-4d46-9749-2032be5023e1 tempest-VolumeDependencyTests-1985494117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-eea97087-9826-4566-8803-929cc5fceecb" returned: 0 in 0.291s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:27 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b0609e10-2be2-4d46-9749-2032be5023e1 tempest-VolumeDependencyTests-1985494117 None] Lock "cinder-quobyte-eea97087-9826-4566-8803-929cc5fceecb" released by "delete_volume" :: held 0.974s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:26:27 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-b0609e10-2be2-4d46-9749-2032be5023e1 tempest-VolumeDependencyTests-1985494117 None] Created reservations ['21b5606c-259e-45e8-beaa-c85f1d7644cf', '9399ec5c-3789-4736-9ebb-b0bc330d1a2e', 'bda833a2-a707-413a-bcc0-f869270c3170', '8a632368-9341-4a32-a7d3-c3a3b1e02936'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:26:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b0609e10-2be2-4d46-9749-2032be5023e1 tempest-VolumeDependencyTests-1985494117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b0609e10-2be2-4d46-9749-2032be5023e1 tempest-VolumeDependencyTests-1985494117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:27 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-b0609e10-2be2-4d46-9749-2032be5023e1 tempest-VolumeDependencyTests-1985494117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:26:27 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-b0609e10-2be2-4d46-9749-2032be5023e1 tempest-VolumeDependencyTests-1985494117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:26:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b0609e10-2be2-4d46-9749-2032be5023e1 tempest-VolumeDependencyTests-1985494117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b0609e10-2be2-4d46-9749-2032be5023e1 tempest-VolumeDependencyTests-1985494117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:27 devstack sudo[102583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:26:27 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:28 devstack sudo[102577]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-eb22fe51-b85e-4278-8729-f8066c7ecc40 tempest-ProjectReaderTests-482304182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-debfe2ef-ca55-43f5-88e5-3ce0683e3bfc 1073741824" returned: 0 in 0.634s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-eb22fe51-b85e-4278-8729-f8066c7ecc40 tempest-ProjectReaderTests-482304182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-debfe2ef-ca55-43f5-88e5-3ce0683e3bfc {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:28 devstack sudo[102587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-debfe2ef-ca55-43f5-88e5-3ce0683e3bfc Aug 31 15:26:28 devstack sudo[102587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:28 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b0609e10-2be2-4d46-9749-2032be5023e1 tempest-VolumeDependencyTests-1985494117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.313s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:28 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-b0609e10-2be2-4d46-9749-2032be5023e1 tempest-VolumeDependencyTests-1985494117 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:26:28 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-b0609e10-2be2-4d46-9749-2032be5023e1 tempest-VolumeDependencyTests-1985494117 None] Deleted volume successfully. Aug 31 15:26:28 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b0609e10-2be2-4d46-9749-2032be5023e1 tempest-VolumeDependencyTests-1985494117 None] Lock "cinder-eea97087-9826-4566-8803-929cc5fceecb-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:26:28 devstack sudo[102587]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-eb22fe51-b85e-4278-8729-f8066c7ecc40 tempest-ProjectReaderTests-482304182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-debfe2ef-ca55-43f5-88e5-3ce0683e3bfc" returned: 0 in 0.299s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:28 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-eb22fe51-b85e-4278-8729-f8066c7ecc40 tempest-ProjectReaderTests-482304182 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:26:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-eb22fe51-b85e-4278-8729-f8066c7ecc40 tempest-ProjectReaderTests-482304182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:28 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb22fe51-b85e-4278-8729-f8066c7ecc40 tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ea0af21-1346-4ca2-8118-fd08cbc9f043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-debfe2ef-ca55-43f5-88e5-3ce0683e3bfc', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:28 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb22fe51-b85e-4278-8729-f8066c7ecc40 tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e82c42c9-7d22-46de-8e1a-35ee3194627d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:28 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-eb22fe51-b85e-4278-8729-f8066c7ecc40 tempest-ProjectReaderTests-482304182 None] Volume volume-debfe2ef-ca55-43f5-88e5-3ce0683e3bfc (debfe2ef-ca55-43f5-88e5-3ce0683e3bfc): created successfully Aug 31 15:26:28 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb22fe51-b85e-4278-8729-f8066c7ecc40 tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e82c42c9-7d22-46de-8e1a-35ee3194627d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:28 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb22fe51-b85e-4278-8729-f8066c7ecc40 tempest-ProjectReaderTests-482304182 None] Flow 'volume_create_manager' (dac2bb0b-1ed3-4df1-bbbd-f65f9a7f78b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:26:28 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-eb22fe51-b85e-4278-8729-f8066c7ecc40 tempest-ProjectReaderTests-482304182 None] Created volume successfully. Aug 31 15:26:29 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-081ffd14-1d20-4644-94fd-328eff00b132 tempest-VolumeDependencyTests-1985494117 None] Acquiring lock "cinder-4fbe7a90-ada7-4313-b5bd-3ca138022169-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:26:29 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-081ffd14-1d20-4644-94fd-328eff00b132 tempest-VolumeDependencyTests-1985494117 None] Lock "cinder-4fbe7a90-ada7-4313-b5bd-3ca138022169-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:26:29 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:SELECT=201,cinder:INSERT=68,cinder:UPDATE=263,cinder:DELETE=22 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:26:29 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-081ffd14-1d20-4644-94fd-328eff00b132 tempest-VolumeDependencyTests-1985494117 None] Acquiring lock "cinder-quobyte-4fbe7a90-ada7-4313-b5bd-3ca138022169" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:26:29 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-081ffd14-1d20-4644-94fd-328eff00b132 tempest-VolumeDependencyTests-1985494117 None] Lock "cinder-quobyte-4fbe7a90-ada7-4313-b5bd-3ca138022169" acquired by "delete_volume" :: waited 0.023s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:26:29 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[44de7637-b025-45d1-ba88-538f43ffc789]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:26:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-081ffd14-1d20-4644-94fd-328eff00b132 tempest-VolumeDependencyTests-1985494117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4fbe7a90-ada7-4313-b5bd-3ca138022169 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:29 devstack sudo[102606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4fbe7a90-ada7-4313-b5bd-3ca138022169 Aug 31 15:26:29 devstack sudo[102606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:29 devstack sudo[102606]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-081ffd14-1d20-4644-94fd-328eff00b132 tempest-VolumeDependencyTests-1985494117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4fbe7a90-ada7-4313-b5bd-3ca138022169" returned: 0 in 0.445s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-081ffd14-1d20-4644-94fd-328eff00b132 tempest-VolumeDependencyTests-1985494117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4fbe7a90-ada7-4313-b5bd-3ca138022169 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:29 devstack sudo[102611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4fbe7a90-ada7-4313-b5bd-3ca138022169 Aug 31 15:26:29 devstack sudo[102611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:29 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-799c3c29-4e3b-4388-a3df-70e68515a39c tempest-ProjectReaderTests-482304182 None] Acquiring lock "cinder-debfe2ef-ca55-43f5-88e5-3ce0683e3bfc-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:26:29 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-799c3c29-4e3b-4388-a3df-70e68515a39c tempest-ProjectReaderTests-482304182 None] Lock "cinder-debfe2ef-ca55-43f5-88e5-3ce0683e3bfc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:26:29 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-799c3c29-4e3b-4388-a3df-70e68515a39c tempest-ProjectReaderTests-482304182 None] Acquiring lock "cinder-quobyte-debfe2ef-ca55-43f5-88e5-3ce0683e3bfc" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:26:29 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-799c3c29-4e3b-4388-a3df-70e68515a39c tempest-ProjectReaderTests-482304182 None] Lock "cinder-quobyte-debfe2ef-ca55-43f5-88e5-3ce0683e3bfc" acquired by "delete_volume" :: waited 0.033s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:26:29 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e4379b-2b93-496e-be97-594d02e148e3]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:26:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-799c3c29-4e3b-4388-a3df-70e68515a39c tempest-ProjectReaderTests-482304182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-debfe2ef-ca55-43f5-88e5-3ce0683e3bfc {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:29 devstack sudo[102611]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-081ffd14-1d20-4644-94fd-328eff00b132 tempest-VolumeDependencyTests-1985494117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4fbe7a90-ada7-4313-b5bd-3ca138022169" returned: 0 in 0.307s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:29 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-081ffd14-1d20-4644-94fd-328eff00b132 tempest-VolumeDependencyTests-1985494117 None] Lock "cinder-quobyte-4fbe7a90-ada7-4313-b5bd-3ca138022169" released by "delete_volume" :: held 0.798s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:26:29 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-081ffd14-1d20-4644-94fd-328eff00b132 tempest-VolumeDependencyTests-1985494117 None] Created reservations ['2e53dca1-887a-49f9-92a0-4e1dacf23986', '35b5a0b4-8f64-4dde-9a8b-340725409a0d', '69dbfdf0-3da6-4b7d-af99-5a42b827e39c', 'e55b85a5-38ac-464a-b2eb-8e7720218f56'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:26:29 devstack sudo[102615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-debfe2ef-ca55-43f5-88e5-3ce0683e3bfc Aug 31 15:26:29 devstack sudo[102615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-081ffd14-1d20-4644-94fd-328eff00b132 tempest-VolumeDependencyTests-1985494117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-081ffd14-1d20-4644-94fd-328eff00b132 tempest-VolumeDependencyTests-1985494117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:30 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-081ffd14-1d20-4644-94fd-328eff00b132 tempest-VolumeDependencyTests-1985494117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:26:30 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-081ffd14-1d20-4644-94fd-328eff00b132 tempest-VolumeDependencyTests-1985494117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:26:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-081ffd14-1d20-4644-94fd-328eff00b132 tempest-VolumeDependencyTests-1985494117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-081ffd14-1d20-4644-94fd-328eff00b132 tempest-VolumeDependencyTests-1985494117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:30 devstack sudo[102617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:26:30 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:30 devstack sudo[102615]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-799c3c29-4e3b-4388-a3df-70e68515a39c tempest-ProjectReaderTests-482304182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-debfe2ef-ca55-43f5-88e5-3ce0683e3bfc" returned: 0 in 0.483s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-799c3c29-4e3b-4388-a3df-70e68515a39c tempest-ProjectReaderTests-482304182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-debfe2ef-ca55-43f5-88e5-3ce0683e3bfc {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:30 devstack sudo[102623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-debfe2ef-ca55-43f5-88e5-3ce0683e3bfc Aug 31 15:26:30 devstack sudo[102623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:30 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-081ffd14-1d20-4644-94fd-328eff00b132 tempest-VolumeDependencyTests-1985494117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.373s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:30 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-081ffd14-1d20-4644-94fd-328eff00b132 tempest-VolumeDependencyTests-1985494117 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:26:30 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-081ffd14-1d20-4644-94fd-328eff00b132 tempest-VolumeDependencyTests-1985494117 None] Deleted volume successfully. Aug 31 15:26:30 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-081ffd14-1d20-4644-94fd-328eff00b132 tempest-VolumeDependencyTests-1985494117 None] Lock "cinder-4fbe7a90-ada7-4313-b5bd-3ca138022169-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:26:30 devstack sudo[102623]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-799c3c29-4e3b-4388-a3df-70e68515a39c tempest-ProjectReaderTests-482304182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-debfe2ef-ca55-43f5-88e5-3ce0683e3bfc" returned: 0 in 0.292s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:30 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-799c3c29-4e3b-4388-a3df-70e68515a39c tempest-ProjectReaderTests-482304182 None] Lock "cinder-quobyte-debfe2ef-ca55-43f5-88e5-3ce0683e3bfc" released by "delete_volume" :: held 0.829s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:26:30 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-799c3c29-4e3b-4388-a3df-70e68515a39c tempest-ProjectReaderTests-482304182 None] Created reservations ['5ac4f897-fa53-41b7-bf47-653c6e10c479', '1289e87a-a190-4242-aed4-a137a656ac6b', 'd51a7b11-ae55-462f-adb7-f6d5c3ccd58f', '5f7aab3c-869b-478f-9399-9229d093acd8'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:26:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-799c3c29-4e3b-4388-a3df-70e68515a39c tempest-ProjectReaderTests-482304182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-799c3c29-4e3b-4388-a3df-70e68515a39c tempest-ProjectReaderTests-482304182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:30 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-799c3c29-4e3b-4388-a3df-70e68515a39c tempest-ProjectReaderTests-482304182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:26:30 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-799c3c29-4e3b-4388-a3df-70e68515a39c tempest-ProjectReaderTests-482304182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:26:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-799c3c29-4e3b-4388-a3df-70e68515a39c tempest-ProjectReaderTests-482304182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-799c3c29-4e3b-4388-a3df-70e68515a39c tempest-ProjectReaderTests-482304182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:30 devstack sudo[102628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:26:30 devstack sudo[102628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:31 devstack sudo[102628]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-799c3c29-4e3b-4388-a3df-70e68515a39c tempest-ProjectReaderTests-482304182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.365s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:31 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-799c3c29-4e3b-4388-a3df-70e68515a39c tempest-ProjectReaderTests-482304182 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:26:31 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-799c3c29-4e3b-4388-a3df-70e68515a39c tempest-ProjectReaderTests-482304182 None] Deleted volume successfully. Aug 31 15:26:31 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-799c3c29-4e3b-4388-a3df-70e68515a39c tempest-ProjectReaderTests-482304182 None] Lock "cinder-debfe2ef-ca55-43f5-88e5-3ce0683e3bfc-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:26:31 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-c66b95a7-2c19-409d-83fd-477e46d297de tempest-ProjectReaderTests-482304182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:26:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c66b95a7-2c19-409d-83fd-477e46d297de tempest-ProjectReaderTests-482304182 None] Flow 'volume_create_manager' (7d63af43-1152-41f4-bf9e-2724a902c016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:26:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c66b95a7-2c19-409d-83fd-477e46d297de tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44c80bb8-fa55-42d0-b54d-1b4589594ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c66b95a7-2c19-409d-83fd-477e46d297de tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44c80bb8-fa55-42d0-b54d-1b4589594ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-981694441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4168e84e-20a8-4b98-b555-78dbf9d17012,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='401baf65d58c4e8face5e39dbd41361d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:26:31Z,use_quota=True,user_id='08b254fde3d74c4eaaf228798bc43139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c66b95a7-2c19-409d-83fd-477e46d297de tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c20f8aa8-d580-4746-ac0e-44c9d5322957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c66b95a7-2c19-409d-83fd-477e46d297de tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c20f8aa8-d580-4746-ac0e-44c9d5322957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c66b95a7-2c19-409d-83fd-477e46d297de tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c3c76e6-12cc-4ee4-906c-6c3b75418aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c66b95a7-2c19-409d-83fd-477e46d297de tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c3c76e6-12cc-4ee4-906c-6c3b75418aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4168e84e-20a8-4b98-b555-78dbf9d17012', 'volume_name': 'volume-4168e84e-20a8-4b98-b555-78dbf9d17012', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c66b95a7-2c19-409d-83fd-477e46d297de tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1a81b29-7602-4d17-9807-67b7b33ef5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c66b95a7-2c19-409d-83fd-477e46d297de tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1a81b29-7602-4d17-9807-67b7b33ef5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c66b95a7-2c19-409d-83fd-477e46d297de tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8900cd82-70e2-45a5-9828-a2cc24537513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:31 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-c66b95a7-2c19-409d-83fd-477e46d297de tempest-ProjectReaderTests-482304182 None] Volume 4168e84e-20a8-4b98-b555-78dbf9d17012: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4168e84e-20a8-4b98-b555-78dbf9d17012', 'volume_size': 1} Aug 31 15:26:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c66b95a7-2c19-409d-83fd-477e46d297de tempest-ProjectReaderTests-482304182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c66b95a7-2c19-409d-83fd-477e46d297de tempest-ProjectReaderTests-482304182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:31 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c66b95a7-2c19-409d-83fd-477e46d297de tempest-ProjectReaderTests-482304182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-981694441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4168e84e-20a8-4b98-b555-78dbf9d17012,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='401baf65d58c4e8face5e39dbd41361d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:26:31Z,use_quota=True,user_id='08b254fde3d74c4eaaf228798bc43139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:26:31 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-c66b95a7-2c19-409d-83fd-477e46d297de tempest-ProjectReaderTests-482304182 None] Creating volume 4168e84e-20a8-4b98-b555-78dbf9d17012 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:26:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c66b95a7-2c19-409d-83fd-477e46d297de tempest-ProjectReaderTests-482304182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c66b95a7-2c19-409d-83fd-477e46d297de tempest-ProjectReaderTests-482304182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:31 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c66b95a7-2c19-409d-83fd-477e46d297de tempest-ProjectReaderTests-482304182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:26:31 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c66b95a7-2c19-409d-83fd-477e46d297de tempest-ProjectReaderTests-482304182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:26:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c66b95a7-2c19-409d-83fd-477e46d297de tempest-ProjectReaderTests-482304182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:31 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c66b95a7-2c19-409d-83fd-477e46d297de tempest-ProjectReaderTests-482304182 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:26:31 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-c66b95a7-2c19-409d-83fd-477e46d297de tempest-ProjectReaderTests-482304182 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:26:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c66b95a7-2c19-409d-83fd-477e46d297de tempest-ProjectReaderTests-482304182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4168e84e-20a8-4b98-b555-78dbf9d17012 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:31 devstack sudo[102631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4168e84e-20a8-4b98-b555-78dbf9d17012 1073741824 Aug 31 15:26:31 devstack sudo[102631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:32 devstack sudo[102631]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c66b95a7-2c19-409d-83fd-477e46d297de tempest-ProjectReaderTests-482304182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4168e84e-20a8-4b98-b555-78dbf9d17012 1073741824" returned: 0 in 0.864s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c66b95a7-2c19-409d-83fd-477e46d297de tempest-ProjectReaderTests-482304182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4168e84e-20a8-4b98-b555-78dbf9d17012 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:32 devstack sudo[102692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4168e84e-20a8-4b98-b555-78dbf9d17012 Aug 31 15:26:32 devstack sudo[102692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:33 devstack sudo[102692]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c66b95a7-2c19-409d-83fd-477e46d297de tempest-ProjectReaderTests-482304182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4168e84e-20a8-4b98-b555-78dbf9d17012" returned: 0 in 0.497s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:33 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c66b95a7-2c19-409d-83fd-477e46d297de tempest-ProjectReaderTests-482304182 None] <== create_volume: return (1437ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:26:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c66b95a7-2c19-409d-83fd-477e46d297de tempest-ProjectReaderTests-482304182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c66b95a7-2c19-409d-83fd-477e46d297de tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8900cd82-70e2-45a5-9828-a2cc24537513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4168e84e-20a8-4b98-b555-78dbf9d17012', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c66b95a7-2c19-409d-83fd-477e46d297de tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3689b7f-e24f-4d59-9c54-9a8c17c7cc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:33 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-c66b95a7-2c19-409d-83fd-477e46d297de tempest-ProjectReaderTests-482304182 None] Volume volume-4168e84e-20a8-4b98-b555-78dbf9d17012 (4168e84e-20a8-4b98-b555-78dbf9d17012): created successfully Aug 31 15:26:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c66b95a7-2c19-409d-83fd-477e46d297de tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3689b7f-e24f-4d59-9c54-9a8c17c7cc78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:33 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c66b95a7-2c19-409d-83fd-477e46d297de tempest-ProjectReaderTests-482304182 None] Flow 'volume_create_manager' (7d63af43-1152-41f4-bf9e-2724a902c016) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:26:33 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-c66b95a7-2c19-409d-83fd-477e46d297de tempest-ProjectReaderTests-482304182 None] Created volume successfully. Aug 31 15:26:33 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4bdeca34-5614-4d7f-9e3f-1e224d27b922 tempest-ProjectReaderTests-482304182 None] Acquiring lock "cinder-4168e84e-20a8-4b98-b555-78dbf9d17012-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:26:33 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4bdeca34-5614-4d7f-9e3f-1e224d27b922 tempest-ProjectReaderTests-482304182 None] Lock "cinder-4168e84e-20a8-4b98-b555-78dbf9d17012-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:26:34 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4bdeca34-5614-4d7f-9e3f-1e224d27b922 tempest-ProjectReaderTests-482304182 None] Acquiring lock "cinder-quobyte-4168e84e-20a8-4b98-b555-78dbf9d17012" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:26:34 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4bdeca34-5614-4d7f-9e3f-1e224d27b922 tempest-ProjectReaderTests-482304182 None] Lock "cinder-quobyte-4168e84e-20a8-4b98-b555-78dbf9d17012" acquired by "delete_volume" :: waited 0.030s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:26:34 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[20523383-1186-41b0-a4b7-da4a350dfe44]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:26:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4bdeca34-5614-4d7f-9e3f-1e224d27b922 tempest-ProjectReaderTests-482304182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4168e84e-20a8-4b98-b555-78dbf9d17012 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:34 devstack sudo[102707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4168e84e-20a8-4b98-b555-78dbf9d17012 Aug 31 15:26:34 devstack sudo[102707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:34 devstack sudo[102707]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4bdeca34-5614-4d7f-9e3f-1e224d27b922 tempest-ProjectReaderTests-482304182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4168e84e-20a8-4b98-b555-78dbf9d17012" returned: 0 in 0.523s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4bdeca34-5614-4d7f-9e3f-1e224d27b922 tempest-ProjectReaderTests-482304182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4168e84e-20a8-4b98-b555-78dbf9d17012 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:34 devstack sudo[102712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4168e84e-20a8-4b98-b555-78dbf9d17012 Aug 31 15:26:34 devstack sudo[102712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:35 devstack sudo[102712]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4bdeca34-5614-4d7f-9e3f-1e224d27b922 tempest-ProjectReaderTests-482304182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4168e84e-20a8-4b98-b555-78dbf9d17012" returned: 0 in 0.473s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:35 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4bdeca34-5614-4d7f-9e3f-1e224d27b922 tempest-ProjectReaderTests-482304182 None] Lock "cinder-quobyte-4168e84e-20a8-4b98-b555-78dbf9d17012" released by "delete_volume" :: held 1.141s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:26:35 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-4bdeca34-5614-4d7f-9e3f-1e224d27b922 tempest-ProjectReaderTests-482304182 None] Created reservations ['91dfae91-7364-4433-abab-b2091dc5dd74', 'b58e95a9-8fb7-4e12-9498-1d988bbb7759', '39e4cb66-2c0c-41bf-8719-6a3e6b2fded4', '8f312ee7-6013-46c0-b6ef-c438daae02dd'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:26:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4bdeca34-5614-4d7f-9e3f-1e224d27b922 tempest-ProjectReaderTests-482304182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4bdeca34-5614-4d7f-9e3f-1e224d27b922 tempest-ProjectReaderTests-482304182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:35 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4bdeca34-5614-4d7f-9e3f-1e224d27b922 tempest-ProjectReaderTests-482304182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:26:35 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4bdeca34-5614-4d7f-9e3f-1e224d27b922 tempest-ProjectReaderTests-482304182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:26:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4bdeca34-5614-4d7f-9e3f-1e224d27b922 tempest-ProjectReaderTests-482304182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4bdeca34-5614-4d7f-9e3f-1e224d27b922 tempest-ProjectReaderTests-482304182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:35 devstack sudo[102723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:26:35 devstack sudo[102723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:35 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f03f05f-cd0a-4261-b0f6-f3ffcdb16797 tempest-CinderUnicodeTest-1965377503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:26:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9f03f05f-cd0a-4261-b0f6-f3ffcdb16797 tempest-CinderUnicodeTest-1965377503 None] Flow 'volume_create_manager' (42023a01-619b-4fce-95f1-2085a8527867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:26:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9f03f05f-cd0a-4261-b0f6-f3ffcdb16797 tempest-CinderUnicodeTest-1965377503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af1e93e-6ba5-4304-b616-a4604e6b323b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9f03f05f-cd0a-4261-b0f6-f3ffcdb16797 tempest-CinderUnicodeTest-1965377503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af1e93e-6ba5-4304-b616-a4604e6b323b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab4d6594-b7f1-4290-a5bc-c2aac1aecac7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='823c8f93f8ce4e9d8a247ac54a4758d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:26:36Z,use_quota=True,user_id='7d118b70947c404e8e6a10daa3aabd0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9f03f05f-cd0a-4261-b0f6-f3ffcdb16797 tempest-CinderUnicodeTest-1965377503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e65539-359b-4a2d-9e5a-b05f053d2c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9f03f05f-cd0a-4261-b0f6-f3ffcdb16797 tempest-CinderUnicodeTest-1965377503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e65539-359b-4a2d-9e5a-b05f053d2c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9f03f05f-cd0a-4261-b0f6-f3ffcdb16797 tempest-CinderUnicodeTest-1965377503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (664d79c7-5f93-4d81-b379-f276a6d5c7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9f03f05f-cd0a-4261-b0f6-f3ffcdb16797 tempest-CinderUnicodeTest-1965377503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (664d79c7-5f93-4d81-b379-f276a6d5c7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab4d6594-b7f1-4290-a5bc-c2aac1aecac7', 'volume_name': 'volume-ab4d6594-b7f1-4290-a5bc-c2aac1aecac7', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:35 devstack sudo[102723]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9f03f05f-cd0a-4261-b0f6-f3ffcdb16797 tempest-CinderUnicodeTest-1965377503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5efebd8b-74f1-4c83-a00c-83fb296bef61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9f03f05f-cd0a-4261-b0f6-f3ffcdb16797 tempest-CinderUnicodeTest-1965377503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5efebd8b-74f1-4c83-a00c-83fb296bef61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9f03f05f-cd0a-4261-b0f6-f3ffcdb16797 tempest-CinderUnicodeTest-1965377503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0104c3d1-ac5a-4c4a-bc1f-9be5081e1d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:35 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-9f03f05f-cd0a-4261-b0f6-f3ffcdb16797 tempest-CinderUnicodeTest-1965377503 None] Volume ab4d6594-b7f1-4290-a5bc-c2aac1aecac7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab4d6594-b7f1-4290-a5bc-c2aac1aecac7', 'volume_size': 1} Aug 31 15:26:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9f03f05f-cd0a-4261-b0f6-f3ffcdb16797 tempest-CinderUnicodeTest-1965377503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9f03f05f-cd0a-4261-b0f6-f3ffcdb16797 tempest-CinderUnicodeTest-1965377503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:35 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-9f03f05f-cd0a-4261-b0f6-f3ffcdb16797 tempest-CinderUnicodeTest-1965377503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab4d6594-b7f1-4290-a5bc-c2aac1aecac7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='823c8f93f8ce4e9d8a247ac54a4758d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:26:36Z,use_quota=True,user_id='7d118b70947c404e8e6a10daa3aabd0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:26:35 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-9f03f05f-cd0a-4261-b0f6-f3ffcdb16797 tempest-CinderUnicodeTest-1965377503 None] Creating volume ab4d6594-b7f1-4290-a5bc-c2aac1aecac7 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:26:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9f03f05f-cd0a-4261-b0f6-f3ffcdb16797 tempest-CinderUnicodeTest-1965377503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9f03f05f-cd0a-4261-b0f6-f3ffcdb16797 tempest-CinderUnicodeTest-1965377503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:35 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-9f03f05f-cd0a-4261-b0f6-f3ffcdb16797 tempest-CinderUnicodeTest-1965377503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:26:35 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-9f03f05f-cd0a-4261-b0f6-f3ffcdb16797 tempest-CinderUnicodeTest-1965377503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:26:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9f03f05f-cd0a-4261-b0f6-f3ffcdb16797 tempest-CinderUnicodeTest-1965377503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:35 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-9f03f05f-cd0a-4261-b0f6-f3ffcdb16797 tempest-CinderUnicodeTest-1965377503 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:26:35 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-9f03f05f-cd0a-4261-b0f6-f3ffcdb16797 tempest-CinderUnicodeTest-1965377503 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:26:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9f03f05f-cd0a-4261-b0f6-f3ffcdb16797 tempest-CinderUnicodeTest-1965377503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ab4d6594-b7f1-4290-a5bc-c2aac1aecac7 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4bdeca34-5614-4d7f-9e3f-1e224d27b922 tempest-ProjectReaderTests-482304182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.506s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:35 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-4bdeca34-5614-4d7f-9e3f-1e224d27b922 tempest-ProjectReaderTests-482304182 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:26:35 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-4bdeca34-5614-4d7f-9e3f-1e224d27b922 tempest-ProjectReaderTests-482304182 None] Deleted volume successfully. Aug 31 15:26:36 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4bdeca34-5614-4d7f-9e3f-1e224d27b922 tempest-ProjectReaderTests-482304182 None] Lock "cinder-4168e84e-20a8-4b98-b555-78dbf9d17012-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:26:36 devstack sudo[102747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ab4d6594-b7f1-4290-a5bc-c2aac1aecac7 1073741824 Aug 31 15:26:36 devstack sudo[102747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:36 devstack sudo[102747]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9f03f05f-cd0a-4261-b0f6-f3ffcdb16797 tempest-CinderUnicodeTest-1965377503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ab4d6594-b7f1-4290-a5bc-c2aac1aecac7 1073741824" returned: 0 in 0.785s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9f03f05f-cd0a-4261-b0f6-f3ffcdb16797 tempest-CinderUnicodeTest-1965377503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ab4d6594-b7f1-4290-a5bc-c2aac1aecac7 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:36 devstack sudo[102758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ab4d6594-b7f1-4290-a5bc-c2aac1aecac7 Aug 31 15:26:36 devstack sudo[102758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:37 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-19578e40-e3fa-4d51-9dc3-43c1181790ce tempest-ProjectReaderTests-482304182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:26:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-19578e40-e3fa-4d51-9dc3-43c1181790ce tempest-ProjectReaderTests-482304182 None] Flow 'volume_create_manager' (43266e46-cad8-4433-a36e-b05cd4a58cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:26:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-19578e40-e3fa-4d51-9dc3-43c1181790ce tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d1dda3-a84a-446f-bf4f-6c63336243bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-19578e40-e3fa-4d51-9dc3-43c1181790ce tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d1dda3-a84a-446f-bf4f-6c63336243bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:26:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1331655050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eeb2e1e-2d68-4ce5-8cd3-dcf19f8b553d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='401baf65d58c4e8face5e39dbd41361d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:26:37Z,use_quota=True,user_id='08b254fde3d74c4eaaf228798bc43139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-19578e40-e3fa-4d51-9dc3-43c1181790ce tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e2beb04-e275-4ffc-83a1-cd94ade53a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-19578e40-e3fa-4d51-9dc3-43c1181790ce tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e2beb04-e275-4ffc-83a1-cd94ade53a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-19578e40-e3fa-4d51-9dc3-43c1181790ce tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f290a43-ab60-442c-aef0-34c7aa50cdd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-19578e40-e3fa-4d51-9dc3-43c1181790ce tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f290a43-ab60-442c-aef0-34c7aa50cdd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5eeb2e1e-2d68-4ce5-8cd3-dcf19f8b553d', 'volume_name': 'volume-5eeb2e1e-2d68-4ce5-8cd3-dcf19f8b553d', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:37 devstack sudo[102758]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-19578e40-e3fa-4d51-9dc3-43c1181790ce tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa24fbe2-39b4-4f97-aa2a-d39d66ed1767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-19578e40-e3fa-4d51-9dc3-43c1181790ce tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa24fbe2-39b4-4f97-aa2a-d39d66ed1767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-19578e40-e3fa-4d51-9dc3-43c1181790ce tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (050f254d-feec-4468-85f9-064d3824a8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:37 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-19578e40-e3fa-4d51-9dc3-43c1181790ce tempest-ProjectReaderTests-482304182 None] Volume 5eeb2e1e-2d68-4ce5-8cd3-dcf19f8b553d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5eeb2e1e-2d68-4ce5-8cd3-dcf19f8b553d', 'volume_size': 1} Aug 31 15:26:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-19578e40-e3fa-4d51-9dc3-43c1181790ce tempest-ProjectReaderTests-482304182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9f03f05f-cd0a-4261-b0f6-f3ffcdb16797 tempest-CinderUnicodeTest-1965377503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ab4d6594-b7f1-4290-a5bc-c2aac1aecac7" returned: 0 in 0.359s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:37 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-9f03f05f-cd0a-4261-b0f6-f3ffcdb16797 tempest-CinderUnicodeTest-1965377503 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:26:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9f03f05f-cd0a-4261-b0f6-f3ffcdb16797 tempest-CinderUnicodeTest-1965377503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-19578e40-e3fa-4d51-9dc3-43c1181790ce tempest-ProjectReaderTests-482304182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:37 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-19578e40-e3fa-4d51-9dc3-43c1181790ce tempest-ProjectReaderTests-482304182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:26:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1331655050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eeb2e1e-2d68-4ce5-8cd3-dcf19f8b553d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='401baf65d58c4e8face5e39dbd41361d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:26:37Z,use_quota=True,user_id='08b254fde3d74c4eaaf228798bc43139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:26:37 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-19578e40-e3fa-4d51-9dc3-43c1181790ce tempest-ProjectReaderTests-482304182 None] Creating volume 5eeb2e1e-2d68-4ce5-8cd3-dcf19f8b553d {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:26:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-19578e40-e3fa-4d51-9dc3-43c1181790ce tempest-ProjectReaderTests-482304182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-19578e40-e3fa-4d51-9dc3-43c1181790ce tempest-ProjectReaderTests-482304182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:37 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-19578e40-e3fa-4d51-9dc3-43c1181790ce tempest-ProjectReaderTests-482304182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:26:37 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-19578e40-e3fa-4d51-9dc3-43c1181790ce tempest-ProjectReaderTests-482304182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:26:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-19578e40-e3fa-4d51-9dc3-43c1181790ce tempest-ProjectReaderTests-482304182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:37 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-19578e40-e3fa-4d51-9dc3-43c1181790ce tempest-ProjectReaderTests-482304182 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:26:37 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-19578e40-e3fa-4d51-9dc3-43c1181790ce tempest-ProjectReaderTests-482304182 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:26:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-19578e40-e3fa-4d51-9dc3-43c1181790ce tempest-ProjectReaderTests-482304182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-5eeb2e1e-2d68-4ce5-8cd3-dcf19f8b553d 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9f03f05f-cd0a-4261-b0f6-f3ffcdb16797 tempest-CinderUnicodeTest-1965377503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0104c3d1-ac5a-4c4a-bc1f-9be5081e1d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab4d6594-b7f1-4290-a5bc-c2aac1aecac7', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:37 devstack sudo[102764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-5eeb2e1e-2d68-4ce5-8cd3-dcf19f8b553d 1073741824 Aug 31 15:26:37 devstack sudo[102764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9f03f05f-cd0a-4261-b0f6-f3ffcdb16797 tempest-CinderUnicodeTest-1965377503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (100f270d-8d49-466c-8e48-67c01da3733c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:37 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-9f03f05f-cd0a-4261-b0f6-f3ffcdb16797 tempest-CinderUnicodeTest-1965377503 None] Volume volume-ab4d6594-b7f1-4290-a5bc-c2aac1aecac7 (ab4d6594-b7f1-4290-a5bc-c2aac1aecac7): created successfully Aug 31 15:26:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9f03f05f-cd0a-4261-b0f6-f3ffcdb16797 tempest-CinderUnicodeTest-1965377503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (100f270d-8d49-466c-8e48-67c01da3733c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9f03f05f-cd0a-4261-b0f6-f3ffcdb16797 tempest-CinderUnicodeTest-1965377503 None] Flow 'volume_create_manager' (42023a01-619b-4fce-95f1-2085a8527867) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:26:37 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-9f03f05f-cd0a-4261-b0f6-f3ffcdb16797 tempest-CinderUnicodeTest-1965377503 None] Created volume successfully. Aug 31 15:26:37 devstack sudo[102764]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-19578e40-e3fa-4d51-9dc3-43c1181790ce tempest-ProjectReaderTests-482304182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-5eeb2e1e-2d68-4ce5-8cd3-dcf19f8b553d 1073741824" returned: 0 in 0.437s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-19578e40-e3fa-4d51-9dc3-43c1181790ce tempest-ProjectReaderTests-482304182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-5eeb2e1e-2d68-4ce5-8cd3-dcf19f8b553d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:37 devstack sudo[102769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-5eeb2e1e-2d68-4ce5-8cd3-dcf19f8b553d Aug 31 15:26:37 devstack sudo[102769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:37 devstack sudo[102769]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-19578e40-e3fa-4d51-9dc3-43c1181790ce tempest-ProjectReaderTests-482304182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-5eeb2e1e-2d68-4ce5-8cd3-dcf19f8b553d" returned: 0 in 0.262s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:37 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-19578e40-e3fa-4d51-9dc3-43c1181790ce tempest-ProjectReaderTests-482304182 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:26:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-19578e40-e3fa-4d51-9dc3-43c1181790ce tempest-ProjectReaderTests-482304182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-19578e40-e3fa-4d51-9dc3-43c1181790ce tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (050f254d-feec-4468-85f9-064d3824a8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5eeb2e1e-2d68-4ce5-8cd3-dcf19f8b553d', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-19578e40-e3fa-4d51-9dc3-43c1181790ce tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7f43c08-70ea-470e-8bd1-54b6658a7045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:37 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-19578e40-e3fa-4d51-9dc3-43c1181790ce tempest-ProjectReaderTests-482304182 None] Volume volume-5eeb2e1e-2d68-4ce5-8cd3-dcf19f8b553d (5eeb2e1e-2d68-4ce5-8cd3-dcf19f8b553d): created successfully Aug 31 15:26:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-19578e40-e3fa-4d51-9dc3-43c1181790ce tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7f43c08-70ea-470e-8bd1-54b6658a7045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-19578e40-e3fa-4d51-9dc3-43c1181790ce tempest-ProjectReaderTests-482304182 None] Flow 'volume_create_manager' (43266e46-cad8-4433-a36e-b05cd4a58cdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:26:37 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-19578e40-e3fa-4d51-9dc3-43c1181790ce tempest-ProjectReaderTests-482304182 None] Created volume successfully. Aug 31 15:26:38 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-fcfea63b-e021-4f7c-bb09-ec6a2e93863c tempest-ProjectReaderTests-482304182 None] Acquiring lock "cinder-5eeb2e1e-2d68-4ce5-8cd3-dcf19f8b553d-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:26:38 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-fcfea63b-e021-4f7c-bb09-ec6a2e93863c tempest-ProjectReaderTests-482304182 None] Lock "cinder-5eeb2e1e-2d68-4ce5-8cd3-dcf19f8b553d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:26:38 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-fcfea63b-e021-4f7c-bb09-ec6a2e93863c tempest-ProjectReaderTests-482304182 None] Acquiring lock "cinder-quobyte-5eeb2e1e-2d68-4ce5-8cd3-dcf19f8b553d" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:26:38 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-fcfea63b-e021-4f7c-bb09-ec6a2e93863c tempest-ProjectReaderTests-482304182 None] Lock "cinder-quobyte-5eeb2e1e-2d68-4ce5-8cd3-dcf19f8b553d" acquired by "delete_volume" :: waited 0.028s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:26:38 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2aeb83-97d2-4812-ab98-d4e2e4999ed5]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:26:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-fcfea63b-e021-4f7c-bb09-ec6a2e93863c tempest-ProjectReaderTests-482304182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-5eeb2e1e-2d68-4ce5-8cd3-dcf19f8b553d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:38 devstack sudo[102772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-5eeb2e1e-2d68-4ce5-8cd3-dcf19f8b553d Aug 31 15:26:38 devstack sudo[102772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:38 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-af922e67-e8b0-40c1-a5a9-6f7dd5b5e20f tempest-CinderUnicodeTest-1965377503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:26:38 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-af922e67-e8b0-40c1-a5a9-6f7dd5b5e20f tempest-CinderUnicodeTest-1965377503 None] Flow 'volume_create_manager' (cc60aa86-a081-464e-9032-1f8278e79101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:26:38 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-af922e67-e8b0-40c1-a5a9-6f7dd5b5e20f tempest-CinderUnicodeTest-1965377503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ed576e4-d41f-4fef-a756-6523c117280c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:38 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-af922e67-e8b0-40c1-a5a9-6f7dd5b5e20f tempest-CinderUnicodeTest-1965377503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ed576e4-d41f-4fef-a756-6523c117280c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:26:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-416366485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec396c7c-71c6-44d9-8a13-39c14f4fc645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='823c8f93f8ce4e9d8a247ac54a4758d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:26:39Z,use_quota=True,user_id='7d118b70947c404e8e6a10daa3aabd0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:38 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-af922e67-e8b0-40c1-a5a9-6f7dd5b5e20f tempest-CinderUnicodeTest-1965377503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00886204-5f7f-4c7d-82a0-618e98fe1737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:38 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-af922e67-e8b0-40c1-a5a9-6f7dd5b5e20f tempest-CinderUnicodeTest-1965377503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00886204-5f7f-4c7d-82a0-618e98fe1737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:38 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-af922e67-e8b0-40c1-a5a9-6f7dd5b5e20f tempest-CinderUnicodeTest-1965377503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85cc383e-2b59-4055-af54-9e5a317eff7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:38 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-af922e67-e8b0-40c1-a5a9-6f7dd5b5e20f tempest-CinderUnicodeTest-1965377503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85cc383e-2b59-4055-af54-9e5a317eff7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec396c7c-71c6-44d9-8a13-39c14f4fc645', 'volume_name': 'volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:38 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-af922e67-e8b0-40c1-a5a9-6f7dd5b5e20f tempest-CinderUnicodeTest-1965377503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afc28cc3-74c7-49f1-ac95-180c1ded6e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:38 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-af922e67-e8b0-40c1-a5a9-6f7dd5b5e20f tempest-CinderUnicodeTest-1965377503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afc28cc3-74c7-49f1-ac95-180c1ded6e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:38 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-af922e67-e8b0-40c1-a5a9-6f7dd5b5e20f tempest-CinderUnicodeTest-1965377503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b038bffe-ba80-485d-afe1-c06f70ac5271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:38 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-af922e67-e8b0-40c1-a5a9-6f7dd5b5e20f tempest-CinderUnicodeTest-1965377503 None] Volume ec396c7c-71c6-44d9-8a13-39c14f4fc645: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645', 'volume_size': 1} Aug 31 15:26:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-af922e67-e8b0-40c1-a5a9-6f7dd5b5e20f tempest-CinderUnicodeTest-1965377503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-af922e67-e8b0-40c1-a5a9-6f7dd5b5e20f tempest-CinderUnicodeTest-1965377503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:38 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-af922e67-e8b0-40c1-a5a9-6f7dd5b5e20f tempest-CinderUnicodeTest-1965377503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:26:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-416366485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec396c7c-71c6-44d9-8a13-39c14f4fc645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='823c8f93f8ce4e9d8a247ac54a4758d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:26:39Z,use_quota=True,user_id='7d118b70947c404e8e6a10daa3aabd0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:26:38 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-af922e67-e8b0-40c1-a5a9-6f7dd5b5e20f tempest-CinderUnicodeTest-1965377503 None] Creating volume ec396c7c-71c6-44d9-8a13-39c14f4fc645 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:26:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-af922e67-e8b0-40c1-a5a9-6f7dd5b5e20f tempest-CinderUnicodeTest-1965377503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-af922e67-e8b0-40c1-a5a9-6f7dd5b5e20f tempest-CinderUnicodeTest-1965377503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:38 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-af922e67-e8b0-40c1-a5a9-6f7dd5b5e20f tempest-CinderUnicodeTest-1965377503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:26:38 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-af922e67-e8b0-40c1-a5a9-6f7dd5b5e20f tempest-CinderUnicodeTest-1965377503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:26:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-af922e67-e8b0-40c1-a5a9-6f7dd5b5e20f tempest-CinderUnicodeTest-1965377503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:38 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-af922e67-e8b0-40c1-a5a9-6f7dd5b5e20f tempest-CinderUnicodeTest-1965377503 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:26:38 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-af922e67-e8b0-40c1-a5a9-6f7dd5b5e20f tempest-CinderUnicodeTest-1965377503 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:26:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-af922e67-e8b0-40c1-a5a9-6f7dd5b5e20f tempest-CinderUnicodeTest-1965377503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:38 devstack sudo[102781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645 1073741824 Aug 31 15:26:38 devstack sudo[102781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:38 devstack sudo[102772]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-fcfea63b-e021-4f7c-bb09-ec6a2e93863c tempest-ProjectReaderTests-482304182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-5eeb2e1e-2d68-4ce5-8cd3-dcf19f8b553d" returned: 0 in 0.417s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-fcfea63b-e021-4f7c-bb09-ec6a2e93863c tempest-ProjectReaderTests-482304182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-5eeb2e1e-2d68-4ce5-8cd3-dcf19f8b553d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:38 devstack sudo[102783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-5eeb2e1e-2d68-4ce5-8cd3-dcf19f8b553d Aug 31 15:26:38 devstack sudo[102783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:39 devstack sudo[102783]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-fcfea63b-e021-4f7c-bb09-ec6a2e93863c tempest-ProjectReaderTests-482304182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-5eeb2e1e-2d68-4ce5-8cd3-dcf19f8b553d" returned: 0 in 0.309s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:39 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-fcfea63b-e021-4f7c-bb09-ec6a2e93863c tempest-ProjectReaderTests-482304182 None] Lock "cinder-quobyte-5eeb2e1e-2d68-4ce5-8cd3-dcf19f8b553d" released by "delete_volume" :: held 0.788s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:26:39 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-fcfea63b-e021-4f7c-bb09-ec6a2e93863c tempest-ProjectReaderTests-482304182 None] Created reservations ['69414da2-c1c9-4002-a0b6-c40a475c3f13', '2776fa76-6e3d-48af-b1a8-8f6c620534d6', 'f19a6c9e-3e66-4333-a84c-00e292eb73fb', 'ccd272d0-776e-48bf-96e9-56dc554bcb54'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:26:39 devstack sudo[102781]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-af922e67-e8b0-40c1-a5a9-6f7dd5b5e20f tempest-CinderUnicodeTest-1965377503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645 1073741824" returned: 0 in 0.575s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-fcfea63b-e021-4f7c-bb09-ec6a2e93863c tempest-ProjectReaderTests-482304182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-fcfea63b-e021-4f7c-bb09-ec6a2e93863c tempest-ProjectReaderTests-482304182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:39 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-fcfea63b-e021-4f7c-bb09-ec6a2e93863c tempest-ProjectReaderTests-482304182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:26:39 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-fcfea63b-e021-4f7c-bb09-ec6a2e93863c tempest-ProjectReaderTests-482304182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:26:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-fcfea63b-e021-4f7c-bb09-ec6a2e93863c tempest-ProjectReaderTests-482304182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-fcfea63b-e021-4f7c-bb09-ec6a2e93863c tempest-ProjectReaderTests-482304182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-af922e67-e8b0-40c1-a5a9-6f7dd5b5e20f tempest-CinderUnicodeTest-1965377503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:39 devstack sudo[102792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:26:39 devstack sudo[102792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:39 devstack sudo[102793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645 Aug 31 15:26:39 devstack sudo[102793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:39 devstack sudo[102792]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-fcfea63b-e021-4f7c-bb09-ec6a2e93863c tempest-ProjectReaderTests-482304182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.527s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:39 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-fcfea63b-e021-4f7c-bb09-ec6a2e93863c tempest-ProjectReaderTests-482304182 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:26:39 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-fcfea63b-e021-4f7c-bb09-ec6a2e93863c tempest-ProjectReaderTests-482304182 None] Deleted volume successfully. Aug 31 15:26:39 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-fcfea63b-e021-4f7c-bb09-ec6a2e93863c tempest-ProjectReaderTests-482304182 None] Lock "cinder-5eeb2e1e-2d68-4ce5-8cd3-dcf19f8b553d-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:26:39 devstack sudo[102793]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-af922e67-e8b0-40c1-a5a9-6f7dd5b5e20f tempest-CinderUnicodeTest-1965377503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645" returned: 0 in 0.556s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:39 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-af922e67-e8b0-40c1-a5a9-6f7dd5b5e20f tempest-CinderUnicodeTest-1965377503 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:26:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-af922e67-e8b0-40c1-a5a9-6f7dd5b5e20f tempest-CinderUnicodeTest-1965377503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:39 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-af922e67-e8b0-40c1-a5a9-6f7dd5b5e20f tempest-CinderUnicodeTest-1965377503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b038bffe-ba80-485d-afe1-c06f70ac5271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:39 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-af922e67-e8b0-40c1-a5a9-6f7dd5b5e20f tempest-CinderUnicodeTest-1965377503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc0476bc-85c0-4e78-a58d-085f6c75e68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:39 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-af922e67-e8b0-40c1-a5a9-6f7dd5b5e20f tempest-CinderUnicodeTest-1965377503 None] Volume volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645 (ec396c7c-71c6-44d9-8a13-39c14f4fc645): created successfully Aug 31 15:26:39 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-af922e67-e8b0-40c1-a5a9-6f7dd5b5e20f tempest-CinderUnicodeTest-1965377503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc0476bc-85c0-4e78-a58d-085f6c75e68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:39 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-af922e67-e8b0-40c1-a5a9-6f7dd5b5e20f tempest-CinderUnicodeTest-1965377503 None] Flow 'volume_create_manager' (cc60aa86-a081-464e-9032-1f8278e79101) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:26:40 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-af922e67-e8b0-40c1-a5a9-6f7dd5b5e20f tempest-CinderUnicodeTest-1965377503 None] Created volume successfully. Aug 31 15:26:40 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-72d4d00d-a968-4a4c-95ef-785b68fb676c tempest-ProjectReaderTests-482304182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:26:40 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-72d4d00d-a968-4a4c-95ef-785b68fb676c tempest-ProjectReaderTests-482304182 None] Flow 'volume_create_manager' (27489e2c-3edc-46f1-a8da-081c6c1f7a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:26:40 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-72d4d00d-a968-4a4c-95ef-785b68fb676c tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0db23328-940d-4d53-b847-6bf8dbf53a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:40 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-72d4d00d-a968-4a4c-95ef-785b68fb676c tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0db23328-940d-4d53-b847-6bf8dbf53a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1628096413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8630f5f1-c493-4fa7-b44e-02658066bed2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='401baf65d58c4e8face5e39dbd41361d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:26:40Z,use_quota=True,user_id='08b254fde3d74c4eaaf228798bc43139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:40 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-72d4d00d-a968-4a4c-95ef-785b68fb676c tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e5b48fd-845b-4807-82f6-01fb5a49ab50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:40 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-72d4d00d-a968-4a4c-95ef-785b68fb676c tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e5b48fd-845b-4807-82f6-01fb5a49ab50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:40 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-72d4d00d-a968-4a4c-95ef-785b68fb676c tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de87e29f-21c6-4ae8-96b0-3ae11c7ce695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:40 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-72d4d00d-a968-4a4c-95ef-785b68fb676c tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de87e29f-21c6-4ae8-96b0-3ae11c7ce695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8630f5f1-c493-4fa7-b44e-02658066bed2', 'volume_name': 'volume-8630f5f1-c493-4fa7-b44e-02658066bed2', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:40 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-72d4d00d-a968-4a4c-95ef-785b68fb676c tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d08a0153-1a72-4c33-bffc-e43246c68e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:40 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-72d4d00d-a968-4a4c-95ef-785b68fb676c tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d08a0153-1a72-4c33-bffc-e43246c68e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:40 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-72d4d00d-a968-4a4c-95ef-785b68fb676c tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09e70588-0180-4c21-8402-1c8735a2e71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:40 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-72d4d00d-a968-4a4c-95ef-785b68fb676c tempest-ProjectReaderTests-482304182 None] Volume 8630f5f1-c493-4fa7-b44e-02658066bed2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8630f5f1-c493-4fa7-b44e-02658066bed2', 'volume_size': 1} Aug 31 15:26:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-72d4d00d-a968-4a4c-95ef-785b68fb676c tempest-ProjectReaderTests-482304182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-72d4d00d-a968-4a4c-95ef-785b68fb676c tempest-ProjectReaderTests-482304182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:40 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-72d4d00d-a968-4a4c-95ef-785b68fb676c tempest-ProjectReaderTests-482304182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1628096413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8630f5f1-c493-4fa7-b44e-02658066bed2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='401baf65d58c4e8face5e39dbd41361d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:26:40Z,use_quota=True,user_id='08b254fde3d74c4eaaf228798bc43139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:26:40 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-72d4d00d-a968-4a4c-95ef-785b68fb676c tempest-ProjectReaderTests-482304182 None] Creating volume 8630f5f1-c493-4fa7-b44e-02658066bed2 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:26:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-72d4d00d-a968-4a4c-95ef-785b68fb676c tempest-ProjectReaderTests-482304182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-72d4d00d-a968-4a4c-95ef-785b68fb676c tempest-ProjectReaderTests-482304182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:40 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-72d4d00d-a968-4a4c-95ef-785b68fb676c tempest-ProjectReaderTests-482304182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:26:40 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-72d4d00d-a968-4a4c-95ef-785b68fb676c tempest-ProjectReaderTests-482304182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:26:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-72d4d00d-a968-4a4c-95ef-785b68fb676c tempest-ProjectReaderTests-482304182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:40 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-72d4d00d-a968-4a4c-95ef-785b68fb676c tempest-ProjectReaderTests-482304182 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:26:40 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-72d4d00d-a968-4a4c-95ef-785b68fb676c tempest-ProjectReaderTests-482304182 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:26:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-72d4d00d-a968-4a4c-95ef-785b68fb676c tempest-ProjectReaderTests-482304182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8630f5f1-c493-4fa7-b44e-02658066bed2 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:40 devstack sudo[102803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8630f5f1-c493-4fa7-b44e-02658066bed2 1073741824 Aug 31 15:26:40 devstack sudo[102803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:40 devstack sudo[102803]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-72d4d00d-a968-4a4c-95ef-785b68fb676c tempest-ProjectReaderTests-482304182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8630f5f1-c493-4fa7-b44e-02658066bed2 1073741824" returned: 0 in 0.579s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-72d4d00d-a968-4a4c-95ef-785b68fb676c tempest-ProjectReaderTests-482304182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8630f5f1-c493-4fa7-b44e-02658066bed2 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:40 devstack sudo[102810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8630f5f1-c493-4fa7-b44e-02658066bed2 Aug 31 15:26:40 devstack sudo[102810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8888f2ba-6301-44e3-adaf-06e63e094a07 tempest-CinderUnicodeTest-1965377503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:41 devstack sudo[102810]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-72d4d00d-a968-4a4c-95ef-785b68fb676c tempest-ProjectReaderTests-482304182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8630f5f1-c493-4fa7-b44e-02658066bed2" returned: 0 in 0.383s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:41 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-72d4d00d-a968-4a4c-95ef-785b68fb676c tempest-ProjectReaderTests-482304182 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:26:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-72d4d00d-a968-4a4c-95ef-785b68fb676c tempest-ProjectReaderTests-482304182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8888f2ba-6301-44e3-adaf-06e63e094a07 tempest-CinderUnicodeTest-1965377503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.060s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:41 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-72d4d00d-a968-4a4c-95ef-785b68fb676c tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09e70588-0180-4c21-8402-1c8735a2e71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8630f5f1-c493-4fa7-b44e-02658066bed2', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:41 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-72d4d00d-a968-4a4c-95ef-785b68fb676c tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b380581-0d19-45dc-a66b-36b181dd022d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:41 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-8888f2ba-6301-44e3-adaf-06e63e094a07 tempest-CinderUnicodeTest-1965377503 None] Creating offline snapshot 24141044-8edf-4a60-a559-60e87ffdc682 of volume ec396c7c-71c6-44d9-8a13-39c14f4fc645 {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:26:41 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-72d4d00d-a968-4a4c-95ef-785b68fb676c tempest-ProjectReaderTests-482304182 None] Volume volume-8630f5f1-c493-4fa7-b44e-02658066bed2 (8630f5f1-c493-4fa7-b44e-02658066bed2): created successfully Aug 31 15:26:41 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-72d4d00d-a968-4a4c-95ef-785b68fb676c tempest-ProjectReaderTests-482304182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b380581-0d19-45dc-a66b-36b181dd022d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:41 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-72d4d00d-a968-4a4c-95ef-785b68fb676c tempest-ProjectReaderTests-482304182 None] Flow 'volume_create_manager' (27489e2c-3edc-46f1-a8da-081c6c1f7a99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:26:41 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc865c6f-b35c-4fd3-8b50-f14d88d72f1b]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:26:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8888f2ba-6301-44e3-adaf-06e63e094a07 tempest-CinderUnicodeTest-1965377503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:41 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-72d4d00d-a968-4a4c-95ef-785b68fb676c tempest-ProjectReaderTests-482304182 None] Created volume successfully. Aug 31 15:26:41 devstack sudo[102815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645 Aug 31 15:26:41 devstack sudo[102815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:41 devstack sudo[102815]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8888f2ba-6301-44e3-adaf-06e63e094a07 tempest-CinderUnicodeTest-1965377503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645" returned: 0 in 0.616s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8888f2ba-6301-44e3-adaf-06e63e094a07 tempest-CinderUnicodeTest-1965377503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645.24141044-8edf-4a60-a559-60e87ffdc682 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:41 devstack sudo[102838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645.24141044-8edf-4a60-a559-60e87ffdc682 1G Aug 31 15:26:41 devstack sudo[102838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:42 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-40aabd2a-04d7-459a-9cec-b43614c56411 req-14620c3c-1380-44c1-b63d-da6ae39a7f58 tempest-TestShelveInstance-784750763 None] Terminate volume connection completed successfully. Aug 31 15:26:42 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-40aabd2a-04d7-459a-9cec-b43614c56411 req-14620c3c-1380-44c1-b63d-da6ae39a7f58 tempest-TestShelveInstance-784750763 None] Deleting attachment 7cf28684-4c3a-4ae6-846c-2dd6382d7e2c. {{(pid=86000) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 31 15:26:42 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-dd35cc8e-38c1-47ba-8cca-01306ce33126 tempest-ProjectReaderTests-482304182 None] Acquiring lock "cinder-8630f5f1-c493-4fa7-b44e-02658066bed2-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:26:42 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-dd35cc8e-38c1-47ba-8cca-01306ce33126 tempest-ProjectReaderTests-482304182 None] Lock "cinder-8630f5f1-c493-4fa7-b44e-02658066bed2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:26:42 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-dd35cc8e-38c1-47ba-8cca-01306ce33126 tempest-ProjectReaderTests-482304182 None] Acquiring lock "cinder-quobyte-8630f5f1-c493-4fa7-b44e-02658066bed2" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:26:42 devstack sudo[102838]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:42 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-dd35cc8e-38c1-47ba-8cca-01306ce33126 tempest-ProjectReaderTests-482304182 None] Lock "cinder-quobyte-8630f5f1-c493-4fa7-b44e-02658066bed2" acquired by "delete_volume" :: waited 0.025s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:26:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8888f2ba-6301-44e3-adaf-06e63e094a07 tempest-CinderUnicodeTest-1965377503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645.24141044-8edf-4a60-a559-60e87ffdc682 1G" returned: 0 in 0.618s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8888f2ba-6301-44e3-adaf-06e63e094a07 tempest-CinderUnicodeTest-1965377503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645.24141044-8edf-4a60-a559-60e87ffdc682 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:42 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a8ee73-d9d1-4ccb-95ca-45a89069a015]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:26:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-dd35cc8e-38c1-47ba-8cca-01306ce33126 tempest-ProjectReaderTests-482304182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8630f5f1-c493-4fa7-b44e-02658066bed2 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:42 devstack sudo[102844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645.24141044-8edf-4a60-a559-60e87ffdc682 Aug 31 15:26:42 devstack sudo[102844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:42 devstack sudo[102845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8630f5f1-c493-4fa7-b44e-02658066bed2 Aug 31 15:26:42 devstack sudo[102845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:42 devstack sudo[102844]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8888f2ba-6301-44e3-adaf-06e63e094a07 tempest-CinderUnicodeTest-1965377503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645.24141044-8edf-4a60-a559-60e87ffdc682" returned: 0 in 0.370s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:42 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-8888f2ba-6301-44e3-adaf-06e63e094a07 tempest-CinderUnicodeTest-1965377503 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645.24141044-8edf-4a60-a559-60e87ffdc682 is being set with open permissions: ugo+rw Aug 31 15:26:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8888f2ba-6301-44e3-adaf-06e63e094a07 tempest-CinderUnicodeTest-1965377503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645.24141044-8edf-4a60-a559-60e87ffdc682 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:42 devstack sudo[102854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645.24141044-8edf-4a60-a559-60e87ffdc682 Aug 31 15:26:42 devstack sudo[102854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:42 devstack sudo[102845]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-dd35cc8e-38c1-47ba-8cca-01306ce33126 tempest-ProjectReaderTests-482304182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8630f5f1-c493-4fa7-b44e-02658066bed2" returned: 0 in 0.410s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-dd35cc8e-38c1-47ba-8cca-01306ce33126 tempest-ProjectReaderTests-482304182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8630f5f1-c493-4fa7-b44e-02658066bed2 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:42 devstack sudo[102856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8630f5f1-c493-4fa7-b44e-02658066bed2 Aug 31 15:26:43 devstack sudo[102856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:43 devstack sudo[102854]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8888f2ba-6301-44e3-adaf-06e63e094a07 tempest-CinderUnicodeTest-1965377503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645.24141044-8edf-4a60-a559-60e87ffdc682" returned: 0 in 0.270s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8888f2ba-6301-44e3-adaf-06e63e094a07 tempest-CinderUnicodeTest-1965377503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:43 devstack sudo[102856]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-dd35cc8e-38c1-47ba-8cca-01306ce33126 tempest-ProjectReaderTests-482304182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8630f5f1-c493-4fa7-b44e-02658066bed2" returned: 0 in 0.262s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:43 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-dd35cc8e-38c1-47ba-8cca-01306ce33126 tempest-ProjectReaderTests-482304182 None] Lock "cinder-quobyte-8630f5f1-c493-4fa7-b44e-02658066bed2" released by "delete_volume" :: held 0.735s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:26:43 devstack sudo[102860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645.info Aug 31 15:26:43 devstack sudo[102860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:43 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-dd35cc8e-38c1-47ba-8cca-01306ce33126 tempest-ProjectReaderTests-482304182 None] Created reservations ['7e528d26-23cd-45dc-962e-4f3daf1b5cc2', '51e1de73-7810-4ff9-98ac-aaf604927f9d', '480dc659-9656-4f6b-a63b-99613fc5c36f', '1fc416c5-d0ad-49fc-88c1-01cdf7a1c41e'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:26:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-dd35cc8e-38c1-47ba-8cca-01306ce33126 tempest-ProjectReaderTests-482304182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-dd35cc8e-38c1-47ba-8cca-01306ce33126 tempest-ProjectReaderTests-482304182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:43 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-dd35cc8e-38c1-47ba-8cca-01306ce33126 tempest-ProjectReaderTests-482304182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:26:43 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-dd35cc8e-38c1-47ba-8cca-01306ce33126 tempest-ProjectReaderTests-482304182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:26:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-dd35cc8e-38c1-47ba-8cca-01306ce33126 tempest-ProjectReaderTests-482304182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-dd35cc8e-38c1-47ba-8cca-01306ce33126 tempest-ProjectReaderTests-482304182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:43 devstack sudo[102863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:26:43 devstack sudo[102863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:43 devstack sudo[102860]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8888f2ba-6301-44e3-adaf-06e63e094a07 tempest-CinderUnicodeTest-1965377503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645.info" returned: 0 in 0.289s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:43 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-8888f2ba-6301-44e3-adaf-06e63e094a07 tempest-CinderUnicodeTest-1965377503 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645.info is being set with open permissions: ugo+rw Aug 31 15:26:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8888f2ba-6301-44e3-adaf-06e63e094a07 tempest-CinderUnicodeTest-1965377503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:43 devstack sudo[102866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645.info Aug 31 15:26:43 devstack sudo[102866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:43 devstack sudo[102863]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-dd35cc8e-38c1-47ba-8cca-01306ce33126 tempest-ProjectReaderTests-482304182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.324s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:43 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-dd35cc8e-38c1-47ba-8cca-01306ce33126 tempest-ProjectReaderTests-482304182 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:26:43 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-dd35cc8e-38c1-47ba-8cca-01306ce33126 tempest-ProjectReaderTests-482304182 None] Deleted volume successfully. Aug 31 15:26:43 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-dd35cc8e-38c1-47ba-8cca-01306ce33126 tempest-ProjectReaderTests-482304182 None] Lock "cinder-8630f5f1-c493-4fa7-b44e-02658066bed2-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:26:43 devstack sudo[102866]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8888f2ba-6301-44e3-adaf-06e63e094a07 tempest-CinderUnicodeTest-1965377503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645.info" returned: 0 in 0.355s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8888f2ba-6301-44e3-adaf-06e63e094a07 tempest-CinderUnicodeTest-1965377503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.668s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:43 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-8888f2ba-6301-44e3-adaf-06e63e094a07 tempest-CinderUnicodeTest-1965377503 None] Create snapshot completed successfully Aug 31 15:26:44 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-91beaf73-dc69-4bf9-a8e9-50d47790688f tempest-CinderUnicodeTest-1965377503 None] Acquiring lock "cinder-24141044-8edf-4a60-a559-60e87ffdc682-delete_snapshot" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:26:44 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-91beaf73-dc69-4bf9-a8e9-50d47790688f tempest-CinderUnicodeTest-1965377503 None] Lock "cinder-24141044-8edf-4a60-a559-60e87ffdc682-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:26:44 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-91beaf73-dc69-4bf9-a8e9-50d47790688f tempest-CinderUnicodeTest-1965377503 None] Acquiring lock "cinder-quobyte-ec396c7c-71c6-44d9-8a13-39c14f4fc645" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:26:44 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-91beaf73-dc69-4bf9-a8e9-50d47790688f tempest-CinderUnicodeTest-1965377503 None] Lock "cinder-quobyte-ec396c7c-71c6-44d9-8a13-39c14f4fc645" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:26:44 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-91beaf73-dc69-4bf9-a8e9-50d47790688f tempest-CinderUnicodeTest-1965377503 None] Acquiring lock "cinder-quobyte-24141044-8edf-4a60-a559-60e87ffdc682" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:26:44 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-91beaf73-dc69-4bf9-a8e9-50d47790688f tempest-CinderUnicodeTest-1965377503 None] Lock "cinder-quobyte-24141044-8edf-4a60-a559-60e87ffdc682" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:26:44 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-91beaf73-dc69-4bf9-a8e9-50d47790688f tempest-CinderUnicodeTest-1965377503 None] Deleting offline snapshot 24141044-8edf-4a60-a559-60e87ffdc682 of volume ec396c7c-71c6-44d9-8a13-39c14f4fc645 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:26:44 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-91beaf73-dc69-4bf9-a8e9-50d47790688f tempest-CinderUnicodeTest-1965377503 None] snapshot_file for this snap is: volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645.24141044-8edf-4a60-a559-60e87ffdc682 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:26:44 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a125e2f5-ccd5-4217-9deb-3b19ac0d1c03]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:26:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-91beaf73-dc69-4bf9-a8e9-50d47790688f tempest-CinderUnicodeTest-1965377503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645.24141044-8edf-4a60-a559-60e87ffdc682 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:44 devstack sudo[102873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645.24141044-8edf-4a60-a559-60e87ffdc682 Aug 31 15:26:44 devstack sudo[102873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:45 devstack sudo[102873]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-91beaf73-dc69-4bf9-a8e9-50d47790688f tempest-CinderUnicodeTest-1965377503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645.24141044-8edf-4a60-a559-60e87ffdc682" returned: 0 in 0.538s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:45 devstack cinder-volume[86000]: DEBUG oslo_service.periodic_task [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86000) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:26:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:26:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:26:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-91beaf73-dc69-4bf9-a8e9-50d47790688f tempest-CinderUnicodeTest-1965377503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:26:45 devstack sudo[102878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:26:45 devstack sudo[102878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:45 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f73c7d8-4295-4dc0-a580-7e2386600dda]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:26:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-91beaf73-dc69-4bf9-a8e9-50d47790688f tempest-CinderUnicodeTest-1965377503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:45 devstack sudo[102880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645 Aug 31 15:26:45 devstack sudo[102880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:45 devstack sudo[102878]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.526s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:45 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:26:45 devstack cinder-volume[86000]: DEBUG oslo_service.periodic_task [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running periodic task VolumeManager._thread_info {{(pid=86000) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:26:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] thread count: 28 {{(pid=86000) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 31 15:26:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] thread info: [<_MainThread(MainThread, started 137631281086592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86000) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 31 15:26:45 devstack sudo[102880]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-91beaf73-dc69-4bf9-a8e9-50d47790688f tempest-CinderUnicodeTest-1965377503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645" returned: 0 in 0.705s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-91beaf73-dc69-4bf9-a8e9-50d47790688f tempest-CinderUnicodeTest-1965377503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645.24141044-8edf-4a60-a559-60e87ffdc682 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:45 devstack sudo[102893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645.24141044-8edf-4a60-a559-60e87ffdc682 Aug 31 15:26:45 devstack sudo[102893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-9526a588-f80d-4c96-91e6-08f3354c66d8 req-68cd93ef-8a0a-4a31-a1df-5dc468f768ae tempest-TestShelveInstance-784750763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-9526a588-f80d-4c96-91e6-08f3354c66d8 req-68cd93ef-8a0a-4a31-a1df-5dc468f768ae tempest-TestShelveInstance-784750763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-9526a588-f80d-4c96-91e6-08f3354c66d8 req-68cd93ef-8a0a-4a31-a1df-5dc468f768ae tempest-TestShelveInstance-784750763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-9526a588-f80d-4c96-91e6-08f3354c66d8 req-68cd93ef-8a0a-4a31-a1df-5dc468f768ae tempest-TestShelveInstance-784750763 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77', 'name': 'volume-377b42d6-0086-4561-a536-34876380339c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '05fb0104-97d4-4fab-8ac5-65008e9ff27d', 'enforce_multipath': True} {{(pid=86000) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 31 15:26:46 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-9526a588-f80d-4c96-91e6-08f3354c66d8 req-68cd93ef-8a0a-4a31-a1df-5dc468f768ae tempest-TestShelveInstance-784750763 None] attachment_update completed successfully. Aug 31 15:26:46 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-c8709374-d684-4c80-ad6c-f8849f1ed5bd tempest-VolumesNegativeTest-581059551 None] Acquiring lock "cinder-2ec25396-ea07-492c-9063-239182934ae9-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:26:46 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-c8709374-d684-4c80-ad6c-f8849f1ed5bd tempest-VolumesNegativeTest-581059551 None] Lock "cinder-2ec25396-ea07-492c-9063-239182934ae9-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:26:46 devstack sudo[102893]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-91beaf73-dc69-4bf9-a8e9-50d47790688f tempest-CinderUnicodeTest-1965377503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645.24141044-8edf-4a60-a559-60e87ffdc682" returned: 0 in 0.448s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-91beaf73-dc69-4bf9-a8e9-50d47790688f tempest-CinderUnicodeTest-1965377503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645.24141044-8edf-4a60-a559-60e87ffdc682 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:46 devstack sudo[102900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645.24141044-8edf-4a60-a559-60e87ffdc682 Aug 31 15:26:46 devstack sudo[102900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:46 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-c8709374-d684-4c80-ad6c-f8849f1ed5bd tempest-VolumesNegativeTest-581059551 None] Acquiring lock "cinder-quobyte-2ec25396-ea07-492c-9063-239182934ae9" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:26:46 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-c8709374-d684-4c80-ad6c-f8849f1ed5bd tempest-VolumesNegativeTest-581059551 None] Lock "cinder-quobyte-2ec25396-ea07-492c-9063-239182934ae9" acquired by "delete_volume" :: waited 0.024s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:26:46 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a8ff3b-20c9-467e-b6fd-af664453651d]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:26:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c8709374-d684-4c80-ad6c-f8849f1ed5bd tempest-VolumesNegativeTest-581059551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2ec25396-ea07-492c-9063-239182934ae9 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:46 devstack sudo[102902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2ec25396-ea07-492c-9063-239182934ae9 Aug 31 15:26:46 devstack sudo[102902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:46 devstack sudo[102900]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-91beaf73-dc69-4bf9-a8e9-50d47790688f tempest-CinderUnicodeTest-1965377503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645.24141044-8edf-4a60-a559-60e87ffdc682" returned: 0 in 0.371s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:46 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-91beaf73-dc69-4bf9-a8e9-50d47790688f tempest-CinderUnicodeTest-1965377503 None] Lock "cinder-quobyte-24141044-8edf-4a60-a559-60e87ffdc682" released by "_delete_snapshot" :: held 2.282s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:26:46 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-91beaf73-dc69-4bf9-a8e9-50d47790688f tempest-CinderUnicodeTest-1965377503 None] Lock "cinder-quobyte-ec396c7c-71c6-44d9-8a13-39c14f4fc645" released by "delete_snapshot" :: held 2.327s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:26:46 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-91beaf73-dc69-4bf9-a8e9-50d47790688f tempest-CinderUnicodeTest-1965377503 None] Created reservations ['4745adf6-6926-4c33-8f9b-902dbb766087', '77f639e8-e9dc-4458-b5ab-d3e22830f81a', '161edae5-7fcc-45f5-a88c-c5855c60d108', 'e7c96b1c-0031-4dfb-b4a4-90342e3d8b14'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:26:46 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-91beaf73-dc69-4bf9-a8e9-50d47790688f tempest-CinderUnicodeTest-1965377503 None] Delete snapshot completed successfully. Aug 31 15:26:46 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-91beaf73-dc69-4bf9-a8e9-50d47790688f tempest-CinderUnicodeTest-1965377503 None] Lock "cinder-24141044-8edf-4a60-a559-60e87ffdc682-delete_snapshot" released by "delete_snapshot" :: held 2.520s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:26:47 devstack sudo[102902]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c8709374-d684-4c80-ad6c-f8849f1ed5bd tempest-VolumesNegativeTest-581059551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2ec25396-ea07-492c-9063-239182934ae9" returned: 0 in 0.551s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c8709374-d684-4c80-ad6c-f8849f1ed5bd tempest-VolumesNegativeTest-581059551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2ec25396-ea07-492c-9063-239182934ae9 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:47 devstack sudo[102908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2ec25396-ea07-492c-9063-239182934ae9 Aug 31 15:26:47 devstack sudo[102908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:47 devstack sudo[102908]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c8709374-d684-4c80-ad6c-f8849f1ed5bd tempest-VolumesNegativeTest-581059551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2ec25396-ea07-492c-9063-239182934ae9" returned: 0 in 0.282s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:47 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-c8709374-d684-4c80-ad6c-f8849f1ed5bd tempest-VolumesNegativeTest-581059551 None] Lock "cinder-quobyte-2ec25396-ea07-492c-9063-239182934ae9" released by "delete_volume" :: held 0.877s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:26:47 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-c8709374-d684-4c80-ad6c-f8849f1ed5bd tempest-VolumesNegativeTest-581059551 None] Created reservations ['030dd95f-0508-403d-9b6e-6f10d8d8772b', '24e6e59f-e04b-4570-9142-deca9798141e', '8c16bdcf-41d6-4328-b37b-0ae0b9503083', '6ea20307-f23e-4991-a7c1-12a5b0ccafb5'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:26:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c8709374-d684-4c80-ad6c-f8849f1ed5bd tempest-VolumesNegativeTest-581059551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c8709374-d684-4c80-ad6c-f8849f1ed5bd tempest-VolumesNegativeTest-581059551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:47 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c8709374-d684-4c80-ad6c-f8849f1ed5bd tempest-VolumesNegativeTest-581059551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:26:47 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c8709374-d684-4c80-ad6c-f8849f1ed5bd tempest-VolumesNegativeTest-581059551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:26:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c8709374-d684-4c80-ad6c-f8849f1ed5bd tempest-VolumesNegativeTest-581059551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c8709374-d684-4c80-ad6c-f8849f1ed5bd tempest-VolumesNegativeTest-581059551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:47 devstack sudo[102911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:26:47 devstack sudo[102911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:47 devstack sudo[102911]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c8709374-d684-4c80-ad6c-f8849f1ed5bd tempest-VolumesNegativeTest-581059551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.288s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:47 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-c8709374-d684-4c80-ad6c-f8849f1ed5bd tempest-VolumesNegativeTest-581059551 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:26:47 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-c8709374-d684-4c80-ad6c-f8849f1ed5bd tempest-VolumesNegativeTest-581059551 None] Deleted volume successfully. Aug 31 15:26:47 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-c8709374-d684-4c80-ad6c-f8849f1ed5bd tempest-VolumesNegativeTest-581059551 None] Lock "cinder-2ec25396-ea07-492c-9063-239182934ae9-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:26:47 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-9ab78740-18b1-42d2-9246-4d9cf5a9caa3 tempest-CinderUnicodeTest-1965377503 None] Acquiring lock "cinder-ec396c7c-71c6-44d9-8a13-39c14f4fc645-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:26:47 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-9ab78740-18b1-42d2-9246-4d9cf5a9caa3 tempest-CinderUnicodeTest-1965377503 None] Lock "cinder-ec396c7c-71c6-44d9-8a13-39c14f4fc645-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:26:47 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-9ab78740-18b1-42d2-9246-4d9cf5a9caa3 tempest-CinderUnicodeTest-1965377503 None] Acquiring lock "cinder-quobyte-ec396c7c-71c6-44d9-8a13-39c14f4fc645" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:26:47 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-9ab78740-18b1-42d2-9246-4d9cf5a9caa3 tempest-CinderUnicodeTest-1965377503 None] Lock "cinder-quobyte-ec396c7c-71c6-44d9-8a13-39c14f4fc645" acquired by "delete_volume" :: waited 0.033s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:26:47 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[51565317-f3e9-42a3-b7e8-9e442ebb7cf5]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:26:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9ab78740-18b1-42d2-9246-4d9cf5a9caa3 tempest-CinderUnicodeTest-1965377503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:48 devstack sudo[102914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645 Aug 31 15:26:48 devstack sudo[102914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:48 devstack sudo[102914]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9ab78740-18b1-42d2-9246-4d9cf5a9caa3 tempest-CinderUnicodeTest-1965377503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645" returned: 0 in 0.461s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9ab78740-18b1-42d2-9246-4d9cf5a9caa3 tempest-CinderUnicodeTest-1965377503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:48 devstack sudo[102920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645 Aug 31 15:26:48 devstack sudo[102920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:48 devstack sudo[102920]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9ab78740-18b1-42d2-9246-4d9cf5a9caa3 tempest-CinderUnicodeTest-1965377503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ec396c7c-71c6-44d9-8a13-39c14f4fc645" returned: 0 in 0.295s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:48 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-9ab78740-18b1-42d2-9246-4d9cf5a9caa3 tempest-CinderUnicodeTest-1965377503 None] Lock "cinder-quobyte-ec396c7c-71c6-44d9-8a13-39c14f4fc645" released by "delete_volume" :: held 0.853s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:26:48 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-9ab78740-18b1-42d2-9246-4d9cf5a9caa3 tempest-CinderUnicodeTest-1965377503 None] Created reservations ['ccbc15df-90a0-4854-9833-8a6fc27de44f', 'ae066685-f7e0-4594-b415-822f20982a15', 'aa008e6c-144d-4bbf-9f2b-ac544a0945bf', '16185d92-7809-4650-af60-6a87d7c914f8'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:26:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9ab78740-18b1-42d2-9246-4d9cf5a9caa3 tempest-CinderUnicodeTest-1965377503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9ab78740-18b1-42d2-9246-4d9cf5a9caa3 tempest-CinderUnicodeTest-1965377503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:48 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-9ab78740-18b1-42d2-9246-4d9cf5a9caa3 tempest-CinderUnicodeTest-1965377503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:26:48 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-9ab78740-18b1-42d2-9246-4d9cf5a9caa3 tempest-CinderUnicodeTest-1965377503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:26:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9ab78740-18b1-42d2-9246-4d9cf5a9caa3 tempest-CinderUnicodeTest-1965377503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9ab78740-18b1-42d2-9246-4d9cf5a9caa3 tempest-CinderUnicodeTest-1965377503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:49 devstack sudo[102923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:26:49 devstack sudo[102923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:49 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-845f78c8-cf26-47b5-8de8-873a85ee98cf tempest-CinderUnicodeTest-1965377503 None] Acquiring lock "cinder-ab4d6594-b7f1-4290-a5bc-c2aac1aecac7-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:26:49 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-845f78c8-cf26-47b5-8de8-873a85ee98cf tempest-CinderUnicodeTest-1965377503 None] Lock "cinder-ab4d6594-b7f1-4290-a5bc-c2aac1aecac7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:26:49 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-845f78c8-cf26-47b5-8de8-873a85ee98cf tempest-CinderUnicodeTest-1965377503 None] Acquiring lock "cinder-quobyte-ab4d6594-b7f1-4290-a5bc-c2aac1aecac7" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:26:49 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-845f78c8-cf26-47b5-8de8-873a85ee98cf tempest-CinderUnicodeTest-1965377503 None] Lock "cinder-quobyte-ab4d6594-b7f1-4290-a5bc-c2aac1aecac7" acquired by "delete_volume" :: waited 0.028s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:26:49 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca0ee56-b439-452a-ae92-6a84caf1ed32]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:26:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-845f78c8-cf26-47b5-8de8-873a85ee98cf tempest-CinderUnicodeTest-1965377503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ab4d6594-b7f1-4290-a5bc-c2aac1aecac7 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:49 devstack sudo[102923]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9ab78740-18b1-42d2-9246-4d9cf5a9caa3 tempest-CinderUnicodeTest-1965377503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.376s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:49 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-9ab78740-18b1-42d2-9246-4d9cf5a9caa3 tempest-CinderUnicodeTest-1965377503 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:26:49 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-9ab78740-18b1-42d2-9246-4d9cf5a9caa3 tempest-CinderUnicodeTest-1965377503 None] Deleted volume successfully. Aug 31 15:26:49 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-9ab78740-18b1-42d2-9246-4d9cf5a9caa3 tempest-CinderUnicodeTest-1965377503 None] Lock "cinder-ec396c7c-71c6-44d9-8a13-39c14f4fc645-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:26:49 devstack sudo[102925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ab4d6594-b7f1-4290-a5bc-c2aac1aecac7 Aug 31 15:26:49 devstack sudo[102925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:49 devstack sudo[102925]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-845f78c8-cf26-47b5-8de8-873a85ee98cf tempest-CinderUnicodeTest-1965377503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ab4d6594-b7f1-4290-a5bc-c2aac1aecac7" returned: 0 in 0.495s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-845f78c8-cf26-47b5-8de8-873a85ee98cf tempest-CinderUnicodeTest-1965377503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ab4d6594-b7f1-4290-a5bc-c2aac1aecac7 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:49 devstack sudo[102931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ab4d6594-b7f1-4290-a5bc-c2aac1aecac7 Aug 31 15:26:49 devstack sudo[102931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:50 devstack sudo[102931]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-845f78c8-cf26-47b5-8de8-873a85ee98cf tempest-CinderUnicodeTest-1965377503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ab4d6594-b7f1-4290-a5bc-c2aac1aecac7" returned: 0 in 0.345s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:50 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-845f78c8-cf26-47b5-8de8-873a85ee98cf tempest-CinderUnicodeTest-1965377503 None] Lock "cinder-quobyte-ab4d6594-b7f1-4290-a5bc-c2aac1aecac7" released by "delete_volume" :: held 0.932s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:26:50 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-845f78c8-cf26-47b5-8de8-873a85ee98cf tempest-CinderUnicodeTest-1965377503 None] Created reservations ['bd81a9a7-cb45-47cb-bd43-0f0256b9e9ef', '6a86622f-6bc6-47e7-8df4-998a034d03e4', '38188e27-8321-49b9-b0ff-f93bad381ad2', '629a6844-59e3-4c76-b619-f14fcea64512'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:26:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-845f78c8-cf26-47b5-8de8-873a85ee98cf tempest-CinderUnicodeTest-1965377503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-845f78c8-cf26-47b5-8de8-873a85ee98cf tempest-CinderUnicodeTest-1965377503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:50 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-845f78c8-cf26-47b5-8de8-873a85ee98cf tempest-CinderUnicodeTest-1965377503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:26:50 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-845f78c8-cf26-47b5-8de8-873a85ee98cf tempest-CinderUnicodeTest-1965377503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:26:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-845f78c8-cf26-47b5-8de8-873a85ee98cf tempest-CinderUnicodeTest-1965377503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-845f78c8-cf26-47b5-8de8-873a85ee98cf tempest-CinderUnicodeTest-1965377503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:50 devstack sudo[103002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:26:50 devstack sudo[103002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:50 devstack sudo[103002]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-845f78c8-cf26-47b5-8de8-873a85ee98cf tempest-CinderUnicodeTest-1965377503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.527s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:50 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-845f78c8-cf26-47b5-8de8-873a85ee98cf tempest-CinderUnicodeTest-1965377503 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:26:50 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-845f78c8-cf26-47b5-8de8-873a85ee98cf tempest-CinderUnicodeTest-1965377503 None] Deleted volume successfully. Aug 31 15:26:50 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-845f78c8-cf26-47b5-8de8-873a85ee98cf tempest-CinderUnicodeTest-1965377503 None] Lock "cinder-ab4d6594-b7f1-4290-a5bc-c2aac1aecac7-delete_volume" released by "delete_volume" :: held 1.831s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:26:58 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-92ae07cb-28fc-4b1d-a3a2-39c8d601d6b3 tempest-ProjectReaderTests-1441318959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:26:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-92ae07cb-28fc-4b1d-a3a2-39c8d601d6b3 tempest-ProjectReaderTests-1441318959 None] Flow 'volume_create_manager' (d5d5ab6b-5dd0-4119-a239-02f500995a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:26:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-92ae07cb-28fc-4b1d-a3a2-39c8d601d6b3 tempest-ProjectReaderTests-1441318959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f166c021-118c-4577-a7b8-677c742ec3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-92ae07cb-28fc-4b1d-a3a2-39c8d601d6b3 tempest-ProjectReaderTests-1441318959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f166c021-118c-4577-a7b8-677c742ec3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-571028378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd8d8986-a4dc-4971-8633-48723a471d39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22baaed146a64e298eceb1e03922d002',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:26:59Z,use_quota=True,user_id='fea7bbd5884040268da8df364f2b85fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-92ae07cb-28fc-4b1d-a3a2-39c8d601d6b3 tempest-ProjectReaderTests-1441318959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f457e32-d261-4547-aeb9-fe4700e05a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-92ae07cb-28fc-4b1d-a3a2-39c8d601d6b3 tempest-ProjectReaderTests-1441318959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f457e32-d261-4547-aeb9-fe4700e05a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-92ae07cb-28fc-4b1d-a3a2-39c8d601d6b3 tempest-ProjectReaderTests-1441318959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d9980d-bd5e-4d4f-95ff-e44481ea5352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-92ae07cb-28fc-4b1d-a3a2-39c8d601d6b3 tempest-ProjectReaderTests-1441318959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d9980d-bd5e-4d4f-95ff-e44481ea5352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd8d8986-a4dc-4971-8633-48723a471d39', 'volume_name': 'volume-dd8d8986-a4dc-4971-8633-48723a471d39', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-92ae07cb-28fc-4b1d-a3a2-39c8d601d6b3 tempest-ProjectReaderTests-1441318959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f761fe5-5037-4ac2-8c1c-eeaf2e51d287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-92ae07cb-28fc-4b1d-a3a2-39c8d601d6b3 tempest-ProjectReaderTests-1441318959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f761fe5-5037-4ac2-8c1c-eeaf2e51d287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-92ae07cb-28fc-4b1d-a3a2-39c8d601d6b3 tempest-ProjectReaderTests-1441318959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f76ee009-1fa7-41d1-bbfe-ccfa1c352044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:58 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-92ae07cb-28fc-4b1d-a3a2-39c8d601d6b3 tempest-ProjectReaderTests-1441318959 None] Volume dd8d8986-a4dc-4971-8633-48723a471d39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd8d8986-a4dc-4971-8633-48723a471d39', 'volume_size': 1} Aug 31 15:26:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-92ae07cb-28fc-4b1d-a3a2-39c8d601d6b3 tempest-ProjectReaderTests-1441318959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-92ae07cb-28fc-4b1d-a3a2-39c8d601d6b3 tempest-ProjectReaderTests-1441318959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:58 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-92ae07cb-28fc-4b1d-a3a2-39c8d601d6b3 tempest-ProjectReaderTests-1441318959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-571028378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd8d8986-a4dc-4971-8633-48723a471d39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22baaed146a64e298eceb1e03922d002',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:26:59Z,use_quota=True,user_id='fea7bbd5884040268da8df364f2b85fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:26:58 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-92ae07cb-28fc-4b1d-a3a2-39c8d601d6b3 tempest-ProjectReaderTests-1441318959 None] Creating volume dd8d8986-a4dc-4971-8633-48723a471d39 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:26:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-92ae07cb-28fc-4b1d-a3a2-39c8d601d6b3 tempest-ProjectReaderTests-1441318959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:26:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-92ae07cb-28fc-4b1d-a3a2-39c8d601d6b3 tempest-ProjectReaderTests-1441318959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:26:58 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-92ae07cb-28fc-4b1d-a3a2-39c8d601d6b3 tempest-ProjectReaderTests-1441318959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:26:58 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-92ae07cb-28fc-4b1d-a3a2-39c8d601d6b3 tempest-ProjectReaderTests-1441318959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:26:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-92ae07cb-28fc-4b1d-a3a2-39c8d601d6b3 tempest-ProjectReaderTests-1441318959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:58 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-92ae07cb-28fc-4b1d-a3a2-39c8d601d6b3 tempest-ProjectReaderTests-1441318959 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:26:58 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-92ae07cb-28fc-4b1d-a3a2-39c8d601d6b3 tempest-ProjectReaderTests-1441318959 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:26:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-92ae07cb-28fc-4b1d-a3a2-39c8d601d6b3 tempest-ProjectReaderTests-1441318959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-dd8d8986-a4dc-4971-8633-48723a471d39 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:58 devstack sudo[103386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-dd8d8986-a4dc-4971-8633-48723a471d39 1073741824 Aug 31 15:26:58 devstack sudo[103386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:59 devstack sudo[103386]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-92ae07cb-28fc-4b1d-a3a2-39c8d601d6b3 tempest-ProjectReaderTests-1441318959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-dd8d8986-a4dc-4971-8633-48723a471d39 1073741824" returned: 0 in 0.655s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-92ae07cb-28fc-4b1d-a3a2-39c8d601d6b3 tempest-ProjectReaderTests-1441318959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-dd8d8986-a4dc-4971-8633-48723a471d39 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:26:59 devstack sudo[103392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-dd8d8986-a4dc-4971-8633-48723a471d39 Aug 31 15:26:59 devstack sudo[103392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:26:59 devstack sudo[103392]: pam_unix(sudo:session): session closed for user root Aug 31 15:26:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-92ae07cb-28fc-4b1d-a3a2-39c8d601d6b3 tempest-ProjectReaderTests-1441318959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-dd8d8986-a4dc-4971-8633-48723a471d39" returned: 0 in 0.320s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:26:59 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-92ae07cb-28fc-4b1d-a3a2-39c8d601d6b3 tempest-ProjectReaderTests-1441318959 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:26:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-92ae07cb-28fc-4b1d-a3a2-39c8d601d6b3 tempest-ProjectReaderTests-1441318959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:26:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-92ae07cb-28fc-4b1d-a3a2-39c8d601d6b3 tempest-ProjectReaderTests-1441318959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f76ee009-1fa7-41d1-bbfe-ccfa1c352044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd8d8986-a4dc-4971-8633-48723a471d39', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-92ae07cb-28fc-4b1d-a3a2-39c8d601d6b3 tempest-ProjectReaderTests-1441318959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8914846c-7611-4fd5-ae34-41a8e0a43d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:26:59 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-92ae07cb-28fc-4b1d-a3a2-39c8d601d6b3 tempest-ProjectReaderTests-1441318959 None] Volume volume-dd8d8986-a4dc-4971-8633-48723a471d39 (dd8d8986-a4dc-4971-8633-48723a471d39): created successfully Aug 31 15:26:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-92ae07cb-28fc-4b1d-a3a2-39c8d601d6b3 tempest-ProjectReaderTests-1441318959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8914846c-7611-4fd5-ae34-41a8e0a43d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:26:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-92ae07cb-28fc-4b1d-a3a2-39c8d601d6b3 tempest-ProjectReaderTests-1441318959 None] Flow 'volume_create_manager' (d5d5ab6b-5dd0-4119-a239-02f500995a57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:26:59 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-92ae07cb-28fc-4b1d-a3a2-39c8d601d6b3 tempest-ProjectReaderTests-1441318959 None] Created volume successfully. Aug 31 15:27:01 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-f214361d-820f-4260-ab44-f4f9348832b3 tempest-ProjectReaderTests-1441318959 None] Acquiring lock "cinder-dd8d8986-a4dc-4971-8633-48723a471d39-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:27:01 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-f214361d-820f-4260-ab44-f4f9348832b3 tempest-ProjectReaderTests-1441318959 None] Lock "cinder-dd8d8986-a4dc-4971-8633-48723a471d39-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:27:01 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-f214361d-820f-4260-ab44-f4f9348832b3 tempest-ProjectReaderTests-1441318959 None] Acquiring lock "cinder-quobyte-dd8d8986-a4dc-4971-8633-48723a471d39" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:27:01 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-f214361d-820f-4260-ab44-f4f9348832b3 tempest-ProjectReaderTests-1441318959 None] Lock "cinder-quobyte-dd8d8986-a4dc-4971-8633-48723a471d39" acquired by "delete_volume" :: waited 0.028s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:27:01 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c21878-2700-44b7-826c-c8654bde0b91]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:27:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f214361d-820f-4260-ab44-f4f9348832b3 tempest-ProjectReaderTests-1441318959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-dd8d8986-a4dc-4971-8633-48723a471d39 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:01 devstack sudo[103396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-dd8d8986-a4dc-4971-8633-48723a471d39 Aug 31 15:27:01 devstack sudo[103396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:01 devstack sudo[103396]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f214361d-820f-4260-ab44-f4f9348832b3 tempest-ProjectReaderTests-1441318959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-dd8d8986-a4dc-4971-8633-48723a471d39" returned: 0 in 0.652s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f214361d-820f-4260-ab44-f4f9348832b3 tempest-ProjectReaderTests-1441318959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-dd8d8986-a4dc-4971-8633-48723a471d39 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:01 devstack sudo[103402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-dd8d8986-a4dc-4971-8633-48723a471d39 Aug 31 15:27:01 devstack sudo[103402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:02 devstack sudo[103402]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f214361d-820f-4260-ab44-f4f9348832b3 tempest-ProjectReaderTests-1441318959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-dd8d8986-a4dc-4971-8633-48723a471d39" returned: 0 in 0.460s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:02 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-f214361d-820f-4260-ab44-f4f9348832b3 tempest-ProjectReaderTests-1441318959 None] Lock "cinder-quobyte-dd8d8986-a4dc-4971-8633-48723a471d39" released by "delete_volume" :: held 1.174s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:27:02 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-f214361d-820f-4260-ab44-f4f9348832b3 tempest-ProjectReaderTests-1441318959 None] Created reservations ['baec3395-5c3f-4777-9dda-8ea4a1e99c3e', '2c816b07-2793-4e63-adb1-88a915216aca', 'd7bf3d73-0f0f-4dbc-b4d6-e84392166e8c', 'ef8746dc-8245-44cc-9f7a-7f2b30ea71be'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:27:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f214361d-820f-4260-ab44-f4f9348832b3 tempest-ProjectReaderTests-1441318959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:27:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f214361d-820f-4260-ab44-f4f9348832b3 tempest-ProjectReaderTests-1441318959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:27:02 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f214361d-820f-4260-ab44-f4f9348832b3 tempest-ProjectReaderTests-1441318959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:27:02 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f214361d-820f-4260-ab44-f4f9348832b3 tempest-ProjectReaderTests-1441318959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:27:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f214361d-820f-4260-ab44-f4f9348832b3 tempest-ProjectReaderTests-1441318959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:27:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f214361d-820f-4260-ab44-f4f9348832b3 tempest-ProjectReaderTests-1441318959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:02 devstack sudo[103405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:27:02 devstack sudo[103405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:02 devstack sudo[103405]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f214361d-820f-4260-ab44-f4f9348832b3 tempest-ProjectReaderTests-1441318959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.319s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:02 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-f214361d-820f-4260-ab44-f4f9348832b3 tempest-ProjectReaderTests-1441318959 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:27:02 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-f214361d-820f-4260-ab44-f4f9348832b3 tempest-ProjectReaderTests-1441318959 None] Deleted volume successfully. Aug 31 15:27:02 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-f214361d-820f-4260-ab44-f4f9348832b3 tempest-ProjectReaderTests-1441318959 None] Lock "cinder-dd8d8986-a4dc-4971-8633-48723a471d39-delete_volume" released by "delete_volume" :: held 1.832s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:27:04 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6eaf1c7-d16b-4179-9dec-a430677bf230 tempest-ProjectReaderTests-1441318959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:27:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b6eaf1c7-d16b-4179-9dec-a430677bf230 tempest-ProjectReaderTests-1441318959 None] Flow 'volume_create_manager' (058a5609-db18-45aa-b486-b27d60823fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:27:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b6eaf1c7-d16b-4179-9dec-a430677bf230 tempest-ProjectReaderTests-1441318959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1011e91b-4e79-4682-ace0-b4f43cffc175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b6eaf1c7-d16b-4179-9dec-a430677bf230 tempest-ProjectReaderTests-1441318959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1011e91b-4e79-4682-ace0-b4f43cffc175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1983523550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea21edba-61fe-44ce-8528-44dc15cd16fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22baaed146a64e298eceb1e03922d002',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:27:04Z,use_quota=True,user_id='fea7bbd5884040268da8df364f2b85fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b6eaf1c7-d16b-4179-9dec-a430677bf230 tempest-ProjectReaderTests-1441318959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61203f25-7673-499c-9d76-6b138300f04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b6eaf1c7-d16b-4179-9dec-a430677bf230 tempest-ProjectReaderTests-1441318959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61203f25-7673-499c-9d76-6b138300f04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b6eaf1c7-d16b-4179-9dec-a430677bf230 tempest-ProjectReaderTests-1441318959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e24e041b-b89d-458b-8535-1cc7647b4c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b6eaf1c7-d16b-4179-9dec-a430677bf230 tempest-ProjectReaderTests-1441318959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e24e041b-b89d-458b-8535-1cc7647b4c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea21edba-61fe-44ce-8528-44dc15cd16fe', 'volume_name': 'volume-ea21edba-61fe-44ce-8528-44dc15cd16fe', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b6eaf1c7-d16b-4179-9dec-a430677bf230 tempest-ProjectReaderTests-1441318959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (793c5b78-1765-4435-b540-69dc571cbcf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b6eaf1c7-d16b-4179-9dec-a430677bf230 tempest-ProjectReaderTests-1441318959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (793c5b78-1765-4435-b540-69dc571cbcf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:04 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b6eaf1c7-d16b-4179-9dec-a430677bf230 tempest-ProjectReaderTests-1441318959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ade206e-89be-4bfe-bd05-d94cf17ab8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:04 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-b6eaf1c7-d16b-4179-9dec-a430677bf230 tempest-ProjectReaderTests-1441318959 None] Volume ea21edba-61fe-44ce-8528-44dc15cd16fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea21edba-61fe-44ce-8528-44dc15cd16fe', 'volume_size': 1} Aug 31 15:27:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b6eaf1c7-d16b-4179-9dec-a430677bf230 tempest-ProjectReaderTests-1441318959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:27:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b6eaf1c7-d16b-4179-9dec-a430677bf230 tempest-ProjectReaderTests-1441318959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:27:04 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-b6eaf1c7-d16b-4179-9dec-a430677bf230 tempest-ProjectReaderTests-1441318959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1983523550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea21edba-61fe-44ce-8528-44dc15cd16fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22baaed146a64e298eceb1e03922d002',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:27:04Z,use_quota=True,user_id='fea7bbd5884040268da8df364f2b85fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:27:04 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-b6eaf1c7-d16b-4179-9dec-a430677bf230 tempest-ProjectReaderTests-1441318959 None] Creating volume ea21edba-61fe-44ce-8528-44dc15cd16fe {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:27:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b6eaf1c7-d16b-4179-9dec-a430677bf230 tempest-ProjectReaderTests-1441318959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:27:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b6eaf1c7-d16b-4179-9dec-a430677bf230 tempest-ProjectReaderTests-1441318959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:27:04 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-b6eaf1c7-d16b-4179-9dec-a430677bf230 tempest-ProjectReaderTests-1441318959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:27:04 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-b6eaf1c7-d16b-4179-9dec-a430677bf230 tempest-ProjectReaderTests-1441318959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:27:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b6eaf1c7-d16b-4179-9dec-a430677bf230 tempest-ProjectReaderTests-1441318959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:27:04 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-b6eaf1c7-d16b-4179-9dec-a430677bf230 tempest-ProjectReaderTests-1441318959 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:27:04 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-b6eaf1c7-d16b-4179-9dec-a430677bf230 tempest-ProjectReaderTests-1441318959 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:27:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b6eaf1c7-d16b-4179-9dec-a430677bf230 tempest-ProjectReaderTests-1441318959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ea21edba-61fe-44ce-8528-44dc15cd16fe 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:04 devstack sudo[103408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ea21edba-61fe-44ce-8528-44dc15cd16fe 1073741824 Aug 31 15:27:04 devstack sudo[103408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:05 devstack sudo[103408]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b6eaf1c7-d16b-4179-9dec-a430677bf230 tempest-ProjectReaderTests-1441318959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ea21edba-61fe-44ce-8528-44dc15cd16fe 1073741824" returned: 0 in 0.769s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b6eaf1c7-d16b-4179-9dec-a430677bf230 tempest-ProjectReaderTests-1441318959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ea21edba-61fe-44ce-8528-44dc15cd16fe {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:05 devstack sudo[103414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ea21edba-61fe-44ce-8528-44dc15cd16fe Aug 31 15:27:05 devstack sudo[103414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:05 devstack sudo[103414]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b6eaf1c7-d16b-4179-9dec-a430677bf230 tempest-ProjectReaderTests-1441318959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ea21edba-61fe-44ce-8528-44dc15cd16fe" returned: 0 in 0.338s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:05 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-b6eaf1c7-d16b-4179-9dec-a430677bf230 tempest-ProjectReaderTests-1441318959 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:27:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b6eaf1c7-d16b-4179-9dec-a430677bf230 tempest-ProjectReaderTests-1441318959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:27:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b6eaf1c7-d16b-4179-9dec-a430677bf230 tempest-ProjectReaderTests-1441318959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ade206e-89be-4bfe-bd05-d94cf17ab8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea21edba-61fe-44ce-8528-44dc15cd16fe', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b6eaf1c7-d16b-4179-9dec-a430677bf230 tempest-ProjectReaderTests-1441318959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cb54c7f-1b28-4dae-a013-6209cdf7237f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:05 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-b6eaf1c7-d16b-4179-9dec-a430677bf230 tempest-ProjectReaderTests-1441318959 None] Volume volume-ea21edba-61fe-44ce-8528-44dc15cd16fe (ea21edba-61fe-44ce-8528-44dc15cd16fe): created successfully Aug 31 15:27:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b6eaf1c7-d16b-4179-9dec-a430677bf230 tempest-ProjectReaderTests-1441318959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cb54c7f-1b28-4dae-a013-6209cdf7237f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b6eaf1c7-d16b-4179-9dec-a430677bf230 tempest-ProjectReaderTests-1441318959 None] Flow 'volume_create_manager' (058a5609-db18-45aa-b486-b27d60823fb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:27:05 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-b6eaf1c7-d16b-4179-9dec-a430677bf230 tempest-ProjectReaderTests-1441318959 None] Created volume successfully. Aug 31 15:27:06 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b07d3511-530e-4fa6-beef-6f41980916d3 tempest-ProjectReaderTests-1441318959 None] Acquiring lock "cinder-ea21edba-61fe-44ce-8528-44dc15cd16fe-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:27:06 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b07d3511-530e-4fa6-beef-6f41980916d3 tempest-ProjectReaderTests-1441318959 None] Lock "cinder-ea21edba-61fe-44ce-8528-44dc15cd16fe-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:27:06 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b07d3511-530e-4fa6-beef-6f41980916d3 tempest-ProjectReaderTests-1441318959 None] Acquiring lock "cinder-quobyte-ea21edba-61fe-44ce-8528-44dc15cd16fe" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:27:06 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b07d3511-530e-4fa6-beef-6f41980916d3 tempest-ProjectReaderTests-1441318959 None] Lock "cinder-quobyte-ea21edba-61fe-44ce-8528-44dc15cd16fe" acquired by "delete_volume" :: waited 0.026s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:27:06 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d23a7a-a4d9-4da9-bda1-6d5c27fac254]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:27:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b07d3511-530e-4fa6-beef-6f41980916d3 tempest-ProjectReaderTests-1441318959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ea21edba-61fe-44ce-8528-44dc15cd16fe {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:07 devstack sudo[103417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ea21edba-61fe-44ce-8528-44dc15cd16fe Aug 31 15:27:07 devstack sudo[103417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:07 devstack sudo[103417]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b07d3511-530e-4fa6-beef-6f41980916d3 tempest-ProjectReaderTests-1441318959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ea21edba-61fe-44ce-8528-44dc15cd16fe" returned: 0 in 0.664s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b07d3511-530e-4fa6-beef-6f41980916d3 tempest-ProjectReaderTests-1441318959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ea21edba-61fe-44ce-8528-44dc15cd16fe {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:07 devstack sudo[103423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ea21edba-61fe-44ce-8528-44dc15cd16fe Aug 31 15:27:07 devstack sudo[103423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:07 devstack sudo[103423]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b07d3511-530e-4fa6-beef-6f41980916d3 tempest-ProjectReaderTests-1441318959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ea21edba-61fe-44ce-8528-44dc15cd16fe" returned: 0 in 0.353s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:07 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b07d3511-530e-4fa6-beef-6f41980916d3 tempest-ProjectReaderTests-1441318959 None] Lock "cinder-quobyte-ea21edba-61fe-44ce-8528-44dc15cd16fe" released by "delete_volume" :: held 1.080s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:27:07 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-b07d3511-530e-4fa6-beef-6f41980916d3 tempest-ProjectReaderTests-1441318959 None] Created reservations ['8032ad32-b18f-4cbe-a815-4fcdd6a21c06', 'db2702f2-18e1-49e5-899c-9ba99c49bb0a', 'ee58f906-b497-411c-8e2f-999a238b4ec9', 'c4c0c9a5-64f7-4fa2-84c9-f70dc55a9002'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:27:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b07d3511-530e-4fa6-beef-6f41980916d3 tempest-ProjectReaderTests-1441318959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:27:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b07d3511-530e-4fa6-beef-6f41980916d3 tempest-ProjectReaderTests-1441318959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:27:07 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-b07d3511-530e-4fa6-beef-6f41980916d3 tempest-ProjectReaderTests-1441318959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:27:07 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-b07d3511-530e-4fa6-beef-6f41980916d3 tempest-ProjectReaderTests-1441318959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:27:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b07d3511-530e-4fa6-beef-6f41980916d3 tempest-ProjectReaderTests-1441318959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:27:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b07d3511-530e-4fa6-beef-6f41980916d3 tempest-ProjectReaderTests-1441318959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:08 devstack sudo[103438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:27:08 devstack sudo[103438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:08 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-8530ac2f-ec48-473c-b593-fbdb59dfaeb7 tempest-VolumesSnapshotTestJSON-235515433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:27:08 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8530ac2f-ec48-473c-b593-fbdb59dfaeb7 tempest-VolumesSnapshotTestJSON-235515433 None] Flow 'volume_create_manager' (2f55876c-2f5b-4148-9350-1682c624fa4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:27:08 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8530ac2f-ec48-473c-b593-fbdb59dfaeb7 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c862c61-5241-46e3-ac4e-aa8291342f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:08 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8530ac2f-ec48-473c-b593-fbdb59dfaeb7 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c862c61-5241-46e3-ac4e-aa8291342f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-197540589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=721b0665-e589-43b6-92ac-5ea0177998a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b694ef42c364eb2a5af7af99ea6ba70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:27:08Z,use_quota=True,user_id='37612abd13cb497eaa90f73eecddcf76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:08 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8530ac2f-ec48-473c-b593-fbdb59dfaeb7 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3efe0c0-2581-478e-95de-6bfff16a8ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:08 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8530ac2f-ec48-473c-b593-fbdb59dfaeb7 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3efe0c0-2581-478e-95de-6bfff16a8ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:08 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8530ac2f-ec48-473c-b593-fbdb59dfaeb7 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12917bbb-8f5c-4783-ae72-e75729c6170d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:08 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8530ac2f-ec48-473c-b593-fbdb59dfaeb7 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12917bbb-8f5c-4783-ae72-e75729c6170d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '721b0665-e589-43b6-92ac-5ea0177998a4', 'volume_name': 'volume-721b0665-e589-43b6-92ac-5ea0177998a4', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:08 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8530ac2f-ec48-473c-b593-fbdb59dfaeb7 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7223798-769d-4bfd-aa7a-7d458b436d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:08 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8530ac2f-ec48-473c-b593-fbdb59dfaeb7 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7223798-769d-4bfd-aa7a-7d458b436d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:08 devstack sudo[103438]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:08 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8530ac2f-ec48-473c-b593-fbdb59dfaeb7 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a462c754-7f94-47ee-ab81-e2c129d11715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:08 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-8530ac2f-ec48-473c-b593-fbdb59dfaeb7 tempest-VolumesSnapshotTestJSON-235515433 None] Volume 721b0665-e589-43b6-92ac-5ea0177998a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-721b0665-e589-43b6-92ac-5ea0177998a4', 'volume_size': 1} Aug 31 15:27:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8530ac2f-ec48-473c-b593-fbdb59dfaeb7 tempest-VolumesSnapshotTestJSON-235515433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:27:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8530ac2f-ec48-473c-b593-fbdb59dfaeb7 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:27:08 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-8530ac2f-ec48-473c-b593-fbdb59dfaeb7 tempest-VolumesSnapshotTestJSON-235515433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-197540589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=721b0665-e589-43b6-92ac-5ea0177998a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b694ef42c364eb2a5af7af99ea6ba70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:27:08Z,use_quota=True,user_id='37612abd13cb497eaa90f73eecddcf76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:27:08 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-8530ac2f-ec48-473c-b593-fbdb59dfaeb7 tempest-VolumesSnapshotTestJSON-235515433 None] Creating volume 721b0665-e589-43b6-92ac-5ea0177998a4 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:27:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8530ac2f-ec48-473c-b593-fbdb59dfaeb7 tempest-VolumesSnapshotTestJSON-235515433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:27:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8530ac2f-ec48-473c-b593-fbdb59dfaeb7 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:27:08 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-8530ac2f-ec48-473c-b593-fbdb59dfaeb7 tempest-VolumesSnapshotTestJSON-235515433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:27:08 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-8530ac2f-ec48-473c-b593-fbdb59dfaeb7 tempest-VolumesSnapshotTestJSON-235515433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:27:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8530ac2f-ec48-473c-b593-fbdb59dfaeb7 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:27:08 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-8530ac2f-ec48-473c-b593-fbdb59dfaeb7 tempest-VolumesSnapshotTestJSON-235515433 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:27:08 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-8530ac2f-ec48-473c-b593-fbdb59dfaeb7 tempest-VolumesSnapshotTestJSON-235515433 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:27:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8530ac2f-ec48-473c-b593-fbdb59dfaeb7 tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b07d3511-530e-4fa6-beef-6f41980916d3 tempest-ProjectReaderTests-1441318959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.464s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:08 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-b07d3511-530e-4fa6-beef-6f41980916d3 tempest-ProjectReaderTests-1441318959 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:27:08 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-b07d3511-530e-4fa6-beef-6f41980916d3 tempest-ProjectReaderTests-1441318959 None] Deleted volume successfully. Aug 31 15:27:08 devstack sudo[103441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4 1073741824 Aug 31 15:27:08 devstack sudo[103441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:08 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b07d3511-530e-4fa6-beef-6f41980916d3 tempest-ProjectReaderTests-1441318959 None] Lock "cinder-ea21edba-61fe-44ce-8528-44dc15cd16fe-delete_volume" released by "delete_volume" :: held 1.904s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:27:08 devstack sudo[103441]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8530ac2f-ec48-473c-b593-fbdb59dfaeb7 tempest-VolumesSnapshotTestJSON-235515433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4 1073741824" returned: 0 in 0.524s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8530ac2f-ec48-473c-b593-fbdb59dfaeb7 tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:09 devstack sudo[103447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4 Aug 31 15:27:09 devstack sudo[103447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:09 devstack sudo[103447]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8530ac2f-ec48-473c-b593-fbdb59dfaeb7 tempest-VolumesSnapshotTestJSON-235515433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4" returned: 0 in 0.333s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:09 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-8530ac2f-ec48-473c-b593-fbdb59dfaeb7 tempest-VolumesSnapshotTestJSON-235515433 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:27:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8530ac2f-ec48-473c-b593-fbdb59dfaeb7 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:27:09 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8530ac2f-ec48-473c-b593-fbdb59dfaeb7 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a462c754-7f94-47ee-ab81-e2c129d11715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-721b0665-e589-43b6-92ac-5ea0177998a4', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:09 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8530ac2f-ec48-473c-b593-fbdb59dfaeb7 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e713871-f23f-4bfa-8b8e-754c826ffb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:09 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-8530ac2f-ec48-473c-b593-fbdb59dfaeb7 tempest-VolumesSnapshotTestJSON-235515433 None] Volume volume-721b0665-e589-43b6-92ac-5ea0177998a4 (721b0665-e589-43b6-92ac-5ea0177998a4): created successfully Aug 31 15:27:09 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8530ac2f-ec48-473c-b593-fbdb59dfaeb7 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e713871-f23f-4bfa-8b8e-754c826ffb46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:09 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8530ac2f-ec48-473c-b593-fbdb59dfaeb7 tempest-VolumesSnapshotTestJSON-235515433 None] Flow 'volume_create_manager' (2f55876c-2f5b-4148-9350-1682c624fa4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:27:09 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-8530ac2f-ec48-473c-b593-fbdb59dfaeb7 tempest-VolumesSnapshotTestJSON-235515433 None] Created volume successfully. Aug 31 15:27:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-d00e3abc-8a6c-4f67-80df-665608a0900e tempest-VolumesSnapshotTestJSON-235515433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:27:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-d00e3abc-8a6c-4f67-80df-665608a0900e tempest-VolumesSnapshotTestJSON-235515433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:27:10 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-d00e3abc-8a6c-4f67-80df-665608a0900e tempest-VolumesSnapshotTestJSON-235515433 None] Creating offline snapshot 9445e919-195a-4922-b762-4724f30f1dab of volume 721b0665-e589-43b6-92ac-5ea0177998a4 {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:27:10 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[30bd324a-737d-4bee-a565-b0725ca366ed]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:27:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d00e3abc-8a6c-4f67-80df-665608a0900e tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:10 devstack sudo[103475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4 Aug 31 15:27:10 devstack sudo[103475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:11 devstack sudo[103475]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d00e3abc-8a6c-4f67-80df-665608a0900e tempest-VolumesSnapshotTestJSON-235515433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4" returned: 0 in 0.480s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d00e3abc-8a6c-4f67-80df-665608a0900e tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4.9445e919-195a-4922-b762-4724f30f1dab 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:11 devstack sudo[103481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4.9445e919-195a-4922-b762-4724f30f1dab 1G Aug 31 15:27:11 devstack sudo[103481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:11 devstack sudo[103481]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d00e3abc-8a6c-4f67-80df-665608a0900e tempest-VolumesSnapshotTestJSON-235515433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4.9445e919-195a-4922-b762-4724f30f1dab 1G" returned: 0 in 0.553s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d00e3abc-8a6c-4f67-80df-665608a0900e tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-721b0665-e589-43b6-92ac-5ea0177998a4 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4.9445e919-195a-4922-b762-4724f30f1dab {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:11 devstack sudo[103489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-721b0665-e589-43b6-92ac-5ea0177998a4 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4.9445e919-195a-4922-b762-4724f30f1dab Aug 31 15:27:11 devstack sudo[103489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:12 devstack sudo[103489]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d00e3abc-8a6c-4f67-80df-665608a0900e tempest-VolumesSnapshotTestJSON-235515433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-721b0665-e589-43b6-92ac-5ea0177998a4 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4.9445e919-195a-4922-b762-4724f30f1dab" returned: 0 in 0.337s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:12 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-d00e3abc-8a6c-4f67-80df-665608a0900e tempest-VolumesSnapshotTestJSON-235515433 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4.9445e919-195a-4922-b762-4724f30f1dab is being set with open permissions: ugo+rw Aug 31 15:27:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d00e3abc-8a6c-4f67-80df-665608a0900e tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4.9445e919-195a-4922-b762-4724f30f1dab {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:12 devstack sudo[103494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4.9445e919-195a-4922-b762-4724f30f1dab Aug 31 15:27:12 devstack sudo[103494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:12 devstack sudo[103494]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d00e3abc-8a6c-4f67-80df-665608a0900e tempest-VolumesSnapshotTestJSON-235515433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4.9445e919-195a-4922-b762-4724f30f1dab" returned: 0 in 0.317s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d00e3abc-8a6c-4f67-80df-665608a0900e tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:12 devstack sudo[103497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4.info Aug 31 15:27:12 devstack sudo[103497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:12 devstack sudo[103497]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d00e3abc-8a6c-4f67-80df-665608a0900e tempest-VolumesSnapshotTestJSON-235515433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4.info" returned: 0 in 0.287s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:12 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-d00e3abc-8a6c-4f67-80df-665608a0900e tempest-VolumesSnapshotTestJSON-235515433 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4.info is being set with open permissions: ugo+rw Aug 31 15:27:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d00e3abc-8a6c-4f67-80df-665608a0900e tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:12 devstack sudo[103500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4.info Aug 31 15:27:12 devstack sudo[103500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:13 devstack sudo[103500]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d00e3abc-8a6c-4f67-80df-665608a0900e tempest-VolumesSnapshotTestJSON-235515433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4.info" returned: 0 in 0.280s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-d00e3abc-8a6c-4f67-80df-665608a0900e tempest-VolumesSnapshotTestJSON-235515433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.370s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:27:13 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-d00e3abc-8a6c-4f67-80df-665608a0900e tempest-VolumesSnapshotTestJSON-235515433 None] Create snapshot completed successfully Aug 31 15:27:14 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5d3a0d15-467e-437a-a691-200df775a4eb tempest-VolumesSnapshotTestJSON-235515433 None] Acquiring lock "cinder-9445e919-195a-4922-b762-4724f30f1dab-delete_snapshot" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:27:14 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5d3a0d15-467e-437a-a691-200df775a4eb tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-9445e919-195a-4922-b762-4724f30f1dab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:27:14 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5d3a0d15-467e-437a-a691-200df775a4eb tempest-VolumesSnapshotTestJSON-235515433 None] Acquiring lock "cinder-quobyte-721b0665-e589-43b6-92ac-5ea0177998a4" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:27:14 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5d3a0d15-467e-437a-a691-200df775a4eb tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-quobyte-721b0665-e589-43b6-92ac-5ea0177998a4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:27:14 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5d3a0d15-467e-437a-a691-200df775a4eb tempest-VolumesSnapshotTestJSON-235515433 None] Acquiring lock "cinder-quobyte-9445e919-195a-4922-b762-4724f30f1dab" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:27:14 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5d3a0d15-467e-437a-a691-200df775a4eb tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-quobyte-9445e919-195a-4922-b762-4724f30f1dab" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:27:14 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-5d3a0d15-467e-437a-a691-200df775a4eb tempest-VolumesSnapshotTestJSON-235515433 None] Deleting offline snapshot 9445e919-195a-4922-b762-4724f30f1dab of volume 721b0665-e589-43b6-92ac-5ea0177998a4 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:27:14 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-5d3a0d15-467e-437a-a691-200df775a4eb tempest-VolumesSnapshotTestJSON-235515433 None] snapshot_file for this snap is: volume-721b0665-e589-43b6-92ac-5ea0177998a4.9445e919-195a-4922-b762-4724f30f1dab {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:27:14 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82bdc29-40ce-45e9-8de9-fef49aea525c]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:27:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5d3a0d15-467e-437a-a691-200df775a4eb tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4.9445e919-195a-4922-b762-4724f30f1dab {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:14 devstack sudo[103503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4.9445e919-195a-4922-b762-4724f30f1dab Aug 31 15:27:14 devstack sudo[103503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:14 devstack sudo[103503]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5d3a0d15-467e-437a-a691-200df775a4eb tempest-VolumesSnapshotTestJSON-235515433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4.9445e919-195a-4922-b762-4724f30f1dab" returned: 0 in 0.386s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:14 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-5d3a0d15-467e-437a-a691-200df775a4eb tempest-VolumesSnapshotTestJSON-235515433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-721b0665-e589-43b6-92ac-5ea0177998a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:27:14 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2f7918-c578-4ec2-87fd-7392cfc313c1]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:27:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5d3a0d15-467e-437a-a691-200df775a4eb tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:14 devstack sudo[103508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4 Aug 31 15:27:14 devstack sudo[103508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:15 devstack sudo[103508]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5d3a0d15-467e-437a-a691-200df775a4eb tempest-VolumesSnapshotTestJSON-235515433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4" returned: 0 in 0.481s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5d3a0d15-467e-437a-a691-200df775a4eb tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4.9445e919-195a-4922-b762-4724f30f1dab {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:15 devstack sudo[103513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4.9445e919-195a-4922-b762-4724f30f1dab Aug 31 15:27:15 devstack sudo[103513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:15 devstack sudo[103513]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5d3a0d15-467e-437a-a691-200df775a4eb tempest-VolumesSnapshotTestJSON-235515433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4.9445e919-195a-4922-b762-4724f30f1dab" returned: 0 in 0.457s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5d3a0d15-467e-437a-a691-200df775a4eb tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4.9445e919-195a-4922-b762-4724f30f1dab {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:15 devstack sudo[103518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4.9445e919-195a-4922-b762-4724f30f1dab Aug 31 15:27:15 devstack sudo[103518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:15 devstack sudo[103518]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5d3a0d15-467e-437a-a691-200df775a4eb tempest-VolumesSnapshotTestJSON-235515433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4.9445e919-195a-4922-b762-4724f30f1dab" returned: 0 in 0.317s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:15 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5d3a0d15-467e-437a-a691-200df775a4eb tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-quobyte-9445e919-195a-4922-b762-4724f30f1dab" released by "_delete_snapshot" :: held 1.787s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:27:15 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5d3a0d15-467e-437a-a691-200df775a4eb tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-quobyte-721b0665-e589-43b6-92ac-5ea0177998a4" released by "delete_snapshot" :: held 1.818s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:27:16 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-5d3a0d15-467e-437a-a691-200df775a4eb tempest-VolumesSnapshotTestJSON-235515433 None] Created reservations ['dc632bc5-4bd5-49bc-9544-556357285fef', 'dcfeb267-dbfb-40b1-bd3c-885a3106f1cf', 'bbac1571-8c36-4fae-8cf9-ca0a8c05c2af', 'ef7eefe9-3d8c-47b4-bbf2-015d0c3706d7'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:27:16 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-5d3a0d15-467e-437a-a691-200df775a4eb tempest-VolumesSnapshotTestJSON-235515433 None] Delete snapshot completed successfully. Aug 31 15:27:16 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5d3a0d15-467e-437a-a691-200df775a4eb tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-9445e919-195a-4922-b762-4724f30f1dab-delete_snapshot" released by "delete_snapshot" :: held 2.078s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:27:16 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb61a200-c5a5-4242-be34-a9cbfd090e9e tempest-VolumesSnapshotTestJSON-235515433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:27:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb61a200-c5a5-4242-be34-a9cbfd090e9e tempest-VolumesSnapshotTestJSON-235515433 None] Flow 'volume_create_manager' (163c7387-e835-405e-8e94-896ac1c127a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:27:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb61a200-c5a5-4242-be34-a9cbfd090e9e tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b591cda-65fb-4b1c-bbe4-a6f9282ae55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb61a200-c5a5-4242-be34-a9cbfd090e9e tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b591cda-65fb-4b1c-bbe4-a6f9282ae55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-426633469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b694ef42c364eb2a5af7af99ea6ba70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:27:17Z,use_quota=True,user_id='37612abd13cb497eaa90f73eecddcf76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb61a200-c5a5-4242-be34-a9cbfd090e9e tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31e982e9-f8c6-45cd-ab14-cb75313d5808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb61a200-c5a5-4242-be34-a9cbfd090e9e tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31e982e9-f8c6-45cd-ab14-cb75313d5808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb61a200-c5a5-4242-be34-a9cbfd090e9e tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a2604a6-eaf7-4693-bd19-cb8e4eb6ec39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb61a200-c5a5-4242-be34-a9cbfd090e9e tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a2604a6-eaf7-4693-bd19-cb8e4eb6ec39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1', 'volume_name': 'volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb61a200-c5a5-4242-be34-a9cbfd090e9e tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2721d903-a003-4405-a954-69b1ee5a724e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb61a200-c5a5-4242-be34-a9cbfd090e9e tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2721d903-a003-4405-a954-69b1ee5a724e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb61a200-c5a5-4242-be34-a9cbfd090e9e tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29358f47-f0fa-4bbe-bac0-470ae8f50923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:17 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-eb61a200-c5a5-4242-be34-a9cbfd090e9e tempest-VolumesSnapshotTestJSON-235515433 None] Volume 1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1', 'volume_size': 1} Aug 31 15:27:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-eb61a200-c5a5-4242-be34-a9cbfd090e9e tempest-VolumesSnapshotTestJSON-235515433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:27:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-eb61a200-c5a5-4242-be34-a9cbfd090e9e tempest-VolumesSnapshotTestJSON-235515433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:27:17 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-eb61a200-c5a5-4242-be34-a9cbfd090e9e tempest-VolumesSnapshotTestJSON-235515433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-426633469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b694ef42c364eb2a5af7af99ea6ba70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:27:17Z,use_quota=True,user_id='37612abd13cb497eaa90f73eecddcf76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:27:17 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-eb61a200-c5a5-4242-be34-a9cbfd090e9e tempest-VolumesSnapshotTestJSON-235515433 None] Creating volume 1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:27:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-eb61a200-c5a5-4242-be34-a9cbfd090e9e tempest-VolumesSnapshotTestJSON-235515433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:27:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-eb61a200-c5a5-4242-be34-a9cbfd090e9e tempest-VolumesSnapshotTestJSON-235515433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:27:17 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-eb61a200-c5a5-4242-be34-a9cbfd090e9e tempest-VolumesSnapshotTestJSON-235515433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:27:17 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-eb61a200-c5a5-4242-be34-a9cbfd090e9e tempest-VolumesSnapshotTestJSON-235515433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:27:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-eb61a200-c5a5-4242-be34-a9cbfd090e9e tempest-VolumesSnapshotTestJSON-235515433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:27:17 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-eb61a200-c5a5-4242-be34-a9cbfd090e9e tempest-VolumesSnapshotTestJSON-235515433 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:27:17 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-eb61a200-c5a5-4242-be34-a9cbfd090e9e tempest-VolumesSnapshotTestJSON-235515433 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:27:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-eb61a200-c5a5-4242-be34-a9cbfd090e9e tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:17 devstack sudo[103521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1 1073741824 Aug 31 15:27:17 devstack sudo[103521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:17 devstack sudo[103521]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-eb61a200-c5a5-4242-be34-a9cbfd090e9e tempest-VolumesSnapshotTestJSON-235515433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1 1073741824" returned: 0 in 0.537s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-eb61a200-c5a5-4242-be34-a9cbfd090e9e tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:17 devstack sudo[103527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1 Aug 31 15:27:17 devstack sudo[103527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:17 devstack sudo[103527]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-eb61a200-c5a5-4242-be34-a9cbfd090e9e tempest-VolumesSnapshotTestJSON-235515433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1" returned: 0 in 0.313s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:17 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-eb61a200-c5a5-4242-be34-a9cbfd090e9e tempest-VolumesSnapshotTestJSON-235515433 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:27:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-eb61a200-c5a5-4242-be34-a9cbfd090e9e tempest-VolumesSnapshotTestJSON-235515433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:27:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb61a200-c5a5-4242-be34-a9cbfd090e9e tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29358f47-f0fa-4bbe-bac0-470ae8f50923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb61a200-c5a5-4242-be34-a9cbfd090e9e tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30d3bffb-4333-4454-b266-f404f739c8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:17 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-eb61a200-c5a5-4242-be34-a9cbfd090e9e tempest-VolumesSnapshotTestJSON-235515433 None] Volume volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1 (1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1): created successfully Aug 31 15:27:18 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb61a200-c5a5-4242-be34-a9cbfd090e9e tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30d3bffb-4333-4454-b266-f404f739c8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:18 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-eb61a200-c5a5-4242-be34-a9cbfd090e9e tempest-VolumesSnapshotTestJSON-235515433 None] Flow 'volume_create_manager' (163c7387-e835-405e-8e94-896ac1c127a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:27:18 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-eb61a200-c5a5-4242-be34-a9cbfd090e9e tempest-VolumesSnapshotTestJSON-235515433 None] Created volume successfully. Aug 31 15:27:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1d62afef-584b-4e22-aed7-14af1d61765e tempest-VolumesSnapshotTestJSON-235515433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:27:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1d62afef-584b-4e22-aed7-14af1d61765e tempest-VolumesSnapshotTestJSON-235515433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:27:19 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-1d62afef-584b-4e22-aed7-14af1d61765e tempest-VolumesSnapshotTestJSON-235515433 None] Creating offline snapshot fc039a7a-32fb-45b6-88c6-ef0ffaa49606 of volume 1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1 {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:27:19 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee26a9e-e20c-4ecc-ad23-049388573d0b]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:27:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1d62afef-584b-4e22-aed7-14af1d61765e tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:19 devstack sudo[103533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1 Aug 31 15:27:19 devstack sudo[103533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:19 devstack sudo[103533]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1d62afef-584b-4e22-aed7-14af1d61765e tempest-VolumesSnapshotTestJSON-235515433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1" returned: 0 in 0.427s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1d62afef-584b-4e22-aed7-14af1d61765e tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1.fc039a7a-32fb-45b6-88c6-ef0ffaa49606 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:19 devstack sudo[103540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1.fc039a7a-32fb-45b6-88c6-ef0ffaa49606 1G Aug 31 15:27:19 devstack sudo[103540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:20 devstack sudo[103540]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1d62afef-584b-4e22-aed7-14af1d61765e tempest-VolumesSnapshotTestJSON-235515433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1.fc039a7a-32fb-45b6-88c6-ef0ffaa49606 1G" returned: 0 in 0.475s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1d62afef-584b-4e22-aed7-14af1d61765e tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1.fc039a7a-32fb-45b6-88c6-ef0ffaa49606 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:20 devstack sudo[103548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1.fc039a7a-32fb-45b6-88c6-ef0ffaa49606 Aug 31 15:27:20 devstack sudo[103548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:20 devstack sudo[103548]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1d62afef-584b-4e22-aed7-14af1d61765e tempest-VolumesSnapshotTestJSON-235515433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1.fc039a7a-32fb-45b6-88c6-ef0ffaa49606" returned: 0 in 0.404s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:20 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-1d62afef-584b-4e22-aed7-14af1d61765e tempest-VolumesSnapshotTestJSON-235515433 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1.fc039a7a-32fb-45b6-88c6-ef0ffaa49606 is being set with open permissions: ugo+rw Aug 31 15:27:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1d62afef-584b-4e22-aed7-14af1d61765e tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1.fc039a7a-32fb-45b6-88c6-ef0ffaa49606 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:20 devstack sudo[103555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1.fc039a7a-32fb-45b6-88c6-ef0ffaa49606 Aug 31 15:27:20 devstack sudo[103555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:20 devstack sudo[103555]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1d62afef-584b-4e22-aed7-14af1d61765e tempest-VolumesSnapshotTestJSON-235515433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1.fc039a7a-32fb-45b6-88c6-ef0ffaa49606" returned: 0 in 0.315s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1d62afef-584b-4e22-aed7-14af1d61765e tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:20 devstack sudo[103562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1.info Aug 31 15:27:20 devstack sudo[103562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:21 devstack sudo[103562]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1d62afef-584b-4e22-aed7-14af1d61765e tempest-VolumesSnapshotTestJSON-235515433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1.info" returned: 0 in 0.450s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:21 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-1d62afef-584b-4e22-aed7-14af1d61765e tempest-VolumesSnapshotTestJSON-235515433 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1.info is being set with open permissions: ugo+rw Aug 31 15:27:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1d62afef-584b-4e22-aed7-14af1d61765e tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:21 devstack sudo[103582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1.info Aug 31 15:27:21 devstack sudo[103582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:21 devstack sudo[103582]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1d62afef-584b-4e22-aed7-14af1d61765e tempest-VolumesSnapshotTestJSON-235515433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1.info" returned: 0 in 0.274s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1d62afef-584b-4e22-aed7-14af1d61765e tempest-VolumesSnapshotTestJSON-235515433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.487s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:27:21 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:INSERT=44,cinder:UPDATE=157,cinder:SELECT=115,cinder:DELETE=13 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:27:21 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-1d62afef-584b-4e22-aed7-14af1d61765e tempest-VolumesSnapshotTestJSON-235515433 None] Create snapshot completed successfully Aug 31 15:27:23 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-74292d65-3085-4987-ab1d-ef4f50d82727 req-a963b72a-a04b-4513-ae94-975ccad3d3f4 tempest-TestShelveInstance-784750763 None] Terminate volume connection completed successfully. Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-74292d65-3085-4987-ab1d-ef4f50d82727 req-a963b72a-a04b-4513-ae94-975ccad3d3f4 tempest-TestShelveInstance-784750763 None] Deleting attachment 05fb0104-97d4-4fab-8ac5-65008e9ff27d. {{(pid=86000) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG cinder.coordination [req-74292d65-3085-4987-ab1d-ef4f50d82727 req-8dd9688c-ffe4-4342-9441-90266a12abd9 tempest-TestShelveInstance-784750763 None] Acquiring lock "cinder-377b42d6-0086-4561-a536-34876380339c-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG cinder.coordination [req-74292d65-3085-4987-ab1d-ef4f50d82727 req-8dd9688c-ffe4-4342-9441-90266a12abd9 tempest-TestShelveInstance-784750763 None] Lock "cinder-377b42d6-0086-4561-a536-34876380339c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Flow 'volume_create_manager' (6bb1b12f-6518-4ff5-b872-ea3a45de5eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d1b1c79-e407-45c8-bbde-910f276e4078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d1b1c79-e407-45c8-bbde-910f276e4078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-845282514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae54a453-24d1-4f8a-9c8c-cae8b322497d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b694ef42c364eb2a5af7af99ea6ba70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:27:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=fc039a7a-32fb-45b6-88c6-ef0ffaa49606,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:27:23Z,use_quota=True,user_id='37612abd13cb497eaa90f73eecddcf76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86173a64-4efc-4611-a520-30220bab4f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86173a64-4efc-4611-a520-30220bab4f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2770d61-1d40-401c-b8b3-cc1209417b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2770d61-1d40-401c-b8b3-cc1209417b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ae54a453-24d1-4f8a-9c8c-cae8b322497d', 'volume_name': 'volume-ae54a453-24d1-4f8a-9c8c-cae8b322497d', 'volume_size': 2, 'snapshot_id': 'fc039a7a-32fb-45b6-88c6-ef0ffaa49606'}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5891ae91-e1df-4a19-a23b-2210cf189759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5891ae91-e1df-4a19-a23b-2210cf189759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94fbc3c1-17bd-497c-8131-b121dc71f1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:23 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Volume ae54a453-24d1-4f8a-9c8c-cae8b322497d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ae54a453-24d1-4f8a-9c8c-cae8b322497d', 'volume_size': 2, 'snapshot_id': 'fc039a7a-32fb-45b6-88c6-ef0ffaa49606'} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG cinder.coordination [req-74292d65-3085-4987-ab1d-ef4f50d82727 req-8dd9688c-ffe4-4342-9441-90266a12abd9 tempest-TestShelveInstance-784750763 None] Acquiring lock "cinder-quobyte-377b42d6-0086-4561-a536-34876380339c" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Acquiring lock "cinder-quobyte-fc039a7a-32fb-45b6-88c6-ef0ffaa49606-ae54a453-24d1-4f8a-9c8c-cae8b322497d" by "_create_volume_from_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-quobyte-fc039a7a-32fb-45b6-88c6-ef0ffaa49606-ae54a453-24d1-4f8a-9c8c-cae8b322497d" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Creating volume ae54a453-24d1-4f8a-9c8c-cae8b322497d from snapshot fc039a7a-32fb-45b6-88c6-ef0ffaa49606 {{(pid=86000) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Acquiring lock "cinder-quobyte-ae54a453-24d1-4f8a-9c8c-cae8b322497d" by "_copy_volume_from_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG cinder.coordination [req-74292d65-3085-4987-ab1d-ef4f50d82727 req-8dd9688c-ffe4-4342-9441-90266a12abd9 tempest-TestShelveInstance-784750763 None] Lock "cinder-quobyte-377b42d6-0086-4561-a536-34876380339c" acquired by "delete_volume" :: waited 0.060s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54d1551-0c6b-44b1-aeb2-2483f26d20e2]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-74292d65-3085-4987-ab1d-ef4f50d82727 req-8dd9688c-ffe4-4342-9441-90266a12abd9 tempest-TestShelveInstance-784750763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-377b42d6-0086-4561-a536-34876380339c {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-quobyte-ae54a453-24d1-4f8a-9c8c-cae8b322497d" acquired by "_copy_volume_from_snapshot" :: waited 0.058s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] snapshot: fc039a7a-32fb-45b6-88c6-ef0ffaa49606, volume: ae54a453-24d1-4f8a-9c8c-cae8b322497d, {{(pid=86000) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce39147-8952-4f71-92c0-56da32ee333d]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1.fc039a7a-32fb-45b6-88c6-ef0ffaa49606 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:23 devstack sudo[103590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-377b42d6-0086-4561-a536-34876380339c Aug 31 15:27:23 devstack sudo[103590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1ee0841-8dcc-4192-8713-be3867594413 tempest-SnapshotDependencyTests-389309808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f1ee0841-8dcc-4192-8713-be3867594413 tempest-SnapshotDependencyTests-389309808 None] Flow 'volume_create_manager' (3b097657-b1b7-46e3-9be9-d455009db840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f1ee0841-8dcc-4192-8713-be3867594413 tempest-SnapshotDependencyTests-389309808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d58aec31-cb27-4a93-9af6-f13d7eab4191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:23 devstack sudo[103591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1.fc039a7a-32fb-45b6-88c6-ef0ffaa49606 Aug 31 15:27:23 devstack sudo[103591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f1ee0841-8dcc-4192-8713-be3867594413 tempest-SnapshotDependencyTests-389309808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d58aec31-cb27-4a93-9af6-f13d7eab4191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1883663136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c4b579b-5fc0-4f30-8307-f909d4a9d51a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00035926d9134dffb00a7cf9f1d69b46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:27:24Z,use_quota=True,user_id='7c1e983f85b74355bc220077faed1fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f1ee0841-8dcc-4192-8713-be3867594413 tempest-SnapshotDependencyTests-389309808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa6794b3-87d9-4fb8-8b13-1f98541c8426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f1ee0841-8dcc-4192-8713-be3867594413 tempest-SnapshotDependencyTests-389309808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa6794b3-87d9-4fb8-8b13-1f98541c8426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f1ee0841-8dcc-4192-8713-be3867594413 tempest-SnapshotDependencyTests-389309808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae0b6359-5f78-440f-a5f3-0040ee853cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f1ee0841-8dcc-4192-8713-be3867594413 tempest-SnapshotDependencyTests-389309808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae0b6359-5f78-440f-a5f3-0040ee853cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c4b579b-5fc0-4f30-8307-f909d4a9d51a', 'volume_name': 'volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f1ee0841-8dcc-4192-8713-be3867594413 tempest-SnapshotDependencyTests-389309808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dd78309-c3b8-401d-9c28-0f0cf76e1103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f1ee0841-8dcc-4192-8713-be3867594413 tempest-SnapshotDependencyTests-389309808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dd78309-c3b8-401d-9c28-0f0cf76e1103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f1ee0841-8dcc-4192-8713-be3867594413 tempest-SnapshotDependencyTests-389309808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d4f8eef-2338-4638-bd57-89e3a79545ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:23 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-f1ee0841-8dcc-4192-8713-be3867594413 tempest-SnapshotDependencyTests-389309808 None] Volume 7c4b579b-5fc0-4f30-8307-f909d4a9d51a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a', 'volume_size': 1} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f1ee0841-8dcc-4192-8713-be3867594413 tempest-SnapshotDependencyTests-389309808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:27:23 devstack sudo[103590]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-74292d65-3085-4987-ab1d-ef4f50d82727 req-8dd9688c-ffe4-4342-9441-90266a12abd9 tempest-TestShelveInstance-784750763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-377b42d6-0086-4561-a536-34876380339c" returned: 0 in 0.481s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-74292d65-3085-4987-ab1d-ef4f50d82727 req-8dd9688c-ffe4-4342-9441-90266a12abd9 tempest-TestShelveInstance-784750763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-377b42d6-0086-4561-a536-34876380339c {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:24 devstack sudo[103591]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1.fc039a7a-32fb-45b6-88c6-ef0ffaa49606" returned: 0 in 0.434s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:24 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:27:24 devstack sudo[103600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-377b42d6-0086-4561-a536-34876380339c Aug 31 15:27:24 devstack sudo[103600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:24 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf37c94f-dcc8-4be7-8775-024bf56608bc]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:27:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:24 devstack sudo[103602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1 Aug 31 15:27:24 devstack sudo[103602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:24 devstack sudo[103600]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-74292d65-3085-4987-ab1d-ef4f50d82727 req-8dd9688c-ffe4-4342-9441-90266a12abd9 tempest-TestShelveInstance-784750763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-377b42d6-0086-4561-a536-34876380339c" returned: 0 in 0.276s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:24 devstack cinder-volume[86000]: DEBUG cinder.coordination [req-74292d65-3085-4987-ab1d-ef4f50d82727 req-8dd9688c-ffe4-4342-9441-90266a12abd9 tempest-TestShelveInstance-784750763 None] Lock "cinder-quobyte-377b42d6-0086-4561-a536-34876380339c" released by "delete_volume" :: held 0.810s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:27:24 devstack cinder-volume[86000]: DEBUG cinder.quota [req-74292d65-3085-4987-ab1d-ef4f50d82727 req-8dd9688c-ffe4-4342-9441-90266a12abd9 tempest-TestShelveInstance-784750763 None] Created reservations ['5b1e9a00-191e-49cd-adf0-b71fcb0857e4', 'be6b1836-ee3e-4fba-87d6-c73bb387a977', 'e97e7c2c-7394-4ae7-88d3-f6e92cde6fcc', '6d61eea0-a2a3-49af-aeaf-d5d41ed61199'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:27:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-74292d65-3085-4987-ab1d-ef4f50d82727 req-8dd9688c-ffe4-4342-9441-90266a12abd9 tempest-TestShelveInstance-784750763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:27:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-74292d65-3085-4987-ab1d-ef4f50d82727 req-8dd9688c-ffe4-4342-9441-90266a12abd9 tempest-TestShelveInstance-784750763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:27:24 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [req-74292d65-3085-4987-ab1d-ef4f50d82727 req-8dd9688c-ffe4-4342-9441-90266a12abd9 tempest-TestShelveInstance-784750763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:27:24 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [req-74292d65-3085-4987-ab1d-ef4f50d82727 req-8dd9688c-ffe4-4342-9441-90266a12abd9 tempest-TestShelveInstance-784750763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:27:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-74292d65-3085-4987-ab1d-ef4f50d82727 req-8dd9688c-ffe4-4342-9441-90266a12abd9 tempest-TestShelveInstance-784750763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:27:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-74292d65-3085-4987-ab1d-ef4f50d82727 req-8dd9688c-ffe4-4342-9441-90266a12abd9 tempest-TestShelveInstance-784750763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:24 devstack sudo[103602]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1" returned: 0 in 0.401s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:24 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1 {{(pid=86000) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 31 15:27:24 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Creating direct copy from snapshot {{(pid=86000) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 31 15:27:24 devstack cinder-volume[86000]: DEBUG cinder.utils [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Path /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ae54a453-24d1-4f8a-9c8c-cae8b322497d not found in is_blk_device check {{(pid=86000) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 31 15:27:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ae54a453-24d1-4f8a-9c8c-cae8b322497d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:24 devstack sudo[103609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:27:24 devstack sudo[103609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:24 devstack sudo[103611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ae54a453-24d1-4f8a-9c8c-cae8b322497d Aug 31 15:27:24 devstack sudo[103611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:24 devstack sudo[103609]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [req-74292d65-3085-4987-ab1d-ef4f50d82727 req-8dd9688c-ffe4-4342-9441-90266a12abd9 tempest-TestShelveInstance-784750763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.264s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:24 devstack cinder-volume[86000]: DEBUG cinder.manager [req-74292d65-3085-4987-ab1d-ef4f50d82727 req-8dd9688c-ffe4-4342-9441-90266a12abd9 tempest-TestShelveInstance-784750763 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:27:24 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-74292d65-3085-4987-ab1d-ef4f50d82727 req-8dd9688c-ffe4-4342-9441-90266a12abd9 tempest-TestShelveInstance-784750763 None] Deleted volume successfully. Aug 31 15:27:24 devstack cinder-volume[86000]: DEBUG cinder.coordination [req-74292d65-3085-4987-ab1d-ef4f50d82727 req-8dd9688c-ffe4-4342-9441-90266a12abd9 tempest-TestShelveInstance-784750763 None] Lock "cinder-377b42d6-0086-4561-a536-34876380339c-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:27:29 devstack sudo[103611]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ae54a453-24d1-4f8a-9c8c-cae8b322497d" returned: 0 in 4.997s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:29 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1, size 1024.00 MB, duration 5.00 sec, destination /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ae54a453-24d1-4f8a-9c8c-cae8b322497d {{(pid=86000) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 31 15:27:29 devstack cinder-volume[86000]: INFO cinder.image.image_utils [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Converted 1024.00 MB image at 204.88 MB/s Aug 31 15:27:29 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ae54a453-24d1-4f8a-9c8c-cae8b322497d is being set with open permissions: ugo+rw Aug 31 15:27:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ae54a453-24d1-4f8a-9c8c-cae8b322497d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:29 devstack sudo[103663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ae54a453-24d1-4f8a-9c8c-cae8b322497d Aug 31 15:27:29 devstack sudo[103663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:29 devstack sudo[103663]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ae54a453-24d1-4f8a-9c8c-cae8b322497d" returned: 0 in 0.282s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:29 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-quobyte-ae54a453-24d1-4f8a-9c8c-cae8b322497d" released by "_copy_volume_from_snapshot" :: held 6.207s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:27:29 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:SELECT=118,cinder:INSERT=24,cinder:UPDATE=129,cinder:DELETE=12 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:27:29 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-quobyte-fc039a7a-32fb-45b6-88c6-ef0ffaa49606-ae54a453-24d1-4f8a-9c8c-cae8b322497d" released by "_create_volume_from_snapshot" :: held 6.326s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:27:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.362s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:27:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f1ee0841-8dcc-4192-8713-be3867594413 tempest-SnapshotDependencyTests-389309808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.036s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:27:29 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f1ee0841-8dcc-4192-8713-be3867594413 tempest-SnapshotDependencyTests-389309808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1883663136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c4b579b-5fc0-4f30-8307-f909d4a9d51a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00035926d9134dffb00a7cf9f1d69b46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:27:24Z,use_quota=True,user_id='7c1e983f85b74355bc220077faed1fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:27:29 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-f1ee0841-8dcc-4192-8713-be3867594413 tempest-SnapshotDependencyTests-389309808 None] Creating volume 7c4b579b-5fc0-4f30-8307-f909d4a9d51a {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:27:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f1ee0841-8dcc-4192-8713-be3867594413 tempest-SnapshotDependencyTests-389309808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:27:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f1ee0841-8dcc-4192-8713-be3867594413 tempest-SnapshotDependencyTests-389309808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:27:29 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f1ee0841-8dcc-4192-8713-be3867594413 tempest-SnapshotDependencyTests-389309808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:27:29 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f1ee0841-8dcc-4192-8713-be3867594413 tempest-SnapshotDependencyTests-389309808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:27:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f1ee0841-8dcc-4192-8713-be3867594413 tempest-SnapshotDependencyTests-389309808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:27:29 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f1ee0841-8dcc-4192-8713-be3867594413 tempest-SnapshotDependencyTests-389309808 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:27:29 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-f1ee0841-8dcc-4192-8713-be3867594413 tempest-SnapshotDependencyTests-389309808 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:27:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f1ee0841-8dcc-4192-8713-be3867594413 tempest-SnapshotDependencyTests-389309808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:29 devstack sudo[103667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a 1073741824 Aug 31 15:27:29 devstack sudo[103667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94fbc3c1-17bd-497c-8131-b121dc71f1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae54a453-24d1-4f8a-9c8c-cae8b322497d', 'volume_size': 2, 'snapshot_id': 'fc039a7a-32fb-45b6-88c6-ef0ffaa49606'}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53659e7c-9000-4df0-99c9-d0a17467e40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:29 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Volume volume-ae54a453-24d1-4f8a-9c8c-cae8b322497d (ae54a453-24d1-4f8a-9c8c-cae8b322497d): created successfully Aug 31 15:27:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53659e7c-9000-4df0-99c9-d0a17467e40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:29 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Flow 'volume_create_manager' (6bb1b12f-6518-4ff5-b872-ea3a45de5eaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:27:29 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-5877164a-91d3-4e98-b178-97cc99adcd81 tempest-VolumesSnapshotTestJSON-235515433 None] Created volume successfully. Aug 31 15:27:30 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e31ab99c-d084-46c2-a984-0b2fed338eb1 tempest-VolumesSnapshotTestJSON-235515433 None] Acquiring lock "cinder-ae54a453-24d1-4f8a-9c8c-cae8b322497d-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:27:30 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e31ab99c-d084-46c2-a984-0b2fed338eb1 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-ae54a453-24d1-4f8a-9c8c-cae8b322497d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:27:30 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e31ab99c-d084-46c2-a984-0b2fed338eb1 tempest-VolumesSnapshotTestJSON-235515433 None] Acquiring lock "cinder-quobyte-ae54a453-24d1-4f8a-9c8c-cae8b322497d" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:27:30 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e31ab99c-d084-46c2-a984-0b2fed338eb1 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-quobyte-ae54a453-24d1-4f8a-9c8c-cae8b322497d" acquired by "delete_volume" :: waited 0.023s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:27:30 devstack sudo[103667]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f1ee0841-8dcc-4192-8713-be3867594413 tempest-SnapshotDependencyTests-389309808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a 1073741824" returned: 0 in 0.494s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:30 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f622614c-bec9-4da7-9c60-5b2b848ac6b1]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:27:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e31ab99c-d084-46c2-a984-0b2fed338eb1 tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ae54a453-24d1-4f8a-9c8c-cae8b322497d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f1ee0841-8dcc-4192-8713-be3867594413 tempest-SnapshotDependencyTests-389309808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:30 devstack sudo[103674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a Aug 31 15:27:30 devstack sudo[103674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:30 devstack sudo[103673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ae54a453-24d1-4f8a-9c8c-cae8b322497d Aug 31 15:27:30 devstack sudo[103673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:30 devstack sudo[103674]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f1ee0841-8dcc-4192-8713-be3867594413 tempest-SnapshotDependencyTests-389309808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a" returned: 0 in 0.252s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:30 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f1ee0841-8dcc-4192-8713-be3867594413 tempest-SnapshotDependencyTests-389309808 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:27:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f1ee0841-8dcc-4192-8713-be3867594413 tempest-SnapshotDependencyTests-389309808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:27:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f1ee0841-8dcc-4192-8713-be3867594413 tempest-SnapshotDependencyTests-389309808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d4f8eef-2338-4638-bd57-89e3a79545ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f1ee0841-8dcc-4192-8713-be3867594413 tempest-SnapshotDependencyTests-389309808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b78ffd1c-d80e-4283-b74b-e527a04b0764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:30 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-f1ee0841-8dcc-4192-8713-be3867594413 tempest-SnapshotDependencyTests-389309808 None] Volume volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a (7c4b579b-5fc0-4f30-8307-f909d4a9d51a): created successfully Aug 31 15:27:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f1ee0841-8dcc-4192-8713-be3867594413 tempest-SnapshotDependencyTests-389309808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b78ffd1c-d80e-4283-b74b-e527a04b0764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f1ee0841-8dcc-4192-8713-be3867594413 tempest-SnapshotDependencyTests-389309808 None] Flow 'volume_create_manager' (3b097657-b1b7-46e3-9be9-d455009db840) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:27:30 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-f1ee0841-8dcc-4192-8713-be3867594413 tempest-SnapshotDependencyTests-389309808 None] Created volume successfully. Aug 31 15:27:30 devstack sudo[103673]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e31ab99c-d084-46c2-a984-0b2fed338eb1 tempest-VolumesSnapshotTestJSON-235515433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ae54a453-24d1-4f8a-9c8c-cae8b322497d" returned: 0 in 0.381s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e31ab99c-d084-46c2-a984-0b2fed338eb1 tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ae54a453-24d1-4f8a-9c8c-cae8b322497d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:30 devstack sudo[103681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ae54a453-24d1-4f8a-9c8c-cae8b322497d Aug 31 15:27:30 devstack sudo[103681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:30 devstack sudo[103681]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e31ab99c-d084-46c2-a984-0b2fed338eb1 tempest-VolumesSnapshotTestJSON-235515433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ae54a453-24d1-4f8a-9c8c-cae8b322497d" returned: 0 in 0.251s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:30 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e31ab99c-d084-46c2-a984-0b2fed338eb1 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-quobyte-ae54a453-24d1-4f8a-9c8c-cae8b322497d" released by "delete_volume" :: held 0.681s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:27:30 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-e31ab99c-d084-46c2-a984-0b2fed338eb1 tempest-VolumesSnapshotTestJSON-235515433 None] Created reservations ['029526eb-c5c3-49c6-a396-92f735a1e021', '9579ff4e-01f9-4fb9-a7ab-f44d35bdac29', '70b831f1-ea05-428e-a830-7cdd66557409', '7b4bb925-c214-4fd1-99ec-703a89acc71c'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:27:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e31ab99c-d084-46c2-a984-0b2fed338eb1 tempest-VolumesSnapshotTestJSON-235515433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:27:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e31ab99c-d084-46c2-a984-0b2fed338eb1 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:27:31 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-e31ab99c-d084-46c2-a984-0b2fed338eb1 tempest-VolumesSnapshotTestJSON-235515433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:27:31 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-e31ab99c-d084-46c2-a984-0b2fed338eb1 tempest-VolumesSnapshotTestJSON-235515433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:27:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e31ab99c-d084-46c2-a984-0b2fed338eb1 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:27:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e31ab99c-d084-46c2-a984-0b2fed338eb1 tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:31 devstack sudo[103684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:27:31 devstack sudo[103684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:31 devstack sudo[103684]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e31ab99c-d084-46c2-a984-0b2fed338eb1 tempest-VolumesSnapshotTestJSON-235515433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.304s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:31 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-e31ab99c-d084-46c2-a984-0b2fed338eb1 tempest-VolumesSnapshotTestJSON-235515433 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:27:31 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-e31ab99c-d084-46c2-a984-0b2fed338eb1 tempest-VolumesSnapshotTestJSON-235515433 None] Deleted volume successfully. Aug 31 15:27:31 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e31ab99c-d084-46c2-a984-0b2fed338eb1 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-ae54a453-24d1-4f8a-9c8c-cae8b322497d-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:27:31 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-abb6e6b7-db89-44b1-904b-202032b1edc8 tempest-VolumesSnapshotTestJSON-235515433 None] Acquiring lock "cinder-fc039a7a-32fb-45b6-88c6-ef0ffaa49606-delete_snapshot" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:27:31 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-abb6e6b7-db89-44b1-904b-202032b1edc8 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-fc039a7a-32fb-45b6-88c6-ef0ffaa49606-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:27:31 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-abb6e6b7-db89-44b1-904b-202032b1edc8 tempest-VolumesSnapshotTestJSON-235515433 None] Acquiring lock "cinder-quobyte-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:27:31 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-abb6e6b7-db89-44b1-904b-202032b1edc8 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-quobyte-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:27:31 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-abb6e6b7-db89-44b1-904b-202032b1edc8 tempest-VolumesSnapshotTestJSON-235515433 None] Acquiring lock "cinder-quobyte-fc039a7a-32fb-45b6-88c6-ef0ffaa49606" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:27:31 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-abb6e6b7-db89-44b1-904b-202032b1edc8 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-quobyte-fc039a7a-32fb-45b6-88c6-ef0ffaa49606" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:27:31 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-abb6e6b7-db89-44b1-904b-202032b1edc8 tempest-VolumesSnapshotTestJSON-235515433 None] Deleting offline snapshot fc039a7a-32fb-45b6-88c6-ef0ffaa49606 of volume 1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:27:31 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-abb6e6b7-db89-44b1-904b-202032b1edc8 tempest-VolumesSnapshotTestJSON-235515433 None] snapshot_file for this snap is: volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1.fc039a7a-32fb-45b6-88c6-ef0ffaa49606 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:27:31 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce1f9a3-aa28-4f32-a8a1-5e073b90e635]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:27:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-abb6e6b7-db89-44b1-904b-202032b1edc8 tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1.fc039a7a-32fb-45b6-88c6-ef0ffaa49606 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:31 devstack sudo[103687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1.fc039a7a-32fb-45b6-88c6-ef0ffaa49606 Aug 31 15:27:31 devstack sudo[103687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-de92b021-916b-48fc-83cf-cfd3d6eb0d9a tempest-SnapshotDependencyTests-389309808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:27:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-de92b021-916b-48fc-83cf-cfd3d6eb0d9a tempest-SnapshotDependencyTests-389309808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:27:31 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-de92b021-916b-48fc-83cf-cfd3d6eb0d9a tempest-SnapshotDependencyTests-389309808 None] Creating offline snapshot c2bfc764-74f1-477d-a93e-ee72464ec0c4 of volume 7c4b579b-5fc0-4f30-8307-f909d4a9d51a {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:27:31 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb91dd5-526e-4125-84cb-6ba85a7692dd]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:27:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-de92b021-916b-48fc-83cf-cfd3d6eb0d9a tempest-SnapshotDependencyTests-389309808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:31 devstack sudo[103689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a Aug 31 15:27:31 devstack sudo[103689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:31 devstack sudo[103687]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-abb6e6b7-db89-44b1-904b-202032b1edc8 tempest-VolumesSnapshotTestJSON-235515433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1.fc039a7a-32fb-45b6-88c6-ef0ffaa49606" returned: 0 in 0.393s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:31 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-abb6e6b7-db89-44b1-904b-202032b1edc8 tempest-VolumesSnapshotTestJSON-235515433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:27:31 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04211e6-f59d-417a-a127-8400ef68e01d]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:27:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-abb6e6b7-db89-44b1-904b-202032b1edc8 tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:32 devstack sudo[103689]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-de92b021-916b-48fc-83cf-cfd3d6eb0d9a tempest-SnapshotDependencyTests-389309808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a" returned: 0 in 0.360s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-de92b021-916b-48fc-83cf-cfd3d6eb0d9a tempest-SnapshotDependencyTests-389309808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a.c2bfc764-74f1-477d-a93e-ee72464ec0c4 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:32 devstack sudo[103694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1 Aug 31 15:27:32 devstack sudo[103694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:32 devstack sudo[103699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a.c2bfc764-74f1-477d-a93e-ee72464ec0c4 1G Aug 31 15:27:32 devstack sudo[103699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:32 devstack sudo[103699]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-de92b021-916b-48fc-83cf-cfd3d6eb0d9a tempest-SnapshotDependencyTests-389309808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a.c2bfc764-74f1-477d-a93e-ee72464ec0c4 1G" returned: 0 in 0.521s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-de92b021-916b-48fc-83cf-cfd3d6eb0d9a tempest-SnapshotDependencyTests-389309808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a.c2bfc764-74f1-477d-a93e-ee72464ec0c4 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:32 devstack sudo[103694]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-abb6e6b7-db89-44b1-904b-202032b1edc8 tempest-VolumesSnapshotTestJSON-235515433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1" returned: 0 in 0.649s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-abb6e6b7-db89-44b1-904b-202032b1edc8 tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1.fc039a7a-32fb-45b6-88c6-ef0ffaa49606 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:32 devstack sudo[103708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a.c2bfc764-74f1-477d-a93e-ee72464ec0c4 Aug 31 15:27:32 devstack sudo[103708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:32 devstack sudo[103709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1.fc039a7a-32fb-45b6-88c6-ef0ffaa49606 Aug 31 15:27:32 devstack sudo[103709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:32 devstack sudo[103708]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-de92b021-916b-48fc-83cf-cfd3d6eb0d9a tempest-SnapshotDependencyTests-389309808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a.c2bfc764-74f1-477d-a93e-ee72464ec0c4" returned: 0 in 0.323s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:32 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-de92b021-916b-48fc-83cf-cfd3d6eb0d9a tempest-SnapshotDependencyTests-389309808 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a.c2bfc764-74f1-477d-a93e-ee72464ec0c4 is being set with open permissions: ugo+rw Aug 31 15:27:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-de92b021-916b-48fc-83cf-cfd3d6eb0d9a tempest-SnapshotDependencyTests-389309808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a.c2bfc764-74f1-477d-a93e-ee72464ec0c4 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:32 devstack sudo[103718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a.c2bfc764-74f1-477d-a93e-ee72464ec0c4 Aug 31 15:27:32 devstack sudo[103718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:33 devstack sudo[103709]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-abb6e6b7-db89-44b1-904b-202032b1edc8 tempest-VolumesSnapshotTestJSON-235515433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1.fc039a7a-32fb-45b6-88c6-ef0ffaa49606" returned: 0 in 0.395s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-abb6e6b7-db89-44b1-904b-202032b1edc8 tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1.fc039a7a-32fb-45b6-88c6-ef0ffaa49606 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:33 devstack sudo[103720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1.fc039a7a-32fb-45b6-88c6-ef0ffaa49606 Aug 31 15:27:33 devstack sudo[103720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:33 devstack sudo[103718]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-de92b021-916b-48fc-83cf-cfd3d6eb0d9a tempest-SnapshotDependencyTests-389309808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a.c2bfc764-74f1-477d-a93e-ee72464ec0c4" returned: 0 in 0.280s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-de92b021-916b-48fc-83cf-cfd3d6eb0d9a tempest-SnapshotDependencyTests-389309808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:33 devstack sudo[103720]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:33 devstack sudo[103725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a.info Aug 31 15:27:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-abb6e6b7-db89-44b1-904b-202032b1edc8 tempest-VolumesSnapshotTestJSON-235515433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1.fc039a7a-32fb-45b6-88c6-ef0ffaa49606" returned: 0 in 0.293s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:33 devstack sudo[103725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:33 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-abb6e6b7-db89-44b1-904b-202032b1edc8 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-quobyte-fc039a7a-32fb-45b6-88c6-ef0ffaa49606" released by "_delete_snapshot" :: held 1.859s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:27:33 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-abb6e6b7-db89-44b1-904b-202032b1edc8 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-quobyte-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1" released by "delete_snapshot" :: held 1.885s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:27:33 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-abb6e6b7-db89-44b1-904b-202032b1edc8 tempest-VolumesSnapshotTestJSON-235515433 None] Created reservations ['d2c56176-1efa-4c67-b5a5-7cc1ab17d680', '8b5dc077-d1f0-4561-97ea-8b11ebf85c8a', 'df17c5d6-b988-4d21-abe8-d4eba98b2597', '5c1bfd7e-dac1-47f3-b8d6-c677058a93a8'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:27:33 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-abb6e6b7-db89-44b1-904b-202032b1edc8 tempest-VolumesSnapshotTestJSON-235515433 None] Delete snapshot completed successfully. Aug 31 15:27:33 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-abb6e6b7-db89-44b1-904b-202032b1edc8 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-fc039a7a-32fb-45b6-88c6-ef0ffaa49606-delete_snapshot" released by "delete_snapshot" :: held 2.030s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:27:33 devstack sudo[103725]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-de92b021-916b-48fc-83cf-cfd3d6eb0d9a tempest-SnapshotDependencyTests-389309808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a.info" returned: 0 in 0.268s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:33 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-de92b021-916b-48fc-83cf-cfd3d6eb0d9a tempest-SnapshotDependencyTests-389309808 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a.info is being set with open permissions: ugo+rw Aug 31 15:27:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-de92b021-916b-48fc-83cf-cfd3d6eb0d9a tempest-SnapshotDependencyTests-389309808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:33 devstack sudo[103728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a.info Aug 31 15:27:33 devstack sudo[103728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:33 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e7701f8e-ddb9-4e58-bd1c-c5652025f17e tempest-VolumesSnapshotTestJSON-235515433 None] Acquiring lock "cinder-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:27:33 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e7701f8e-ddb9-4e58-bd1c-c5652025f17e tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:27:33 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e7701f8e-ddb9-4e58-bd1c-c5652025f17e tempest-VolumesSnapshotTestJSON-235515433 None] Acquiring lock "cinder-quobyte-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:27:33 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e7701f8e-ddb9-4e58-bd1c-c5652025f17e tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-quobyte-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1" acquired by "delete_volume" :: waited 0.023s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:27:33 devstack sudo[103728]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:33 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32e4614-ec14-48b2-8c73-9e8ddd7a8b15]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:27:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e7701f8e-ddb9-4e58-bd1c-c5652025f17e tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-de92b021-916b-48fc-83cf-cfd3d6eb0d9a tempest-SnapshotDependencyTests-389309808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a.info" returned: 0 in 0.329s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-de92b021-916b-48fc-83cf-cfd3d6eb0d9a tempest-SnapshotDependencyTests-389309808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.214s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:27:33 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-de92b021-916b-48fc-83cf-cfd3d6eb0d9a tempest-SnapshotDependencyTests-389309808 None] Create snapshot completed successfully Aug 31 15:27:34 devstack sudo[103731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1 Aug 31 15:27:34 devstack sudo[103731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:34 devstack sudo[103731]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e7701f8e-ddb9-4e58-bd1c-c5652025f17e tempest-VolumesSnapshotTestJSON-235515433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1" returned: 0 in 0.393s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e7701f8e-ddb9-4e58-bd1c-c5652025f17e tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:34 devstack sudo[103736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1 Aug 31 15:27:34 devstack sudo[103736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:34 devstack sudo[103736]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e7701f8e-ddb9-4e58-bd1c-c5652025f17e tempest-VolumesSnapshotTestJSON-235515433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1" returned: 0 in 0.263s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:34 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e7701f8e-ddb9-4e58-bd1c-c5652025f17e tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-quobyte-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1" released by "delete_volume" :: held 0.726s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:27:34 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-e7701f8e-ddb9-4e58-bd1c-c5652025f17e tempest-VolumesSnapshotTestJSON-235515433 None] Created reservations ['173b21f6-241d-4db7-aed6-e3b020e022c2', 'c3d00cf7-72c4-4d36-a2b4-e58579379387', '89ce6d0a-0caf-44ae-9f25-1cf837203c2f', '896ec40f-20cf-45af-b750-8e9b7fe58d67'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:27:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e7701f8e-ddb9-4e58-bd1c-c5652025f17e tempest-VolumesSnapshotTestJSON-235515433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:27:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e7701f8e-ddb9-4e58-bd1c-c5652025f17e tempest-VolumesSnapshotTestJSON-235515433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:27:34 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-e7701f8e-ddb9-4e58-bd1c-c5652025f17e tempest-VolumesSnapshotTestJSON-235515433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:27:34 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-e7701f8e-ddb9-4e58-bd1c-c5652025f17e tempest-VolumesSnapshotTestJSON-235515433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:27:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e7701f8e-ddb9-4e58-bd1c-c5652025f17e tempest-VolumesSnapshotTestJSON-235515433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:27:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e7701f8e-ddb9-4e58-bd1c-c5652025f17e tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:34 devstack sudo[103739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:27:34 devstack sudo[103739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:35 devstack sudo[103739]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e7701f8e-ddb9-4e58-bd1c-c5652025f17e tempest-VolumesSnapshotTestJSON-235515433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.434s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:35 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-e7701f8e-ddb9-4e58-bd1c-c5652025f17e tempest-VolumesSnapshotTestJSON-235515433 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:27:35 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-e7701f8e-ddb9-4e58-bd1c-c5652025f17e tempest-VolumesSnapshotTestJSON-235515433 None] Deleted volume successfully. Aug 31 15:27:35 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e7701f8e-ddb9-4e58-bd1c-c5652025f17e tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-1c5562cc-ced2-4cf0-a6f5-cafa5a3761b1-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:27:35 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-4961729a-f9cb-4371-9270-ff2b7c3b6390 tempest-VolumesSnapshotTestJSON-235515433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:27:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4961729a-f9cb-4371-9270-ff2b7c3b6390 tempest-VolumesSnapshotTestJSON-235515433 None] Flow 'volume_create_manager' (15b970f4-5c09-464d-9ddf-e1ae5cf24945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:27:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4961729a-f9cb-4371-9270-ff2b7c3b6390 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9776823d-0560-40cc-8bde-1ee501b49291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4961729a-f9cb-4371-9270-ff2b7c3b6390 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9776823d-0560-40cc-8bde-1ee501b49291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1924235508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a571f807-85b0-4ca0-9537-020097f692e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b694ef42c364eb2a5af7af99ea6ba70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:27:36Z,use_quota=True,user_id='37612abd13cb497eaa90f73eecddcf76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4961729a-f9cb-4371-9270-ff2b7c3b6390 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a641e3b5-de87-4527-b278-d9e728b20ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4961729a-f9cb-4371-9270-ff2b7c3b6390 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a641e3b5-de87-4527-b278-d9e728b20ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4961729a-f9cb-4371-9270-ff2b7c3b6390 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ded2ec8-663c-4a1d-9b1f-c1f7a0ac92c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4961729a-f9cb-4371-9270-ff2b7c3b6390 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ded2ec8-663c-4a1d-9b1f-c1f7a0ac92c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a571f807-85b0-4ca0-9537-020097f692e5', 'volume_name': 'volume-a571f807-85b0-4ca0-9537-020097f692e5', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4961729a-f9cb-4371-9270-ff2b7c3b6390 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b34aad99-3f96-4818-8f1d-78b8c4a49a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4961729a-f9cb-4371-9270-ff2b7c3b6390 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b34aad99-3f96-4818-8f1d-78b8c4a49a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4961729a-f9cb-4371-9270-ff2b7c3b6390 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (701f2ab0-63c3-4993-9963-cb6d7f455c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:36 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-4961729a-f9cb-4371-9270-ff2b7c3b6390 tempest-VolumesSnapshotTestJSON-235515433 None] Volume a571f807-85b0-4ca0-9537-020097f692e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a571f807-85b0-4ca0-9537-020097f692e5', 'volume_size': 1} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4961729a-f9cb-4371-9270-ff2b7c3b6390 tempest-VolumesSnapshotTestJSON-235515433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4961729a-f9cb-4371-9270-ff2b7c3b6390 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4961729a-f9cb-4371-9270-ff2b7c3b6390 tempest-VolumesSnapshotTestJSON-235515433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1924235508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a571f807-85b0-4ca0-9537-020097f692e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b694ef42c364eb2a5af7af99ea6ba70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:27:36Z,use_quota=True,user_id='37612abd13cb497eaa90f73eecddcf76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-4961729a-f9cb-4371-9270-ff2b7c3b6390 tempest-VolumesSnapshotTestJSON-235515433 None] Creating volume a571f807-85b0-4ca0-9537-020097f692e5 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4961729a-f9cb-4371-9270-ff2b7c3b6390 tempest-VolumesSnapshotTestJSON-235515433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4961729a-f9cb-4371-9270-ff2b7c3b6390 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4961729a-f9cb-4371-9270-ff2b7c3b6390 tempest-VolumesSnapshotTestJSON-235515433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4961729a-f9cb-4371-9270-ff2b7c3b6390 tempest-VolumesSnapshotTestJSON-235515433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4961729a-f9cb-4371-9270-ff2b7c3b6390 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4961729a-f9cb-4371-9270-ff2b7c3b6390 tempest-VolumesSnapshotTestJSON-235515433 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:27:36 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-4961729a-f9cb-4371-9270-ff2b7c3b6390 tempest-VolumesSnapshotTestJSON-235515433 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4961729a-f9cb-4371-9270-ff2b7c3b6390 tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:27:36 devstack sudo[103744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5 1073741824 Aug 31 15:27:36 devstack sudo[103744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Flow 'volume_create_manager' (484fe967-7f44-4ff1-b7d7-9108e5ca3eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b5fa6d7-2f12-4624-90e0-e66e190c68ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b5fa6d7-2f12-4624-90e0-e66e190c68ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0136f10c-5470-4e20-a0ac-85c6a3eea0e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00035926d9134dffb00a7cf9f1d69b46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c2bfc764-74f1-477d-a93e-ee72464ec0c4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:27:36Z,use_quota=True,user_id='7c1e983f85b74355bc220077faed1fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3264eea-f4e8-4dda-b9b4-64490d9f70fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3264eea-f4e8-4dda-b9b4-64490d9f70fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45b5bb10-71be-4ef7-925f-6bf9c0bbdc4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45b5bb10-71be-4ef7-925f-6bf9c0bbdc4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0136f10c-5470-4e20-a0ac-85c6a3eea0e8', 'volume_name': 'volume-0136f10c-5470-4e20-a0ac-85c6a3eea0e8', 'volume_size': 1, 'snapshot_id': 'c2bfc764-74f1-477d-a93e-ee72464ec0c4'}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a21b7c4-b8d1-420a-8010-2c8043944b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a21b7c4-b8d1-420a-8010-2c8043944b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (056949de-eb27-46f8-ab9e-803e2a456d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:36 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Volume 0136f10c-5470-4e20-a0ac-85c6a3eea0e8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0136f10c-5470-4e20-a0ac-85c6a3eea0e8', 'volume_size': 1, 'snapshot_id': 'c2bfc764-74f1-477d-a93e-ee72464ec0c4'} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:27:36 devstack sudo[103744]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4961729a-f9cb-4371-9270-ff2b7c3b6390 tempest-VolumesSnapshotTestJSON-235515433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5 1073741824" returned: 0 in 0.451s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4961729a-f9cb-4371-9270-ff2b7c3b6390 tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:36 devstack sudo[103749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5 Aug 31 15:27:36 devstack sudo[103749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:36 devstack sudo[103749]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4961729a-f9cb-4371-9270-ff2b7c3b6390 tempest-VolumesSnapshotTestJSON-235515433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5" returned: 0 in 0.258s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4961729a-f9cb-4371-9270-ff2b7c3b6390 tempest-VolumesSnapshotTestJSON-235515433 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4961729a-f9cb-4371-9270-ff2b7c3b6390 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.575s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Acquiring lock "cinder-quobyte-c2bfc764-74f1-477d-a93e-ee72464ec0c4-0136f10c-5470-4e20-a0ac-85c6a3eea0e8" by "_create_volume_from_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4961729a-f9cb-4371-9270-ff2b7c3b6390 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (701f2ab0-63c3-4993-9963-cb6d7f455c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a571f807-85b0-4ca0-9537-020097f692e5', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4961729a-f9cb-4371-9270-ff2b7c3b6390 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8934e353-a7cb-48f1-a467-4e26da3aa6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Lock "cinder-quobyte-c2bfc764-74f1-477d-a93e-ee72464ec0c4-0136f10c-5470-4e20-a0ac-85c6a3eea0e8" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Creating volume 0136f10c-5470-4e20-a0ac-85c6a3eea0e8 from snapshot c2bfc764-74f1-477d-a93e-ee72464ec0c4 {{(pid=86000) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Acquiring lock "cinder-quobyte-0136f10c-5470-4e20-a0ac-85c6a3eea0e8" by "_copy_volume_from_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:27:36 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-4961729a-f9cb-4371-9270-ff2b7c3b6390 tempest-VolumesSnapshotTestJSON-235515433 None] Volume volume-a571f807-85b0-4ca0-9537-020097f692e5 (a571f807-85b0-4ca0-9537-020097f692e5): created successfully Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4961729a-f9cb-4371-9270-ff2b7c3b6390 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8934e353-a7cb-48f1-a467-4e26da3aa6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-4961729a-f9cb-4371-9270-ff2b7c3b6390 tempest-VolumesSnapshotTestJSON-235515433 None] Flow 'volume_create_manager' (15b970f4-5c09-464d-9ddf-e1ae5cf24945) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Lock "cinder-quobyte-0136f10c-5470-4e20-a0ac-85c6a3eea0e8" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] snapshot: c2bfc764-74f1-477d-a93e-ee72464ec0c4, volume: 0136f10c-5470-4e20-a0ac-85c6a3eea0e8, {{(pid=86000) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:27:36 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-4961729a-f9cb-4371-9270-ff2b7c3b6390 tempest-VolumesSnapshotTestJSON-235515433 None] Created volume successfully. Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30753eb-930d-4a5a-9d02-4297e8ee115f]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:27:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a.c2bfc764-74f1-477d-a93e-ee72464ec0c4 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:37 devstack sudo[103755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a.c2bfc764-74f1-477d-a93e-ee72464ec0c4 Aug 31 15:27:37 devstack sudo[103755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:37 devstack sudo[103755]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a.c2bfc764-74f1-477d-a93e-ee72464ec0c4" returned: 0 in 0.422s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:37 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:27:37 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf5ff59-dc99-423a-9bc0-914111244514]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:27:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:37 devstack sudo[103763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a Aug 31 15:27:37 devstack sudo[103763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:37 devstack sudo[103763]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a" returned: 0 in 0.417s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:37 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a {{(pid=86000) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 31 15:27:37 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Creating direct copy from snapshot {{(pid=86000) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 31 15:27:37 devstack cinder-volume[86000]: DEBUG cinder.utils [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Path /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0136f10c-5470-4e20-a0ac-85c6a3eea0e8 not found in is_blk_device check {{(pid=86000) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 31 15:27:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0136f10c-5470-4e20-a0ac-85c6a3eea0e8 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:37 devstack sudo[103768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0136f10c-5470-4e20-a0ac-85c6a3eea0e8 Aug 31 15:27:37 devstack sudo[103768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5789faec-124a-409b-850f-62a1cababf25 tempest-VolumesSnapshotTestJSON-235515433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:27:42 devstack sudo[103768]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0136f10c-5470-4e20-a0ac-85c6a3eea0e8" returned: 0 in 5.006s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:42 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a, size 1024.00 MB, duration 5.01 sec, destination /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0136f10c-5470-4e20-a0ac-85c6a3eea0e8 {{(pid=86000) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 31 15:27:42 devstack cinder-volume[86000]: INFO cinder.image.image_utils [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Converted 1024.00 MB image at 204.47 MB/s Aug 31 15:27:42 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0136f10c-5470-4e20-a0ac-85c6a3eea0e8 is being set with open permissions: ugo+rw Aug 31 15:27:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0136f10c-5470-4e20-a0ac-85c6a3eea0e8 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:42 devstack sudo[103783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0136f10c-5470-4e20-a0ac-85c6a3eea0e8 Aug 31 15:27:42 devstack sudo[103783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:43 devstack sudo[103783]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0136f10c-5470-4e20-a0ac-85c6a3eea0e8" returned: 0 in 0.264s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:43 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Lock "cinder-quobyte-0136f10c-5470-4e20-a0ac-85c6a3eea0e8" released by "_copy_volume_from_snapshot" :: held 6.259s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:27:43 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Lock "cinder-quobyte-c2bfc764-74f1-477d-a93e-ee72464ec0c4-0136f10c-5470-4e20-a0ac-85c6a3eea0e8" released by "_create_volume_from_snapshot" :: held 6.346s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:27:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.383s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:27:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5789faec-124a-409b-850f-62a1cababf25 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.138s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:27:43 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-5789faec-124a-409b-850f-62a1cababf25 tempest-VolumesSnapshotTestJSON-235515433 None] Creating offline snapshot dcdb029d-2fff-492e-a499-61d430fc62c0 of volume a571f807-85b0-4ca0-9537-020097f692e5 {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:27:43 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (056949de-eb27-46f8-ab9e-803e2a456d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0136f10c-5470-4e20-a0ac-85c6a3eea0e8', 'volume_size': 1, 'snapshot_id': 'c2bfc764-74f1-477d-a93e-ee72464ec0c4'}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:43 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beaa75bd-8dca-4681-a492-f885d70cad7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:43 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dfeefb7-52b2-4ade-bb29-56c0f02b8e20]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:27:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5789faec-124a-409b-850f-62a1cababf25 tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:43 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Volume volume-0136f10c-5470-4e20-a0ac-85c6a3eea0e8 (0136f10c-5470-4e20-a0ac-85c6a3eea0e8): created successfully Aug 31 15:27:43 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beaa75bd-8dca-4681-a492-f885d70cad7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:43 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Flow 'volume_create_manager' (484fe967-7f44-4ff1-b7d7-9108e5ca3eb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:27:43 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-1505375a-8393-4733-86e2-b3acb4d703e0 tempest-SnapshotDependencyTests-389309808 None] Created volume successfully. Aug 31 15:27:43 devstack sudo[103786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5 Aug 31 15:27:43 devstack sudo[103786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:43 devstack sudo[103786]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5789faec-124a-409b-850f-62a1cababf25 tempest-VolumesSnapshotTestJSON-235515433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5" returned: 0 in 0.382s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5789faec-124a-409b-850f-62a1cababf25 tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5.dcdb029d-2fff-492e-a499-61d430fc62c0 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:43 devstack sudo[103792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5.dcdb029d-2fff-492e-a499-61d430fc62c0 1G Aug 31 15:27:43 devstack sudo[103792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:44 devstack sudo[103792]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5789faec-124a-409b-850f-62a1cababf25 tempest-VolumesSnapshotTestJSON-235515433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5.dcdb029d-2fff-492e-a499-61d430fc62c0 1G" returned: 0 in 0.393s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5789faec-124a-409b-850f-62a1cababf25 tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a571f807-85b0-4ca0-9537-020097f692e5 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5.dcdb029d-2fff-492e-a499-61d430fc62c0 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:44 devstack sudo[103798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a571f807-85b0-4ca0-9537-020097f692e5 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5.dcdb029d-2fff-492e-a499-61d430fc62c0 Aug 31 15:27:44 devstack sudo[103798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:44 devstack sudo[103798]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5789faec-124a-409b-850f-62a1cababf25 tempest-VolumesSnapshotTestJSON-235515433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a571f807-85b0-4ca0-9537-020097f692e5 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5.dcdb029d-2fff-492e-a499-61d430fc62c0" returned: 0 in 0.308s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:44 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-5789faec-124a-409b-850f-62a1cababf25 tempest-VolumesSnapshotTestJSON-235515433 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5.dcdb029d-2fff-492e-a499-61d430fc62c0 is being set with open permissions: ugo+rw Aug 31 15:27:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5789faec-124a-409b-850f-62a1cababf25 tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5.dcdb029d-2fff-492e-a499-61d430fc62c0 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:44 devstack sudo[103803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5.dcdb029d-2fff-492e-a499-61d430fc62c0 Aug 31 15:27:44 devstack sudo[103803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:44 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-795df6bc-0b60-49d1-a2a5-05a2a1743eec tempest-SnapshotDependencyTests-389309808 None] Acquiring lock "cinder-c2bfc764-74f1-477d-a93e-ee72464ec0c4-delete_snapshot" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:27:44 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-795df6bc-0b60-49d1-a2a5-05a2a1743eec tempest-SnapshotDependencyTests-389309808 None] Lock "cinder-c2bfc764-74f1-477d-a93e-ee72464ec0c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:27:44 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-795df6bc-0b60-49d1-a2a5-05a2a1743eec tempest-SnapshotDependencyTests-389309808 None] Acquiring lock "cinder-quobyte-7c4b579b-5fc0-4f30-8307-f909d4a9d51a" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:27:44 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-795df6bc-0b60-49d1-a2a5-05a2a1743eec tempest-SnapshotDependencyTests-389309808 None] Lock "cinder-quobyte-7c4b579b-5fc0-4f30-8307-f909d4a9d51a" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:27:44 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-795df6bc-0b60-49d1-a2a5-05a2a1743eec tempest-SnapshotDependencyTests-389309808 None] Acquiring lock "cinder-quobyte-c2bfc764-74f1-477d-a93e-ee72464ec0c4" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:27:44 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-795df6bc-0b60-49d1-a2a5-05a2a1743eec tempest-SnapshotDependencyTests-389309808 None] Lock "cinder-quobyte-c2bfc764-74f1-477d-a93e-ee72464ec0c4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:27:44 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-795df6bc-0b60-49d1-a2a5-05a2a1743eec tempest-SnapshotDependencyTests-389309808 None] Deleting offline snapshot c2bfc764-74f1-477d-a93e-ee72464ec0c4 of volume 7c4b579b-5fc0-4f30-8307-f909d4a9d51a {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:27:44 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-795df6bc-0b60-49d1-a2a5-05a2a1743eec tempest-SnapshotDependencyTests-389309808 None] snapshot_file for this snap is: volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a.c2bfc764-74f1-477d-a93e-ee72464ec0c4 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:27:44 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ca36c8-965f-4a18-a97a-afafbcecf3b9]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:27:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-795df6bc-0b60-49d1-a2a5-05a2a1743eec tempest-SnapshotDependencyTests-389309808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a.c2bfc764-74f1-477d-a93e-ee72464ec0c4 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:44 devstack sudo[103803]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5789faec-124a-409b-850f-62a1cababf25 tempest-VolumesSnapshotTestJSON-235515433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5.dcdb029d-2fff-492e-a499-61d430fc62c0" returned: 0 in 0.279s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5789faec-124a-409b-850f-62a1cababf25 tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:44 devstack sudo[103807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5.info Aug 31 15:27:44 devstack sudo[103807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:44 devstack sudo[103806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a.c2bfc764-74f1-477d-a93e-ee72464ec0c4 Aug 31 15:27:44 devstack sudo[103806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:44 devstack sudo[103807]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5789faec-124a-409b-850f-62a1cababf25 tempest-VolumesSnapshotTestJSON-235515433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5.info" returned: 0 in 0.274s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:44 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-5789faec-124a-409b-850f-62a1cababf25 tempest-VolumesSnapshotTestJSON-235515433 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5.info is being set with open permissions: ugo+rw Aug 31 15:27:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5789faec-124a-409b-850f-62a1cababf25 tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:44 devstack sudo[103813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5.info Aug 31 15:27:44 devstack sudo[103813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:44 devstack sudo[103806]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-795df6bc-0b60-49d1-a2a5-05a2a1743eec tempest-SnapshotDependencyTests-389309808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a.c2bfc764-74f1-477d-a93e-ee72464ec0c4" returned: 0 in 0.412s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:44 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-795df6bc-0b60-49d1-a2a5-05a2a1743eec tempest-SnapshotDependencyTests-389309808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:27:45 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ea0795-49b8-4e1d-bc47-ced34ef3f12b]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:27:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-795df6bc-0b60-49d1-a2a5-05a2a1743eec tempest-SnapshotDependencyTests-389309808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:45 devstack cinder-volume[86000]: DEBUG oslo_service.periodic_task [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86000) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:27:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:27:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:27:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:27:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:27:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:27:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:45 devstack sudo[103817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:27:45 devstack sudo[103817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:45 devstack sudo[103816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a Aug 31 15:27:45 devstack sudo[103816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:45 devstack sudo[103813]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5789faec-124a-409b-850f-62a1cababf25 tempest-VolumesSnapshotTestJSON-235515433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5.info" returned: 0 in 0.302s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5789faec-124a-409b-850f-62a1cababf25 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.067s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:27:45 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-5789faec-124a-409b-850f-62a1cababf25 tempest-VolumesSnapshotTestJSON-235515433 None] Create snapshot completed successfully Aug 31 15:27:45 devstack sudo[103817]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.266s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:45 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:27:45 devstack cinder-volume[86000]: DEBUG oslo_service.periodic_task [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running periodic task VolumeManager._thread_info {{(pid=86000) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:27:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] thread count: 28 {{(pid=86000) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 31 15:27:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] thread info: [<_MainThread(MainThread, started 137631281086592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86000) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 31 15:27:45 devstack sudo[103816]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-795df6bc-0b60-49d1-a2a5-05a2a1743eec tempest-SnapshotDependencyTests-389309808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a" returned: 0 in 0.621s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-795df6bc-0b60-49d1-a2a5-05a2a1743eec tempest-SnapshotDependencyTests-389309808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a.c2bfc764-74f1-477d-a93e-ee72464ec0c4 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:45 devstack sudo[103826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a.c2bfc764-74f1-477d-a93e-ee72464ec0c4 Aug 31 15:27:45 devstack sudo[103826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:46 devstack sudo[103826]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-795df6bc-0b60-49d1-a2a5-05a2a1743eec tempest-SnapshotDependencyTests-389309808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a.c2bfc764-74f1-477d-a93e-ee72464ec0c4" returned: 0 in 0.415s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-795df6bc-0b60-49d1-a2a5-05a2a1743eec tempest-SnapshotDependencyTests-389309808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a.c2bfc764-74f1-477d-a93e-ee72464ec0c4 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:46 devstack sudo[103832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a.c2bfc764-74f1-477d-a93e-ee72464ec0c4 Aug 31 15:27:46 devstack sudo[103832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Flow 'volume_create_manager' (4cdb0eec-9dd3-47f8-841c-fcfe1c2d4509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89236bd8-e698-4d06-98ae-49617cbb5731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89236bd8-e698-4d06-98ae-49617cbb5731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-840235684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89aa96ba-40d9-41b1-a34f-11fb9d50c5cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b694ef42c364eb2a5af7af99ea6ba70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dcdb029d-2fff-492e-a499-61d430fc62c0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:27:46Z,use_quota=True,user_id='37612abd13cb497eaa90f73eecddcf76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fab5e98-fee2-4573-9763-7880860d26e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fab5e98-fee2-4573-9763-7880860d26e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5268679e-c82e-45f6-a9ea-2f9fbf818b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5268679e-c82e-45f6-a9ea-2f9fbf818b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '89aa96ba-40d9-41b1-a34f-11fb9d50c5cd', 'volume_name': 'volume-89aa96ba-40d9-41b1-a34f-11fb9d50c5cd', 'volume_size': 1, 'snapshot_id': 'dcdb029d-2fff-492e-a499-61d430fc62c0'}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da4cf8d0-8a06-4c92-8a22-5feb5a2a6520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da4cf8d0-8a06-4c92-8a22-5feb5a2a6520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ade35151-5469-4f64-a01f-9105c7a1eded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:46 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Volume 89aa96ba-40d9-41b1-a34f-11fb9d50c5cd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-89aa96ba-40d9-41b1-a34f-11fb9d50c5cd', 'volume_size': 1, 'snapshot_id': 'dcdb029d-2fff-492e-a499-61d430fc62c0'} Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Acquiring lock "cinder-quobyte-dcdb029d-2fff-492e-a499-61d430fc62c0-89aa96ba-40d9-41b1-a34f-11fb9d50c5cd" by "_create_volume_from_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-quobyte-dcdb029d-2fff-492e-a499-61d430fc62c0-89aa96ba-40d9-41b1-a34f-11fb9d50c5cd" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Creating volume 89aa96ba-40d9-41b1-a34f-11fb9d50c5cd from snapshot dcdb029d-2fff-492e-a499-61d430fc62c0 {{(pid=86000) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Acquiring lock "cinder-quobyte-89aa96ba-40d9-41b1-a34f-11fb9d50c5cd" by "_copy_volume_from_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:27:46 devstack sudo[103832]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-quobyte-89aa96ba-40d9-41b1-a34f-11fb9d50c5cd" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] snapshot: dcdb029d-2fff-492e-a499-61d430fc62c0, volume: 89aa96ba-40d9-41b1-a34f-11fb9d50c5cd, {{(pid=86000) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-795df6bc-0b60-49d1-a2a5-05a2a1743eec tempest-SnapshotDependencyTests-389309808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a.c2bfc764-74f1-477d-a93e-ee72464ec0c4" returned: 0 in 0.301s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47dcde6-10b3-486c-a458-a99d5b7d0296]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5.dcdb029d-2fff-492e-a499-61d430fc62c0 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-795df6bc-0b60-49d1-a2a5-05a2a1743eec tempest-SnapshotDependencyTests-389309808 None] Lock "cinder-quobyte-c2bfc764-74f1-477d-a93e-ee72464ec0c4" released by "_delete_snapshot" :: held 1.913s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-795df6bc-0b60-49d1-a2a5-05a2a1743eec tempest-SnapshotDependencyTests-389309808 None] Lock "cinder-quobyte-7c4b579b-5fc0-4f30-8307-f909d4a9d51a" released by "delete_snapshot" :: held 1.944s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-795df6bc-0b60-49d1-a2a5-05a2a1743eec tempest-SnapshotDependencyTests-389309808 None] Created reservations ['3f6615a1-a92e-4a37-a0ce-4879d4f4a19a', '7649439d-2e51-4c93-aaab-e23bc9d341bf', 'c9ea79b0-46bb-4a65-9e61-4f9ff7b798da', '659add59-2dc4-4e49-9c6c-d94cfd2b402f'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:27:46 devstack sudo[103835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5.dcdb029d-2fff-492e-a499-61d430fc62c0 Aug 31 15:27:46 devstack sudo[103835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:46 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-795df6bc-0b60-49d1-a2a5-05a2a1743eec tempest-SnapshotDependencyTests-389309808 None] Delete snapshot completed successfully. Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-795df6bc-0b60-49d1-a2a5-05a2a1743eec tempest-SnapshotDependencyTests-389309808 None] Lock "cinder-c2bfc764-74f1-477d-a93e-ee72464ec0c4-delete_snapshot" released by "delete_snapshot" :: held 2.141s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e0f1eb9e-8e60-49fe-a9da-1b582088c069 tempest-SnapshotDependencyTests-389309808 None] Acquiring lock "cinder-7c4b579b-5fc0-4f30-8307-f909d4a9d51a-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e0f1eb9e-8e60-49fe-a9da-1b582088c069 tempest-SnapshotDependencyTests-389309808 None] Lock "cinder-7c4b579b-5fc0-4f30-8307-f909d4a9d51a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e0f1eb9e-8e60-49fe-a9da-1b582088c069 tempest-SnapshotDependencyTests-389309808 None] Acquiring lock "cinder-quobyte-7c4b579b-5fc0-4f30-8307-f909d4a9d51a" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e0f1eb9e-8e60-49fe-a9da-1b582088c069 tempest-SnapshotDependencyTests-389309808 None] Lock "cinder-quobyte-7c4b579b-5fc0-4f30-8307-f909d4a9d51a" acquired by "delete_volume" :: waited 0.017s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b38b19c-2977-48ff-84f1-e54ad9207109]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e0f1eb9e-8e60-49fe-a9da-1b582088c069 tempest-SnapshotDependencyTests-389309808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:46 devstack sudo[103835]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5.dcdb029d-2fff-492e-a499-61d430fc62c0" returned: 0 in 0.413s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a571f807-85b0-4ca0-9537-020097f692e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cafd84d-8b0a-4e03-9d6a-546fd1f8aab0]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:27:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:46 devstack sudo[103840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a Aug 31 15:27:46 devstack sudo[103840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:46 devstack sudo[103841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5 Aug 31 15:27:46 devstack sudo[103841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:47 devstack sudo[103840]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e0f1eb9e-8e60-49fe-a9da-1b582088c069 tempest-SnapshotDependencyTests-389309808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a" returned: 0 in 0.388s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e0f1eb9e-8e60-49fe-a9da-1b582088c069 tempest-SnapshotDependencyTests-389309808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:47 devstack sudo[103848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a Aug 31 15:27:47 devstack sudo[103848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:47 devstack sudo[103841]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5" returned: 0 in 0.419s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:47 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5 {{(pid=86000) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 31 15:27:47 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Creating direct copy from snapshot {{(pid=86000) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 31 15:27:47 devstack cinder-volume[86000]: DEBUG cinder.utils [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Path /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-89aa96ba-40d9-41b1-a34f-11fb9d50c5cd not found in is_blk_device check {{(pid=86000) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 31 15:27:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-89aa96ba-40d9-41b1-a34f-11fb9d50c5cd {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:47 devstack sudo[103852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-89aa96ba-40d9-41b1-a34f-11fb9d50c5cd Aug 31 15:27:47 devstack sudo[103852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:47 devstack sudo[103848]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e0f1eb9e-8e60-49fe-a9da-1b582088c069 tempest-SnapshotDependencyTests-389309808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7c4b579b-5fc0-4f30-8307-f909d4a9d51a" returned: 0 in 0.258s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:47 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e0f1eb9e-8e60-49fe-a9da-1b582088c069 tempest-SnapshotDependencyTests-389309808 None] Lock "cinder-quobyte-7c4b579b-5fc0-4f30-8307-f909d4a9d51a" released by "delete_volume" :: held 0.707s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:27:47 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-e0f1eb9e-8e60-49fe-a9da-1b582088c069 tempest-SnapshotDependencyTests-389309808 None] Created reservations ['4fc7bfbb-a7bc-423c-8147-e4f28d01a415', '772a41e0-5c92-4d50-afbe-db91d6f41aac', 'd3f702f6-620e-42ff-8c24-7a8eee7208a4', '1155f365-3dd1-4ba2-b9b2-a22fcfd9e196'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:27:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e0f1eb9e-8e60-49fe-a9da-1b582088c069 tempest-SnapshotDependencyTests-389309808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:27:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e0f1eb9e-8e60-49fe-a9da-1b582088c069 tempest-SnapshotDependencyTests-389309808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:27:47 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-e0f1eb9e-8e60-49fe-a9da-1b582088c069 tempest-SnapshotDependencyTests-389309808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:27:47 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-e0f1eb9e-8e60-49fe-a9da-1b582088c069 tempest-SnapshotDependencyTests-389309808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:27:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e0f1eb9e-8e60-49fe-a9da-1b582088c069 tempest-SnapshotDependencyTests-389309808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:27:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e0f1eb9e-8e60-49fe-a9da-1b582088c069 tempest-SnapshotDependencyTests-389309808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:47 devstack sudo[103858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:27:47 devstack sudo[103858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:47 devstack sudo[103858]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e0f1eb9e-8e60-49fe-a9da-1b582088c069 tempest-SnapshotDependencyTests-389309808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.340s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:47 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-e0f1eb9e-8e60-49fe-a9da-1b582088c069 tempest-SnapshotDependencyTests-389309808 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:27:48 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-e0f1eb9e-8e60-49fe-a9da-1b582088c069 tempest-SnapshotDependencyTests-389309808 None] Deleted volume successfully. Aug 31 15:27:48 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7d1a3bf9-fe82-4b79-bd65-c5a6c9b641fe tempest-SnapshotDependencyTests-389309808 None] Acquiring lock "cinder-0136f10c-5470-4e20-a0ac-85c6a3eea0e8-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:27:48 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e0f1eb9e-8e60-49fe-a9da-1b582088c069 tempest-SnapshotDependencyTests-389309808 None] Lock "cinder-7c4b579b-5fc0-4f30-8307-f909d4a9d51a-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:27:48 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7d1a3bf9-fe82-4b79-bd65-c5a6c9b641fe tempest-SnapshotDependencyTests-389309808 None] Lock "cinder-0136f10c-5470-4e20-a0ac-85c6a3eea0e8-delete_volume" acquired by "delete_volume" :: waited 0.113s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:27:48 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7d1a3bf9-fe82-4b79-bd65-c5a6c9b641fe tempest-SnapshotDependencyTests-389309808 None] Acquiring lock "cinder-quobyte-0136f10c-5470-4e20-a0ac-85c6a3eea0e8" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:27:48 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7d1a3bf9-fe82-4b79-bd65-c5a6c9b641fe tempest-SnapshotDependencyTests-389309808 None] Lock "cinder-quobyte-0136f10c-5470-4e20-a0ac-85c6a3eea0e8" acquired by "delete_volume" :: waited 0.054s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:27:48 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[810d706a-8530-4c7f-aad3-69f7ca4ba903]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:27:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7d1a3bf9-fe82-4b79-bd65-c5a6c9b641fe tempest-SnapshotDependencyTests-389309808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0136f10c-5470-4e20-a0ac-85c6a3eea0e8 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:48 devstack sudo[103869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0136f10c-5470-4e20-a0ac-85c6a3eea0e8 Aug 31 15:27:48 devstack sudo[103869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:49 devstack sudo[103869]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7d1a3bf9-fe82-4b79-bd65-c5a6c9b641fe tempest-SnapshotDependencyTests-389309808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0136f10c-5470-4e20-a0ac-85c6a3eea0e8" returned: 0 in 0.754s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7d1a3bf9-fe82-4b79-bd65-c5a6c9b641fe tempest-SnapshotDependencyTests-389309808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0136f10c-5470-4e20-a0ac-85c6a3eea0e8 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:49 devstack sudo[103874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0136f10c-5470-4e20-a0ac-85c6a3eea0e8 Aug 31 15:27:49 devstack sudo[103874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:50 devstack sudo[103874]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7d1a3bf9-fe82-4b79-bd65-c5a6c9b641fe tempest-SnapshotDependencyTests-389309808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0136f10c-5470-4e20-a0ac-85c6a3eea0e8" returned: 0 in 0.866s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:50 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7d1a3bf9-fe82-4b79-bd65-c5a6c9b641fe tempest-SnapshotDependencyTests-389309808 None] Lock "cinder-quobyte-0136f10c-5470-4e20-a0ac-85c6a3eea0e8" released by "delete_volume" :: held 1.747s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:27:50 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-7d1a3bf9-fe82-4b79-bd65-c5a6c9b641fe tempest-SnapshotDependencyTests-389309808 None] Created reservations ['d1e27ebb-d4a9-4a20-93ea-c7fd90fcf989', '96889e9b-4e69-46f2-9b1d-c2ee47d7fe74', 'b64e91d9-48ca-4f6e-8e74-b1176ac56faf', '44c91573-1891-4272-a3b6-8f9fc653d81d'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:27:50 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:27:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Flow 'volume_create_manager' (8096b64e-dd1f-43bb-b337-29da613f50ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:27:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9c23e69-f8b6-4005-a0bd-4d04fd5f9654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9c23e69-f8b6-4005-a0bd-4d04fd5f9654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=971e270c-e8f0-4bc9-a300-2791df78ea7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='531eafe160174b51b83b008b2c71d905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:27:50Z,use_quota=True,user_id='e85f550855504067bfaad5604621e4d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ee01d4c-a1e2-455b-9d25-961f67366a56),volume_type_id=5ee01d4c-a1e2-455b-9d25-961f67366a56)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68177901-2729-45af-9a59-7960959f433f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68177901-2729-45af-9a59-7960959f433f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83ee8c95-a5b7-4dda-82d4-5d9190955477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:50 devstack cinder-volume[86000]: DEBUG cinder.image.glance [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Creating Keystone auth plugin from conf {{(pid=86000) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 31 15:27:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7d1a3bf9-fe82-4b79-bd65-c5a6c9b641fe tempest-SnapshotDependencyTests-389309808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:27:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7d1a3bf9-fe82-4b79-bd65-c5a6c9b641fe tempest-SnapshotDependencyTests-389309808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:27:50 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-7d1a3bf9-fe82-4b79-bd65-c5a6c9b641fe tempest-SnapshotDependencyTests-389309808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:27:50 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-7d1a3bf9-fe82-4b79-bd65-c5a6c9b641fe tempest-SnapshotDependencyTests-389309808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:27:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7d1a3bf9-fe82-4b79-bd65-c5a6c9b641fe tempest-SnapshotDependencyTests-389309808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:27:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7d1a3bf9-fe82-4b79-bd65-c5a6c9b641fe tempest-SnapshotDependencyTests-389309808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:50 devstack sudo[103878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:27:50 devstack sudo[103878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:51 devstack sudo[103878]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7d1a3bf9-fe82-4b79-bd65-c5a6c9b641fe tempest-SnapshotDependencyTests-389309808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.741s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:51 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-7d1a3bf9-fe82-4b79-bd65-c5a6c9b641fe tempest-SnapshotDependencyTests-389309808 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:27:51 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-7d1a3bf9-fe82-4b79-bd65-c5a6c9b641fe tempest-SnapshotDependencyTests-389309808 None] Deleted volume successfully. Aug 31 15:27:51 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-7d1a3bf9-fe82-4b79-bd65-c5a6c9b641fe tempest-SnapshotDependencyTests-389309808 None] Lock "cinder-0136f10c-5470-4e20-a0ac-85c6a3eea0e8-delete_volume" released by "delete_volume" :: held 3.386s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:27:51 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83ee8c95-a5b7-4dda-82d4-5d9190955477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '971e270c-e8f0-4bc9-a300-2791df78ea7f', 'volume_name': 'volume-971e270c-e8f0-4bc9-a300-2791df78ea7f', 'volume_size': 1, 'image_id': '3671f266-2a49-4863-9f4d-367e67ccafba', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3671f266-2a49-4863-9f4d-367e67ccafba', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ff6e147d8de6ec57bd018eb3ce5e6c78', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '531eafe160174b51b83b008b2c71d905', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '85a523a45eb4612be6e4276e9572fb5fa3dfa5bf768eae83ae68876c25f2025c672a419275de424b782ab7c2de66cc298e6dea6465c4dbcfa05fe3625a23ab72', 'id': '3671f266-2a49-4863-9f4d-367e67ccafba', 'created_at': datetime.datetime(2026, 8, 31, 13, 27, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 13, 27, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3671f266-2a49-4863-9f4d-367e67ccafba/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:51 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0caaa15-0771-44c8-afe1-e0890a6d4635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:51 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0caaa15-0771-44c8-afe1-e0890a6d4635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:51 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2e90a57-f23c-4fff-a69a-49018403799b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:51 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Volume 971e270c-e8f0-4bc9-a300-2791df78ea7f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-971e270c-e8f0-4bc9-a300-2791df78ea7f', 'volume_size': 1, 'image_id': '3671f266-2a49-4863-9f4d-367e67ccafba', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3671f266-2a49-4863-9f4d-367e67ccafba', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ff6e147d8de6ec57bd018eb3ce5e6c78', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '531eafe160174b51b83b008b2c71d905', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '85a523a45eb4612be6e4276e9572fb5fa3dfa5bf768eae83ae68876c25f2025c672a419275de424b782ab7c2de66cc298e6dea6465c4dbcfa05fe3625a23ab72', 'id': '3671f266-2a49-4863-9f4d-367e67ccafba', 'created_at': datetime.datetime(2026, 8, 31, 13, 27, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 13, 27, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3671f266-2a49-4863-9f4d-367e67ccafba/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 31 15:27:51 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Trying to clone 971e270c-e8f0-4bc9-a300-2791df78ea7f from image 3671f266-2a49-4863-9f4d-367e67ccafba at location (None, [{'url': 'file:///opt/stack/data/glance/images/3671f266-2a49-4863-9f4d-367e67ccafba', 'metadata': {}}]). {{(pid=86000) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 31 15:27:51 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3671f266-2a49-4863-9f4d-367e67ccafba_qyrr87z9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86000) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 31 15:27:51 devstack cinder-volume[86000]: INFO cinder.image.image_utils [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Image download 0.00 MB at 0.00 MB/s Aug 31 15:27:52 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e0220d-7f1e-4f3b-8640-ac2d0f5295c8]: (4, 'raw') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:27:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3671f266-2a49-4863-9f4d-367e67ccafba_qyrr87z9devstack@QuobyteHD {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:52 devstack sudo[103881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3671f266-2a49-4863-9f4d-367e67ccafba_qyrr87z9devstack@QuobyteHD Aug 31 15:27:52 devstack sudo[103881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:52 devstack sudo[103881]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3671f266-2a49-4863-9f4d-367e67ccafba_qyrr87z9devstack@QuobyteHD" returned: 0 in 0.916s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3671f266-2a49-4863-9f4d-367e67ccafba_qyrr87z9devstack@QuobyteHD {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:53 devstack sudo[103852]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-89aa96ba-40d9-41b1-a34f-11fb9d50c5cd" returned: 0 in 5.791s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:53 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5, size 1024.00 MB, duration 5.79 sec, destination /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-89aa96ba-40d9-41b1-a34f-11fb9d50c5cd {{(pid=86000) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 31 15:27:53 devstack cinder-volume[86000]: INFO cinder.image.image_utils [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Converted 1024.00 MB image at 176.76 MB/s Aug 31 15:27:53 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-89aa96ba-40d9-41b1-a34f-11fb9d50c5cd is being set with open permissions: ugo+rw Aug 31 15:27:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-89aa96ba-40d9-41b1-a34f-11fb9d50c5cd {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:53 devstack sudo[103886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-89aa96ba-40d9-41b1-a34f-11fb9d50c5cd Aug 31 15:27:53 devstack sudo[103886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:53 devstack sudo[103885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3671f266-2a49-4863-9f4d-367e67ccafba_qyrr87z9devstack@QuobyteHD Aug 31 15:27:53 devstack sudo[103885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:53 devstack sudo[103886]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-89aa96ba-40d9-41b1-a34f-11fb9d50c5cd" returned: 0 in 0.273s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:53 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-quobyte-89aa96ba-40d9-41b1-a34f-11fb9d50c5cd" released by "_copy_volume_from_snapshot" :: held 7.009s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:27:53 devstack sudo[103885]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3671f266-2a49-4863-9f4d-367e67ccafba_qyrr87z9devstack@QuobyteHD" returned: 1 in 0.397s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3671f266-2a49-4863-9f4d-367e67ccafba_qyrr87z9devstack@QuobyteHD' failed. Not Retrying. {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 31 15:27:53 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Temporary image 3671f266-2a49-4863-9f4d-367e67ccafba is fetched for user e85f550855504067bfaad5604621e4d7. {{(pid=86000) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 31 15:27:53 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-quobyte-dcdb029d-2fff-492e-a499-61d430fc62c0-89aa96ba-40d9-41b1-a34f-11fb9d50c5cd" released by "_create_volume_from_snapshot" :: held 7.089s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:27:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.109s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:27:53 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ade35151-5469-4f64-a01f-9105c7a1eded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89aa96ba-40d9-41b1-a34f-11fb9d50c5cd', 'volume_size': 1, 'snapshot_id': 'dcdb029d-2fff-492e-a499-61d430fc62c0'}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:53 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d58215-e86c-4160-9594-a60603d162f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:53 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Volume volume-89aa96ba-40d9-41b1-a34f-11fb9d50c5cd (89aa96ba-40d9-41b1-a34f-11fb9d50c5cd): created successfully Aug 31 15:27:53 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d58215-e86c-4160-9594-a60603d162f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:53 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Flow 'volume_create_manager' (4cdb0eec-9dd3-47f8-841c-fcfe1c2d4509) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:27:53 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5904bc71-246b-4e07-97cc-d73e942a3531]: (4, 'raw') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:27:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3671f266-2a49-4863-9f4d-367e67ccafba_qyrr87z9devstack@QuobyteHD {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:53 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-5d83b74c-6441-4b4f-90ae-e25660a845f6 tempest-VolumesSnapshotTestJSON-235515433 None] Created volume successfully. Aug 31 15:27:53 devstack sudo[103893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3671f266-2a49-4863-9f4d-367e67ccafba_qyrr87z9devstack@QuobyteHD Aug 31 15:27:53 devstack sudo[103893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:53 devstack sudo[103893]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3671f266-2a49-4863-9f4d-367e67ccafba_qyrr87z9devstack@QuobyteHD" returned: 0 in 0.361s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3671f266-2a49-4863-9f4d-367e67ccafba_qyrr87z9devstack@QuobyteHD {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:53 devstack sudo[103898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3671f266-2a49-4863-9f4d-367e67ccafba_qyrr87z9devstack@QuobyteHD Aug 31 15:27:53 devstack sudo[103898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:54 devstack sudo[103898]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3671f266-2a49-4863-9f4d-367e67ccafba_qyrr87z9devstack@QuobyteHD" returned: 1 in 0.354s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3671f266-2a49-4863-9f4d-367e67ccafba_qyrr87z9devstack@QuobyteHD' failed. Not Retrying. {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 31 15:27:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:27:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:27:54 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=971e270c-e8f0-4bc9-a300-2791df78ea7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='531eafe160174b51b83b008b2c71d905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:27:50Z,use_quota=True,user_id='e85f550855504067bfaad5604621e4d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ee01d4c-a1e2-455b-9d25-961f67366a56),volume_type_id=5ee01d4c-a1e2-455b-9d25-961f67366a56)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:27:54 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Creating volume 971e270c-e8f0-4bc9-a300-2791df78ea7f {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:27:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:27:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:27:54 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:27:54 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:27:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:27:54 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:27:54 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:27:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-971e270c-e8f0-4bc9-a300-2791df78ea7f 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:54 devstack sudo[103903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-971e270c-e8f0-4bc9-a300-2791df78ea7f 1073741824 Aug 31 15:27:54 devstack sudo[103903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:54 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-cdde45d7-08cf-48a2-83b5-f18455533b08 tempest-VolumesSnapshotTestJSON-235515433 None] Acquiring lock "cinder-89aa96ba-40d9-41b1-a34f-11fb9d50c5cd-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:27:54 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-cdde45d7-08cf-48a2-83b5-f18455533b08 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-89aa96ba-40d9-41b1-a34f-11fb9d50c5cd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:27:54 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-cdde45d7-08cf-48a2-83b5-f18455533b08 tempest-VolumesSnapshotTestJSON-235515433 None] Acquiring lock "cinder-quobyte-89aa96ba-40d9-41b1-a34f-11fb9d50c5cd" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:27:54 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-cdde45d7-08cf-48a2-83b5-f18455533b08 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-quobyte-89aa96ba-40d9-41b1-a34f-11fb9d50c5cd" acquired by "delete_volume" :: waited 0.020s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:27:54 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db90eb7-83ba-4790-a020-b8a5dde11e55]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:27:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cdde45d7-08cf-48a2-83b5-f18455533b08 tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-89aa96ba-40d9-41b1-a34f-11fb9d50c5cd {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:54 devstack sudo[103905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-89aa96ba-40d9-41b1-a34f-11fb9d50c5cd Aug 31 15:27:54 devstack sudo[103905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:54 devstack sudo[103903]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-971e270c-e8f0-4bc9-a300-2791df78ea7f 1073741824" returned: 0 in 0.513s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-971e270c-e8f0-4bc9-a300-2791df78ea7f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:54 devstack sudo[103914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-971e270c-e8f0-4bc9-a300-2791df78ea7f Aug 31 15:27:54 devstack sudo[103914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:54 devstack sudo[103905]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cdde45d7-08cf-48a2-83b5-f18455533b08 tempest-VolumesSnapshotTestJSON-235515433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-89aa96ba-40d9-41b1-a34f-11fb9d50c5cd" returned: 0 in 0.430s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cdde45d7-08cf-48a2-83b5-f18455533b08 tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-89aa96ba-40d9-41b1-a34f-11fb9d50c5cd {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:54 devstack sudo[103916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-89aa96ba-40d9-41b1-a34f-11fb9d50c5cd Aug 31 15:27:54 devstack sudo[103916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:55 devstack sudo[103914]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-971e270c-e8f0-4bc9-a300-2791df78ea7f" returned: 0 in 0.273s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:55 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:27:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:27:55 devstack cinder-volume[86000]: DEBUG cinder.volume.volume_utils [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Attempting download of 3671f266-2a49-4863-9f4d-367e67ccafba ((None, [{'url': 'file:///opt/stack/data/glance/images/3671f266-2a49-4863-9f4d-367e67ccafba', 'metadata': {}}])) to volume 971e270c-e8f0-4bc9-a300-2791df78ea7f. {{(pid=86000) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 31 15:27:55 devstack sudo[103916]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cdde45d7-08cf-48a2-83b5-f18455533b08 tempest-VolumesSnapshotTestJSON-235515433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-89aa96ba-40d9-41b1-a34f-11fb9d50c5cd" returned: 0 in 0.267s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:55 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-cdde45d7-08cf-48a2-83b5-f18455533b08 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-quobyte-89aa96ba-40d9-41b1-a34f-11fb9d50c5cd" released by "delete_volume" :: held 0.745s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:27:55 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d91e737-f8bb-440c-96cd-f378fbcab251]: (4, 'raw') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:27:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3671f266-2a49-4863-9f4d-367e67ccafba_euj7h7oi {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:55 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-cdde45d7-08cf-48a2-83b5-f18455533b08 tempest-VolumesSnapshotTestJSON-235515433 None] Created reservations ['fb87f911-cbfe-4812-8dd6-60a963500446', '7eb871bc-d9c1-4fc7-b8a7-3b88a722d1c5', 'c933bd18-649b-43b4-8ba0-bffb52bef02b', '9791a74b-d86c-473e-bc8d-9ac2b3f3b8bb'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:27:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-cdde45d7-08cf-48a2-83b5-f18455533b08 tempest-VolumesSnapshotTestJSON-235515433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:27:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-cdde45d7-08cf-48a2-83b5-f18455533b08 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:27:55 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-cdde45d7-08cf-48a2-83b5-f18455533b08 tempest-VolumesSnapshotTestJSON-235515433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:27:55 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-cdde45d7-08cf-48a2-83b5-f18455533b08 tempest-VolumesSnapshotTestJSON-235515433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:27:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-cdde45d7-08cf-48a2-83b5-f18455533b08 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:27:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cdde45d7-08cf-48a2-83b5-f18455533b08 tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:55 devstack sudo[103920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3671f266-2a49-4863-9f4d-367e67ccafba_euj7h7oi Aug 31 15:27:55 devstack sudo[103920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:55 devstack sudo[103922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:27:55 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:55 devstack sudo[103920]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3671f266-2a49-4863-9f4d-367e67ccafba_euj7h7oi" returned: 0 in 0.355s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3671f266-2a49-4863-9f4d-367e67ccafba_euj7h7oi {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:55 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cdde45d7-08cf-48a2-83b5-f18455533b08 tempest-VolumesSnapshotTestJSON-235515433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.274s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:55 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-cdde45d7-08cf-48a2-83b5-f18455533b08 tempest-VolumesSnapshotTestJSON-235515433 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:27:55 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-cdde45d7-08cf-48a2-83b5-f18455533b08 tempest-VolumesSnapshotTestJSON-235515433 None] Deleted volume successfully. Aug 31 15:27:55 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-cdde45d7-08cf-48a2-83b5-f18455533b08 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-89aa96ba-40d9-41b1-a34f-11fb9d50c5cd-delete_volume" released by "delete_volume" :: held 1.264s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:27:55 devstack sudo[103927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3671f266-2a49-4863-9f4d-367e67ccafba_euj7h7oi Aug 31 15:27:55 devstack sudo[103927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:55 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-da5f423a-f749-4b5e-b322-d9ae2bc6c913 tempest-VolumesSnapshotTestJSON-235515433 None] Acquiring lock "cinder-dcdb029d-2fff-492e-a499-61d430fc62c0-delete_snapshot" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:27:55 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-da5f423a-f749-4b5e-b322-d9ae2bc6c913 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-dcdb029d-2fff-492e-a499-61d430fc62c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:27:55 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-da5f423a-f749-4b5e-b322-d9ae2bc6c913 tempest-VolumesSnapshotTestJSON-235515433 None] Acquiring lock "cinder-quobyte-a571f807-85b0-4ca0-9537-020097f692e5" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:27:55 devstack sudo[103927]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:55 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-da5f423a-f749-4b5e-b322-d9ae2bc6c913 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-quobyte-a571f807-85b0-4ca0-9537-020097f692e5" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:27:55 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-da5f423a-f749-4b5e-b322-d9ae2bc6c913 tempest-VolumesSnapshotTestJSON-235515433 None] Acquiring lock "cinder-quobyte-dcdb029d-2fff-492e-a499-61d430fc62c0" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:27:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3671f266-2a49-4863-9f4d-367e67ccafba_euj7h7oi" returned: 1 in 0.445s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3671f266-2a49-4863-9f4d-367e67ccafba_euj7h7oi' failed. Not Retrying. {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 31 15:27:55 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f2fdcb-df3d-4f28-be66-99bd988040d9]: (4, 'raw') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:27:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3671f266-2a49-4863-9f4d-367e67ccafba_qyrr87z9devstack@QuobyteHD {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:55 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-da5f423a-f749-4b5e-b322-d9ae2bc6c913 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-quobyte-dcdb029d-2fff-492e-a499-61d430fc62c0" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:27:55 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-da5f423a-f749-4b5e-b322-d9ae2bc6c913 tempest-VolumesSnapshotTestJSON-235515433 None] Deleting offline snapshot dcdb029d-2fff-492e-a499-61d430fc62c0 of volume a571f807-85b0-4ca0-9537-020097f692e5 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:27:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-da5f423a-f749-4b5e-b322-d9ae2bc6c913 tempest-VolumesSnapshotTestJSON-235515433 None] snapshot_file for this snap is: volume-a571f807-85b0-4ca0-9537-020097f692e5.dcdb029d-2fff-492e-a499-61d430fc62c0 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:27:56 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[40533f3b-4750-4cf0-8a2a-d20706b1c84e]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:27:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-da5f423a-f749-4b5e-b322-d9ae2bc6c913 tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5.dcdb029d-2fff-492e-a499-61d430fc62c0 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:56 devstack sudo[103931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3671f266-2a49-4863-9f4d-367e67ccafba_qyrr87z9devstack@QuobyteHD Aug 31 15:27:56 devstack sudo[103931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:56 devstack sudo[103932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5.dcdb029d-2fff-492e-a499-61d430fc62c0 Aug 31 15:27:56 devstack sudo[103932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:56 devstack sudo[103931]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3671f266-2a49-4863-9f4d-367e67ccafba_qyrr87z9devstack@QuobyteHD" returned: 0 in 0.367s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3671f266-2a49-4863-9f4d-367e67ccafba_qyrr87z9devstack@QuobyteHD {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:56 devstack sudo[103932]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-da5f423a-f749-4b5e-b322-d9ae2bc6c913 tempest-VolumesSnapshotTestJSON-235515433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5.dcdb029d-2fff-492e-a499-61d430fc62c0" returned: 0 in 0.404s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-da5f423a-f749-4b5e-b322-d9ae2bc6c913 tempest-VolumesSnapshotTestJSON-235515433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a571f807-85b0-4ca0-9537-020097f692e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:27:56 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7c0224-19e0-4ba9-983a-c9126ec319d4]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:27:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-da5f423a-f749-4b5e-b322-d9ae2bc6c913 tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:56 devstack sudo[103938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3671f266-2a49-4863-9f4d-367e67ccafba_qyrr87z9devstack@QuobyteHD Aug 31 15:27:56 devstack sudo[103938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:56 devstack sudo[103941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5 Aug 31 15:27:56 devstack sudo[103941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:56 devstack sudo[103938]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3671f266-2a49-4863-9f4d-367e67ccafba_qyrr87z9devstack@QuobyteHD" returned: 1 in 0.361s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3671f266-2a49-4863-9f4d-367e67ccafba_qyrr87z9devstack@QuobyteHD' failed. Not Retrying. {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 31 15:27:56 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] 3671f266-2a49-4863-9f4d-367e67ccafba was raw, converting to qcow2 {{(pid=86000) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 31 15:27:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3671f266-2a49-4863-9f4d-367e67ccafba_qyrr87z9devstack@QuobyteHD /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-971e270c-e8f0-4bc9-a300-2791df78ea7f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:56 devstack sudo[103948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3671f266-2a49-4863-9f4d-367e67ccafba_qyrr87z9devstack@QuobyteHD /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-971e270c-e8f0-4bc9-a300-2791df78ea7f Aug 31 15:27:56 devstack sudo[103948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:57 devstack sudo[103941]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-da5f423a-f749-4b5e-b322-d9ae2bc6c913 tempest-VolumesSnapshotTestJSON-235515433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5" returned: 0 in 0.678s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-da5f423a-f749-4b5e-b322-d9ae2bc6c913 tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5.dcdb029d-2fff-492e-a499-61d430fc62c0 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:57 devstack sudo[103957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5.dcdb029d-2fff-492e-a499-61d430fc62c0 Aug 31 15:27:57 devstack sudo[103957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:57 devstack sudo[103948]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3671f266-2a49-4863-9f4d-367e67ccafba_qyrr87z9devstack@QuobyteHD /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-971e270c-e8f0-4bc9-a300-2791df78ea7f" returned: 0 in 0.567s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:57 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3671f266-2a49-4863-9f4d-367e67ccafba_qyrr87z9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-971e270c-e8f0-4bc9-a300-2791df78ea7f {{(pid=86000) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 31 15:27:57 devstack cinder-volume[86000]: INFO cinder.image.image_utils [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Converted 0.00 MB image at 0.00 MB/s Aug 31 15:27:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-971e270c-e8f0-4bc9-a300-2791df78ea7f 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:57 devstack sudo[103959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-971e270c-e8f0-4bc9-a300-2791df78ea7f 1G Aug 31 15:27:57 devstack sudo[103959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:57 devstack sudo[103957]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-da5f423a-f749-4b5e-b322-d9ae2bc6c913 tempest-VolumesSnapshotTestJSON-235515433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5.dcdb029d-2fff-492e-a499-61d430fc62c0" returned: 0 in 0.382s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-da5f423a-f749-4b5e-b322-d9ae2bc6c913 tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5.dcdb029d-2fff-492e-a499-61d430fc62c0 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:57 devstack sudo[103966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5.dcdb029d-2fff-492e-a499-61d430fc62c0 Aug 31 15:27:57 devstack sudo[103966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:57 devstack sudo[103959]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-971e270c-e8f0-4bc9-a300-2791df78ea7f 1G" returned: 0 in 0.360s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:57 devstack cinder-volume[86000]: DEBUG cinder.volume.volume_utils [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Downloaded image 3671f266-2a49-4863-9f4d-367e67ccafba ((None, [{'url': 'file:///opt/stack/data/glance/images/3671f266-2a49-4863-9f4d-367e67ccafba', 'metadata': {}}])) to volume 971e270c-e8f0-4bc9-a300-2791df78ea7f successfully. {{(pid=86000) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 31 15:27:57 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Temporary image 3671f266-2a49-4863-9f4d-367e67ccafba for user e85f550855504067bfaad5604621e4d7 is deleted. {{(pid=86000) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 31 15:27:57 devstack cinder-volume[86000]: DEBUG cinder.volume.volume_utils [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Marking volume 971e270c-e8f0-4bc9-a300-2791df78ea7f as bootable. {{(pid=86000) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 31 15:27:57 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Copying metadata from image 3671f266-2a49-4863-9f4d-367e67ccafba to 971e270c-e8f0-4bc9-a300-2791df78ea7f. {{(pid=86000) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 31 15:27:57 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Creating volume glance metadata for volume 971e270c-e8f0-4bc9-a300-2791df78ea7f backed by image 3671f266-2a49-4863-9f4d-367e67ccafba with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '3671f266-2a49-4863-9f4d-367e67ccafba', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'ff6e147d8de6ec57bd018eb3ce5e6c78', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86000) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 31 15:27:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2e90a57-f23c-4fff-a69a-49018403799b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-971e270c-e8f0-4bc9-a300-2791df78ea7f', 'volume_size': 1, 'image_id': '3671f266-2a49-4863-9f4d-367e67ccafba', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3671f266-2a49-4863-9f4d-367e67ccafba', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ff6e147d8de6ec57bd018eb3ce5e6c78', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '531eafe160174b51b83b008b2c71d905', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '85a523a45eb4612be6e4276e9572fb5fa3dfa5bf768eae83ae68876c25f2025c672a419275de424b782ab7c2de66cc298e6dea6465c4dbcfa05fe3625a23ab72', 'id': '3671f266-2a49-4863-9f4d-367e67ccafba', 'created_at': datetime.datetime(2026, 8, 31, 13, 27, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 13, 27, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3671f266-2a49-4863-9f4d-367e67ccafba/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (399ecd56-2632-495a-89c5-e30e851a631a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:27:57 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Volume volume-971e270c-e8f0-4bc9-a300-2791df78ea7f (971e270c-e8f0-4bc9-a300-2791df78ea7f): created successfully Aug 31 15:27:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (399ecd56-2632-495a-89c5-e30e851a631a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:27:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Flow 'volume_create_manager' (8096b64e-dd1f-43bb-b337-29da613f50ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:27:57 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-1889713b-86ca-4800-bcdc-581342dec228 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Created volume successfully. Aug 31 15:27:57 devstack sudo[103966]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-da5f423a-f749-4b5e-b322-d9ae2bc6c913 tempest-VolumesSnapshotTestJSON-235515433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5.dcdb029d-2fff-492e-a499-61d430fc62c0" returned: 0 in 0.294s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:57 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-da5f423a-f749-4b5e-b322-d9ae2bc6c913 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-quobyte-dcdb029d-2fff-492e-a499-61d430fc62c0" released by "_delete_snapshot" :: held 1.869s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:27:57 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-da5f423a-f749-4b5e-b322-d9ae2bc6c913 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-quobyte-a571f807-85b0-4ca0-9537-020097f692e5" released by "delete_snapshot" :: held 1.907s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:27:57 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-da5f423a-f749-4b5e-b322-d9ae2bc6c913 tempest-VolumesSnapshotTestJSON-235515433 None] Created reservations ['0fd4b07b-b49d-44f1-b2e2-2268bd3c5236', '58d76805-4f77-4473-aed9-f3e150f4bc00', 'f3618635-18b4-44ec-ae36-386c1e1d1be0', '1db10e7b-458b-4d03-9f84-990a9d4c1634'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:27:57 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-da5f423a-f749-4b5e-b322-d9ae2bc6c913 tempest-VolumesSnapshotTestJSON-235515433 None] Delete snapshot completed successfully. Aug 31 15:27:57 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-da5f423a-f749-4b5e-b322-d9ae2bc6c913 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-dcdb029d-2fff-492e-a499-61d430fc62c0-delete_snapshot" released by "delete_snapshot" :: held 2.034s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:27:58 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-87b3d827-2368-4f2c-8945-f5643eba90e1 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Acquiring lock "cinder-971e270c-e8f0-4bc9-a300-2791df78ea7f-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:27:58 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6bf9d2f3-98da-4b29-b24e-c0c6571e4f38 tempest-VolumesSnapshotTestJSON-235515433 None] Acquiring lock "cinder-a571f807-85b0-4ca0-9537-020097f692e5-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:27:58 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-87b3d827-2368-4f2c-8945-f5643eba90e1 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Lock "cinder-971e270c-e8f0-4bc9-a300-2791df78ea7f-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:27:58 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6bf9d2f3-98da-4b29-b24e-c0c6571e4f38 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-a571f807-85b0-4ca0-9537-020097f692e5-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:27:58 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6bf9d2f3-98da-4b29-b24e-c0c6571e4f38 tempest-VolumesSnapshotTestJSON-235515433 None] Acquiring lock "cinder-quobyte-a571f807-85b0-4ca0-9537-020097f692e5" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:27:58 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-87b3d827-2368-4f2c-8945-f5643eba90e1 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Acquiring lock "cinder-quobyte-971e270c-e8f0-4bc9-a300-2791df78ea7f" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:27:58 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6bf9d2f3-98da-4b29-b24e-c0c6571e4f38 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-quobyte-a571f807-85b0-4ca0-9537-020097f692e5" acquired by "delete_volume" :: waited 0.023s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:27:58 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-87b3d827-2368-4f2c-8945-f5643eba90e1 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Lock "cinder-quobyte-971e270c-e8f0-4bc9-a300-2791df78ea7f" acquired by "delete_volume" :: waited 0.046s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:27:58 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf8af2f-4441-459f-8aa8-cde4f2e4d503]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:27:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6bf9d2f3-98da-4b29-b24e-c0c6571e4f38 tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:58 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8a213a-e0b7-45f9-b1c3-7e948c3e5a5b]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:27:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-87b3d827-2368-4f2c-8945-f5643eba90e1 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-971e270c-e8f0-4bc9-a300-2791df78ea7f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:58 devstack sudo[103972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5 Aug 31 15:27:58 devstack sudo[103972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:58 devstack sudo[103973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-971e270c-e8f0-4bc9-a300-2791df78ea7f Aug 31 15:27:58 devstack sudo[103973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:58 devstack sudo[103973]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-87b3d827-2368-4f2c-8945-f5643eba90e1 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-971e270c-e8f0-4bc9-a300-2791df78ea7f" returned: 0 in 0.371s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-87b3d827-2368-4f2c-8945-f5643eba90e1 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-971e270c-e8f0-4bc9-a300-2791df78ea7f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:58 devstack sudo[103972]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6bf9d2f3-98da-4b29-b24e-c0c6571e4f38 tempest-VolumesSnapshotTestJSON-235515433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5" returned: 0 in 0.401s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6bf9d2f3-98da-4b29-b24e-c0c6571e4f38 tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:58 devstack sudo[103983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-971e270c-e8f0-4bc9-a300-2791df78ea7f Aug 31 15:27:58 devstack sudo[103983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:58 devstack sudo[103984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5 Aug 31 15:27:58 devstack sudo[103984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:58 devstack sudo[103983]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-87b3d827-2368-4f2c-8945-f5643eba90e1 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-971e270c-e8f0-4bc9-a300-2791df78ea7f" returned: 0 in 0.259s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:59 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-87b3d827-2368-4f2c-8945-f5643eba90e1 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Lock "cinder-quobyte-971e270c-e8f0-4bc9-a300-2791df78ea7f" released by "delete_volume" :: held 0.682s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:27:59 devstack sudo[103984]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6bf9d2f3-98da-4b29-b24e-c0c6571e4f38 tempest-VolumesSnapshotTestJSON-235515433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a571f807-85b0-4ca0-9537-020097f692e5" returned: 0 in 0.281s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:59 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6bf9d2f3-98da-4b29-b24e-c0c6571e4f38 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-quobyte-a571f807-85b0-4ca0-9537-020097f692e5" released by "delete_volume" :: held 0.762s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:27:59 devstack cinder-volume[86000]: WARNING cinder.quota [None req-87b3d827-2368-4f2c-8945-f5643eba90e1 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 31 15:27:59 devstack cinder-volume[86000]: WARNING cinder.quota [None req-87b3d827-2368-4f2c-8945-f5643eba90e1 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 31 15:27:59 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-87b3d827-2368-4f2c-8945-f5643eba90e1 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Created reservations ['83943937-bff7-45a8-b2a8-7728331747ab', '2b57b7b7-6f6c-4bab-af9b-55899ea8a73a', 'e31bb711-0744-4b9a-97a1-2bbe2f410473', '9fd3337b-5145-4c0f-b714-27fd67a3337e'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:27:59 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-6bf9d2f3-98da-4b29-b24e-c0c6571e4f38 tempest-VolumesSnapshotTestJSON-235515433 None] Created reservations ['093dae9b-cba8-47e0-b49c-0398aa18a069', 'ee67b98f-39e4-4cba-8ab6-035b652570a9', '549cd473-437f-4964-85ab-f3ad316606b8', 'b55e2d2d-dad7-41a4-8bc2-da0985673d07'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:27:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-87b3d827-2368-4f2c-8945-f5643eba90e1 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:27:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-87b3d827-2368-4f2c-8945-f5643eba90e1 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:27:59 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-87b3d827-2368-4f2c-8945-f5643eba90e1 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:27:59 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-87b3d827-2368-4f2c-8945-f5643eba90e1 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:27:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-87b3d827-2368-4f2c-8945-f5643eba90e1 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:27:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-87b3d827-2368-4f2c-8945-f5643eba90e1 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:59 devstack sudo[103989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:27:59 devstack sudo[103989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6bf9d2f3-98da-4b29-b24e-c0c6571e4f38 tempest-VolumesSnapshotTestJSON-235515433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:27:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6bf9d2f3-98da-4b29-b24e-c0c6571e4f38 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:27:59 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6bf9d2f3-98da-4b29-b24e-c0c6571e4f38 tempest-VolumesSnapshotTestJSON-235515433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:27:59 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6bf9d2f3-98da-4b29-b24e-c0c6571e4f38 tempest-VolumesSnapshotTestJSON-235515433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:27:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6bf9d2f3-98da-4b29-b24e-c0c6571e4f38 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:27:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6bf9d2f3-98da-4b29-b24e-c0c6571e4f38 tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:59 devstack sudo[103991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:27:59 devstack sudo[103991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:27:59 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e2e4b9c2-c9de-4855-981c-4c0d52719ca3 tempest-VolumesSnapshotTestJSON-235515433 None] Acquiring lock "cinder-721b0665-e589-43b6-92ac-5ea0177998a4-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:27:59 devstack sudo[103989]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-87b3d827-2368-4f2c-8945-f5643eba90e1 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.397s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:59 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-87b3d827-2368-4f2c-8945-f5643eba90e1 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:27:59 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e2e4b9c2-c9de-4855-981c-4c0d52719ca3 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-721b0665-e589-43b6-92ac-5ea0177998a4-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:27:59 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-87b3d827-2368-4f2c-8945-f5643eba90e1 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Deleted volume successfully. Aug 31 15:27:59 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-87b3d827-2368-4f2c-8945-f5643eba90e1 tempest-VolumeAndVolumeTypeFromImageTest-979004083 None] Lock "cinder-971e270c-e8f0-4bc9-a300-2791df78ea7f-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:27:59 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e2e4b9c2-c9de-4855-981c-4c0d52719ca3 tempest-VolumesSnapshotTestJSON-235515433 None] Acquiring lock "cinder-quobyte-721b0665-e589-43b6-92ac-5ea0177998a4" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:27:59 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e2e4b9c2-c9de-4855-981c-4c0d52719ca3 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-quobyte-721b0665-e589-43b6-92ac-5ea0177998a4" acquired by "delete_volume" :: waited 0.027s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:27:59 devstack sudo[103991]: pam_unix(sudo:session): session closed for user root Aug 31 15:27:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6bf9d2f3-98da-4b29-b24e-c0c6571e4f38 tempest-VolumesSnapshotTestJSON-235515433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.502s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:27:59 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-6bf9d2f3-98da-4b29-b24e-c0c6571e4f38 tempest-VolumesSnapshotTestJSON-235515433 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:27:59 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-6bf9d2f3-98da-4b29-b24e-c0c6571e4f38 tempest-VolumesSnapshotTestJSON-235515433 None] Deleted volume successfully. Aug 31 15:27:59 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa40deb-1a25-4e14-89f1-cf2df4bedafe]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:27:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e2e4b9c2-c9de-4855-981c-4c0d52719ca3 tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:27:59 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6bf9d2f3-98da-4b29-b24e-c0c6571e4f38 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-a571f807-85b0-4ca0-9537-020097f692e5-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:27:59 devstack sudo[103996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4 Aug 31 15:27:59 devstack sudo[103996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:00 devstack sudo[103996]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e2e4b9c2-c9de-4855-981c-4c0d52719ca3 tempest-VolumesSnapshotTestJSON-235515433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4" returned: 0 in 0.424s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e2e4b9c2-c9de-4855-981c-4c0d52719ca3 tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:00 devstack sudo[104002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4 Aug 31 15:28:00 devstack sudo[104002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:00 devstack sudo[104002]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e2e4b9c2-c9de-4855-981c-4c0d52719ca3 tempest-VolumesSnapshotTestJSON-235515433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-721b0665-e589-43b6-92ac-5ea0177998a4" returned: 0 in 0.256s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:00 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e2e4b9c2-c9de-4855-981c-4c0d52719ca3 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-quobyte-721b0665-e589-43b6-92ac-5ea0177998a4" released by "delete_volume" :: held 0.773s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:28:00 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-e2e4b9c2-c9de-4855-981c-4c0d52719ca3 tempest-VolumesSnapshotTestJSON-235515433 None] Created reservations ['2364d672-29e8-4a60-bd70-6c92706925b4', '67c2377a-7cd9-40ad-8c7b-4e5fbe5330eb', '3da39337-c77b-445d-8a61-ac78f5d72d0a', '14d22949-211e-4b3f-9fd1-94065c78eaa5'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:28:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e2e4b9c2-c9de-4855-981c-4c0d52719ca3 tempest-VolumesSnapshotTestJSON-235515433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:28:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e2e4b9c2-c9de-4855-981c-4c0d52719ca3 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:28:00 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-e2e4b9c2-c9de-4855-981c-4c0d52719ca3 tempest-VolumesSnapshotTestJSON-235515433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:28:00 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-e2e4b9c2-c9de-4855-981c-4c0d52719ca3 tempest-VolumesSnapshotTestJSON-235515433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:28:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e2e4b9c2-c9de-4855-981c-4c0d52719ca3 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:28:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e2e4b9c2-c9de-4855-981c-4c0d52719ca3 tempest-VolumesSnapshotTestJSON-235515433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:00 devstack sudo[104005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:28:00 devstack sudo[104005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:00 devstack sudo[104005]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e2e4b9c2-c9de-4855-981c-4c0d52719ca3 tempest-VolumesSnapshotTestJSON-235515433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.361s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:00 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-e2e4b9c2-c9de-4855-981c-4c0d52719ca3 tempest-VolumesSnapshotTestJSON-235515433 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:28:00 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-e2e4b9c2-c9de-4855-981c-4c0d52719ca3 tempest-VolumesSnapshotTestJSON-235515433 None] Deleted volume successfully. Aug 31 15:28:01 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e2e4b9c2-c9de-4855-981c-4c0d52719ca3 tempest-VolumesSnapshotTestJSON-235515433 None] Lock "cinder-721b0665-e589-43b6-92ac-5ea0177998a4-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:28:05 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-62df8819-a15b-4446-90ad-857ede920b59 tempest-CreateVolumesFromImageTest-1463302820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:28:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-62df8819-a15b-4446-90ad-857ede920b59 tempest-CreateVolumesFromImageTest-1463302820 None] Flow 'volume_create_manager' (51dacf5f-cf75-44fc-892b-de8455e31dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:28:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-62df8819-a15b-4446-90ad-857ede920b59 tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1937abdb-a7c3-4d72-bfc3-1383675e96d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-62df8819-a15b-4446-90ad-857ede920b59 tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1937abdb-a7c3-4d72-bfc3-1383675e96d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1946130943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ae1ffff-da47-43d3-ad30-1b4a5bb6c5e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54557fdbf5234977b34642bd277cd42e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:28:05Z,use_quota=True,user_id='1e2273aff889464180270edeeacd6c96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-62df8819-a15b-4446-90ad-857ede920b59 tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52b781b1-2f7f-4432-bb07-278c30bb37cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-62df8819-a15b-4446-90ad-857ede920b59 tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52b781b1-2f7f-4432-bb07-278c30bb37cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-62df8819-a15b-4446-90ad-857ede920b59 tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6cc710b-61ef-47c5-84a9-1f4c00fb1697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-62df8819-a15b-4446-90ad-857ede920b59 tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6cc710b-61ef-47c5-84a9-1f4c00fb1697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ae1ffff-da47-43d3-ad30-1b4a5bb6c5e2', 'volume_name': 'volume-2ae1ffff-da47-43d3-ad30-1b4a5bb6c5e2', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-62df8819-a15b-4446-90ad-857ede920b59 tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a79ff18-53da-4432-9305-b6a85933bd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-62df8819-a15b-4446-90ad-857ede920b59 tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a79ff18-53da-4432-9305-b6a85933bd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-62df8819-a15b-4446-90ad-857ede920b59 tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (885a80a1-844e-44a8-88ad-a40fe6276890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:05 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-62df8819-a15b-4446-90ad-857ede920b59 tempest-CreateVolumesFromImageTest-1463302820 None] Volume 2ae1ffff-da47-43d3-ad30-1b4a5bb6c5e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ae1ffff-da47-43d3-ad30-1b4a5bb6c5e2', 'volume_size': 1} Aug 31 15:28:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-62df8819-a15b-4446-90ad-857ede920b59 tempest-CreateVolumesFromImageTest-1463302820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:28:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-62df8819-a15b-4446-90ad-857ede920b59 tempest-CreateVolumesFromImageTest-1463302820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:28:05 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-62df8819-a15b-4446-90ad-857ede920b59 tempest-CreateVolumesFromImageTest-1463302820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1946130943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ae1ffff-da47-43d3-ad30-1b4a5bb6c5e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54557fdbf5234977b34642bd277cd42e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:28:05Z,use_quota=True,user_id='1e2273aff889464180270edeeacd6c96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:28:05 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-62df8819-a15b-4446-90ad-857ede920b59 tempest-CreateVolumesFromImageTest-1463302820 None] Creating volume 2ae1ffff-da47-43d3-ad30-1b4a5bb6c5e2 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:28:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-62df8819-a15b-4446-90ad-857ede920b59 tempest-CreateVolumesFromImageTest-1463302820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:28:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-62df8819-a15b-4446-90ad-857ede920b59 tempest-CreateVolumesFromImageTest-1463302820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:28:05 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-62df8819-a15b-4446-90ad-857ede920b59 tempest-CreateVolumesFromImageTest-1463302820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:28:05 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-62df8819-a15b-4446-90ad-857ede920b59 tempest-CreateVolumesFromImageTest-1463302820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:28:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-62df8819-a15b-4446-90ad-857ede920b59 tempest-CreateVolumesFromImageTest-1463302820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:28:05 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-62df8819-a15b-4446-90ad-857ede920b59 tempest-CreateVolumesFromImageTest-1463302820 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:28:05 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-62df8819-a15b-4446-90ad-857ede920b59 tempest-CreateVolumesFromImageTest-1463302820 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:28:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-62df8819-a15b-4446-90ad-857ede920b59 tempest-CreateVolumesFromImageTest-1463302820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2ae1ffff-da47-43d3-ad30-1b4a5bb6c5e2 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:05 devstack sudo[104010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2ae1ffff-da47-43d3-ad30-1b4a5bb6c5e2 1073741824 Aug 31 15:28:05 devstack sudo[104010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:05 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-84cac8dd-83f9-4100-90f3-20db1833a0d6 tempest-CreateVolumesFromImageTest-1463302820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:28:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-84cac8dd-83f9-4100-90f3-20db1833a0d6 tempest-CreateVolumesFromImageTest-1463302820 None] Flow 'volume_create_manager' (51da67b7-f79d-4e37-aa3d-f415ae9fe041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:28:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-84cac8dd-83f9-4100-90f3-20db1833a0d6 tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b43756c-dfbc-4bbd-8e83-371997506d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-84cac8dd-83f9-4100-90f3-20db1833a0d6 tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b43756c-dfbc-4bbd-8e83-371997506d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1235793773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4580c6ee-e6e7-4e43-85e2-2219408fedb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54557fdbf5234977b34642bd277cd42e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:28:06Z,use_quota=True,user_id='1e2273aff889464180270edeeacd6c96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-84cac8dd-83f9-4100-90f3-20db1833a0d6 tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (250391a3-b1de-4167-aa66-781fa946d8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-84cac8dd-83f9-4100-90f3-20db1833a0d6 tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (250391a3-b1de-4167-aa66-781fa946d8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-84cac8dd-83f9-4100-90f3-20db1833a0d6 tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e835f068-3384-43ed-864f-d5e19c04860c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-84cac8dd-83f9-4100-90f3-20db1833a0d6 tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e835f068-3384-43ed-864f-d5e19c04860c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4580c6ee-e6e7-4e43-85e2-2219408fedb7', 'volume_name': 'volume-4580c6ee-e6e7-4e43-85e2-2219408fedb7', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-84cac8dd-83f9-4100-90f3-20db1833a0d6 tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be1d2fde-2b20-4d92-bb86-776cf356e290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-84cac8dd-83f9-4100-90f3-20db1833a0d6 tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be1d2fde-2b20-4d92-bb86-776cf356e290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-84cac8dd-83f9-4100-90f3-20db1833a0d6 tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e6fb005-aa25-4193-b685-1c059d3ed9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:05 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-84cac8dd-83f9-4100-90f3-20db1833a0d6 tempest-CreateVolumesFromImageTest-1463302820 None] Volume 4580c6ee-e6e7-4e43-85e2-2219408fedb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4580c6ee-e6e7-4e43-85e2-2219408fedb7', 'volume_size': 1} Aug 31 15:28:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-84cac8dd-83f9-4100-90f3-20db1833a0d6 tempest-CreateVolumesFromImageTest-1463302820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:28:06 devstack sudo[104010]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-62df8819-a15b-4446-90ad-857ede920b59 tempest-CreateVolumesFromImageTest-1463302820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2ae1ffff-da47-43d3-ad30-1b4a5bb6c5e2 1073741824" returned: 0 in 0.631s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-62df8819-a15b-4446-90ad-857ede920b59 tempest-CreateVolumesFromImageTest-1463302820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2ae1ffff-da47-43d3-ad30-1b4a5bb6c5e2 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:06 devstack sudo[104017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2ae1ffff-da47-43d3-ad30-1b4a5bb6c5e2 Aug 31 15:28:06 devstack sudo[104017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:06 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1c69f0c-dbab-4d7d-8894-769de94f2e8e tempest-CreateVolumesFromImageTest-1463302820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:28:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e1c69f0c-dbab-4d7d-8894-769de94f2e8e tempest-CreateVolumesFromImageTest-1463302820 None] Flow 'volume_create_manager' (6979fdf6-534d-485b-bf6b-6f387dd3a8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:28:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e1c69f0c-dbab-4d7d-8894-769de94f2e8e tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7843f2-d7b0-4857-9508-9f8689182f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e1c69f0c-dbab-4d7d-8894-769de94f2e8e tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7843f2-d7b0-4857-9508-9f8689182f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1424813123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7693bb41-c177-482e-800a-95a971cdcd82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54557fdbf5234977b34642bd277cd42e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:28:06Z,use_quota=True,user_id='1e2273aff889464180270edeeacd6c96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e1c69f0c-dbab-4d7d-8894-769de94f2e8e tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b12e73fe-a2b8-4887-aefa-fe38cf3ff109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e1c69f0c-dbab-4d7d-8894-769de94f2e8e tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b12e73fe-a2b8-4887-aefa-fe38cf3ff109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e1c69f0c-dbab-4d7d-8894-769de94f2e8e tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e84b9019-f835-4ead-93c5-1cf0e1e7875a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e1c69f0c-dbab-4d7d-8894-769de94f2e8e tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e84b9019-f835-4ead-93c5-1cf0e1e7875a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7693bb41-c177-482e-800a-95a971cdcd82', 'volume_name': 'volume-7693bb41-c177-482e-800a-95a971cdcd82', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e1c69f0c-dbab-4d7d-8894-769de94f2e8e tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6bd6702-4252-4b82-bc17-8872470bf423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e1c69f0c-dbab-4d7d-8894-769de94f2e8e tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6bd6702-4252-4b82-bc17-8872470bf423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e1c69f0c-dbab-4d7d-8894-769de94f2e8e tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ed62a08-f4f5-47bb-93db-d2a929a4ac74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:06 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-e1c69f0c-dbab-4d7d-8894-769de94f2e8e tempest-CreateVolumesFromImageTest-1463302820 None] Volume 7693bb41-c177-482e-800a-95a971cdcd82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7693bb41-c177-482e-800a-95a971cdcd82', 'volume_size': 1} Aug 31 15:28:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e1c69f0c-dbab-4d7d-8894-769de94f2e8e tempest-CreateVolumesFromImageTest-1463302820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:28:06 devstack sudo[104017]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-62df8819-a15b-4446-90ad-857ede920b59 tempest-CreateVolumesFromImageTest-1463302820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2ae1ffff-da47-43d3-ad30-1b4a5bb6c5e2" returned: 0 in 0.378s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:06 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-62df8819-a15b-4446-90ad-857ede920b59 tempest-CreateVolumesFromImageTest-1463302820 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:28:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-62df8819-a15b-4446-90ad-857ede920b59 tempest-CreateVolumesFromImageTest-1463302820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:28:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-84cac8dd-83f9-4100-90f3-20db1833a0d6 tempest-CreateVolumesFromImageTest-1463302820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.630s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:28:06 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-84cac8dd-83f9-4100-90f3-20db1833a0d6 tempest-CreateVolumesFromImageTest-1463302820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1235793773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4580c6ee-e6e7-4e43-85e2-2219408fedb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54557fdbf5234977b34642bd277cd42e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:28:06Z,use_quota=True,user_id='1e2273aff889464180270edeeacd6c96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:28:06 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-84cac8dd-83f9-4100-90f3-20db1833a0d6 tempest-CreateVolumesFromImageTest-1463302820 None] Creating volume 4580c6ee-e6e7-4e43-85e2-2219408fedb7 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:28:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-84cac8dd-83f9-4100-90f3-20db1833a0d6 tempest-CreateVolumesFromImageTest-1463302820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:28:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-84cac8dd-83f9-4100-90f3-20db1833a0d6 tempest-CreateVolumesFromImageTest-1463302820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:28:06 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-84cac8dd-83f9-4100-90f3-20db1833a0d6 tempest-CreateVolumesFromImageTest-1463302820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:28:06 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-84cac8dd-83f9-4100-90f3-20db1833a0d6 tempest-CreateVolumesFromImageTest-1463302820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:28:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-84cac8dd-83f9-4100-90f3-20db1833a0d6 tempest-CreateVolumesFromImageTest-1463302820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:28:06 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-84cac8dd-83f9-4100-90f3-20db1833a0d6 tempest-CreateVolumesFromImageTest-1463302820 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:28:06 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-84cac8dd-83f9-4100-90f3-20db1833a0d6 tempest-CreateVolumesFromImageTest-1463302820 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:28:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-84cac8dd-83f9-4100-90f3-20db1833a0d6 tempest-CreateVolumesFromImageTest-1463302820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4580c6ee-e6e7-4e43-85e2-2219408fedb7 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:06 devstack sudo[104020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4580c6ee-e6e7-4e43-85e2-2219408fedb7 1073741824 Aug 31 15:28:06 devstack sudo[104020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-62df8819-a15b-4446-90ad-857ede920b59 tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (885a80a1-844e-44a8-88ad-a40fe6276890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ae1ffff-da47-43d3-ad30-1b4a5bb6c5e2', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-62df8819-a15b-4446-90ad-857ede920b59 tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bd5b614-7481-4541-9f24-b07f355889d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:06 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-62df8819-a15b-4446-90ad-857ede920b59 tempest-CreateVolumesFromImageTest-1463302820 None] Volume volume-2ae1ffff-da47-43d3-ad30-1b4a5bb6c5e2 (2ae1ffff-da47-43d3-ad30-1b4a5bb6c5e2): created successfully Aug 31 15:28:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-62df8819-a15b-4446-90ad-857ede920b59 tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bd5b614-7481-4541-9f24-b07f355889d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-62df8819-a15b-4446-90ad-857ede920b59 tempest-CreateVolumesFromImageTest-1463302820 None] Flow 'volume_create_manager' (51dacf5f-cf75-44fc-892b-de8455e31dc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:28:06 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-62df8819-a15b-4446-90ad-857ede920b59 tempest-CreateVolumesFromImageTest-1463302820 None] Created volume successfully. Aug 31 15:28:06 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-350fd668-678f-4cf9-abca-ba21bf5fb44c tempest-CreateVolumesFromImageTest-1463302820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:28:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-350fd668-678f-4cf9-abca-ba21bf5fb44c tempest-CreateVolumesFromImageTest-1463302820 None] Flow 'volume_create_manager' (31423c1d-5051-4bab-9459-dd3f4f267b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:28:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-350fd668-678f-4cf9-abca-ba21bf5fb44c tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5165dd0e-1b01-42ee-aff0-183b37fe8c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-350fd668-678f-4cf9-abca-ba21bf5fb44c tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5165dd0e-1b01-42ee-aff0-183b37fe8c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1313970770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af27f5bc-d86c-4518-bf81-09e133add3a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54557fdbf5234977b34642bd277cd42e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:28:07Z,use_quota=True,user_id='1e2273aff889464180270edeeacd6c96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-350fd668-678f-4cf9-abca-ba21bf5fb44c tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65baacff-a92e-4e30-b617-c5ebd4c1749b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-350fd668-678f-4cf9-abca-ba21bf5fb44c tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65baacff-a92e-4e30-b617-c5ebd4c1749b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-350fd668-678f-4cf9-abca-ba21bf5fb44c tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0b189b9-cbf9-4ce0-a764-ec328c8c5eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-350fd668-678f-4cf9-abca-ba21bf5fb44c tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0b189b9-cbf9-4ce0-a764-ec328c8c5eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af27f5bc-d86c-4518-bf81-09e133add3a6', 'volume_name': 'volume-af27f5bc-d86c-4518-bf81-09e133add3a6', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-350fd668-678f-4cf9-abca-ba21bf5fb44c tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2467b89-673f-474e-b07f-d7b04feb4c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-350fd668-678f-4cf9-abca-ba21bf5fb44c tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2467b89-673f-474e-b07f-d7b04feb4c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-350fd668-678f-4cf9-abca-ba21bf5fb44c tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (321e9606-1daf-4e25-b46e-5196d277cd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:06 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-350fd668-678f-4cf9-abca-ba21bf5fb44c tempest-CreateVolumesFromImageTest-1463302820 None] Volume af27f5bc-d86c-4518-bf81-09e133add3a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af27f5bc-d86c-4518-bf81-09e133add3a6', 'volume_size': 1} Aug 31 15:28:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-350fd668-678f-4cf9-abca-ba21bf5fb44c tempest-CreateVolumesFromImageTest-1463302820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:28:07 devstack sudo[104020]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-84cac8dd-83f9-4100-90f3-20db1833a0d6 tempest-CreateVolumesFromImageTest-1463302820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4580c6ee-e6e7-4e43-85e2-2219408fedb7 1073741824" returned: 0 in 0.555s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-84cac8dd-83f9-4100-90f3-20db1833a0d6 tempest-CreateVolumesFromImageTest-1463302820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4580c6ee-e6e7-4e43-85e2-2219408fedb7 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:07 devstack sudo[104026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4580c6ee-e6e7-4e43-85e2-2219408fedb7 Aug 31 15:28:07 devstack sudo[104026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:07 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-23d23409-ec3a-4c1d-8f0d-7646c792c981 tempest-CreateVolumesFromImageTest-1463302820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:28:07 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-23d23409-ec3a-4c1d-8f0d-7646c792c981 tempest-CreateVolumesFromImageTest-1463302820 None] Flow 'volume_create_manager' (d7233f11-0885-444b-9180-5e21499c2d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:28:07 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-23d23409-ec3a-4c1d-8f0d-7646c792c981 tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (000f0c90-cb8c-4d5d-ac69-9667f8f6edb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:07 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-23d23409-ec3a-4c1d-8f0d-7646c792c981 tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (000f0c90-cb8c-4d5d-ac69-9667f8f6edb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:28:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-351783360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a381c01a-9e93-4fae-9ea7-86a74bd4d718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54557fdbf5234977b34642bd277cd42e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:28:07Z,use_quota=True,user_id='1e2273aff889464180270edeeacd6c96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:07 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-23d23409-ec3a-4c1d-8f0d-7646c792c981 tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d16df402-829b-40b6-b15a-8aa65349b9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:07 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-23d23409-ec3a-4c1d-8f0d-7646c792c981 tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d16df402-829b-40b6-b15a-8aa65349b9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:07 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-23d23409-ec3a-4c1d-8f0d-7646c792c981 tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ace41e-d0ae-4c46-98b6-eec3dcbc3508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:07 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-23d23409-ec3a-4c1d-8f0d-7646c792c981 tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ace41e-d0ae-4c46-98b6-eec3dcbc3508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a381c01a-9e93-4fae-9ea7-86a74bd4d718', 'volume_name': 'volume-a381c01a-9e93-4fae-9ea7-86a74bd4d718', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:07 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-23d23409-ec3a-4c1d-8f0d-7646c792c981 tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (347aead0-1311-46c5-856f-066a1a23b4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:07 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-23d23409-ec3a-4c1d-8f0d-7646c792c981 tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (347aead0-1311-46c5-856f-066a1a23b4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:07 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-23d23409-ec3a-4c1d-8f0d-7646c792c981 tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f31645a-93cd-4f38-8830-aafbd298c109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:07 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-23d23409-ec3a-4c1d-8f0d-7646c792c981 tempest-CreateVolumesFromImageTest-1463302820 None] Volume a381c01a-9e93-4fae-9ea7-86a74bd4d718: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a381c01a-9e93-4fae-9ea7-86a74bd4d718', 'volume_size': 1} Aug 31 15:28:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-23d23409-ec3a-4c1d-8f0d-7646c792c981 tempest-CreateVolumesFromImageTest-1463302820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:28:07 devstack sudo[104026]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-84cac8dd-83f9-4100-90f3-20db1833a0d6 tempest-CreateVolumesFromImageTest-1463302820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4580c6ee-e6e7-4e43-85e2-2219408fedb7" returned: 0 in 0.284s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:07 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-84cac8dd-83f9-4100-90f3-20db1833a0d6 tempest-CreateVolumesFromImageTest-1463302820 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:28:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-84cac8dd-83f9-4100-90f3-20db1833a0d6 tempest-CreateVolumesFromImageTest-1463302820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:28:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e1c69f0c-dbab-4d7d-8894-769de94f2e8e tempest-CreateVolumesFromImageTest-1463302820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.040s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:28:07 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-e1c69f0c-dbab-4d7d-8894-769de94f2e8e tempest-CreateVolumesFromImageTest-1463302820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1424813123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7693bb41-c177-482e-800a-95a971cdcd82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54557fdbf5234977b34642bd277cd42e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:28:06Z,use_quota=True,user_id='1e2273aff889464180270edeeacd6c96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:28:07 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-e1c69f0c-dbab-4d7d-8894-769de94f2e8e tempest-CreateVolumesFromImageTest-1463302820 None] Creating volume 7693bb41-c177-482e-800a-95a971cdcd82 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:28:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e1c69f0c-dbab-4d7d-8894-769de94f2e8e tempest-CreateVolumesFromImageTest-1463302820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:28:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e1c69f0c-dbab-4d7d-8894-769de94f2e8e tempest-CreateVolumesFromImageTest-1463302820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:28:07 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-e1c69f0c-dbab-4d7d-8894-769de94f2e8e tempest-CreateVolumesFromImageTest-1463302820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:28:07 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-e1c69f0c-dbab-4d7d-8894-769de94f2e8e tempest-CreateVolumesFromImageTest-1463302820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:28:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e1c69f0c-dbab-4d7d-8894-769de94f2e8e tempest-CreateVolumesFromImageTest-1463302820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:28:07 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-e1c69f0c-dbab-4d7d-8894-769de94f2e8e tempest-CreateVolumesFromImageTest-1463302820 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:28:07 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-e1c69f0c-dbab-4d7d-8894-769de94f2e8e tempest-CreateVolumesFromImageTest-1463302820 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:28:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e1c69f0c-dbab-4d7d-8894-769de94f2e8e tempest-CreateVolumesFromImageTest-1463302820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7693bb41-c177-482e-800a-95a971cdcd82 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:07 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-84cac8dd-83f9-4100-90f3-20db1833a0d6 tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e6fb005-aa25-4193-b685-1c059d3ed9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4580c6ee-e6e7-4e43-85e2-2219408fedb7', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:07 devstack sudo[104029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7693bb41-c177-482e-800a-95a971cdcd82 1073741824 Aug 31 15:28:07 devstack sudo[104029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:07 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-84cac8dd-83f9-4100-90f3-20db1833a0d6 tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8123ea24-30e1-431d-958a-bf05a3cf6283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:07 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-84cac8dd-83f9-4100-90f3-20db1833a0d6 tempest-CreateVolumesFromImageTest-1463302820 None] Volume volume-4580c6ee-e6e7-4e43-85e2-2219408fedb7 (4580c6ee-e6e7-4e43-85e2-2219408fedb7): created successfully Aug 31 15:28:07 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-84cac8dd-83f9-4100-90f3-20db1833a0d6 tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8123ea24-30e1-431d-958a-bf05a3cf6283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:07 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-84cac8dd-83f9-4100-90f3-20db1833a0d6 tempest-CreateVolumesFromImageTest-1463302820 None] Flow 'volume_create_manager' (51da67b7-f79d-4e37-aa3d-f415ae9fe041) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:28:07 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-84cac8dd-83f9-4100-90f3-20db1833a0d6 tempest-CreateVolumesFromImageTest-1463302820 None] Created volume successfully. Aug 31 15:28:07 devstack sudo[104029]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e1c69f0c-dbab-4d7d-8894-769de94f2e8e tempest-CreateVolumesFromImageTest-1463302820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7693bb41-c177-482e-800a-95a971cdcd82 1073741824" returned: 0 in 0.479s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e1c69f0c-dbab-4d7d-8894-769de94f2e8e tempest-CreateVolumesFromImageTest-1463302820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7693bb41-c177-482e-800a-95a971cdcd82 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:07 devstack sudo[104035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7693bb41-c177-482e-800a-95a971cdcd82 Aug 31 15:28:07 devstack sudo[104035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:08 devstack sudo[104035]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e1c69f0c-dbab-4d7d-8894-769de94f2e8e tempest-CreateVolumesFromImageTest-1463302820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7693bb41-c177-482e-800a-95a971cdcd82" returned: 0 in 0.268s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:08 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-e1c69f0c-dbab-4d7d-8894-769de94f2e8e tempest-CreateVolumesFromImageTest-1463302820 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:28:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e1c69f0c-dbab-4d7d-8894-769de94f2e8e tempest-CreateVolumesFromImageTest-1463302820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:28:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-350fd668-678f-4cf9-abca-ba21bf5fb44c tempest-CreateVolumesFromImageTest-1463302820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.429s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:28:08 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-350fd668-678f-4cf9-abca-ba21bf5fb44c tempest-CreateVolumesFromImageTest-1463302820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1313970770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af27f5bc-d86c-4518-bf81-09e133add3a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54557fdbf5234977b34642bd277cd42e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:28:07Z,use_quota=True,user_id='1e2273aff889464180270edeeacd6c96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:28:08 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-350fd668-678f-4cf9-abca-ba21bf5fb44c tempest-CreateVolumesFromImageTest-1463302820 None] Creating volume af27f5bc-d86c-4518-bf81-09e133add3a6 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:28:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-350fd668-678f-4cf9-abca-ba21bf5fb44c tempest-CreateVolumesFromImageTest-1463302820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:28:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-350fd668-678f-4cf9-abca-ba21bf5fb44c tempest-CreateVolumesFromImageTest-1463302820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:28:08 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-350fd668-678f-4cf9-abca-ba21bf5fb44c tempest-CreateVolumesFromImageTest-1463302820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:28:08 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-350fd668-678f-4cf9-abca-ba21bf5fb44c tempest-CreateVolumesFromImageTest-1463302820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:28:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-350fd668-678f-4cf9-abca-ba21bf5fb44c tempest-CreateVolumesFromImageTest-1463302820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:28:08 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-350fd668-678f-4cf9-abca-ba21bf5fb44c tempest-CreateVolumesFromImageTest-1463302820 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:28:08 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-350fd668-678f-4cf9-abca-ba21bf5fb44c tempest-CreateVolumesFromImageTest-1463302820 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:28:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-350fd668-678f-4cf9-abca-ba21bf5fb44c tempest-CreateVolumesFromImageTest-1463302820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-af27f5bc-d86c-4518-bf81-09e133add3a6 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:08 devstack sudo[104038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-af27f5bc-d86c-4518-bf81-09e133add3a6 1073741824 Aug 31 15:28:08 devstack sudo[104038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:08 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e1c69f0c-dbab-4d7d-8894-769de94f2e8e tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ed62a08-f4f5-47bb-93db-d2a929a4ac74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7693bb41-c177-482e-800a-95a971cdcd82', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:08 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e1c69f0c-dbab-4d7d-8894-769de94f2e8e tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae316f88-c37a-4516-bda7-3cc194dc60b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:08 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-e1c69f0c-dbab-4d7d-8894-769de94f2e8e tempest-CreateVolumesFromImageTest-1463302820 None] Volume volume-7693bb41-c177-482e-800a-95a971cdcd82 (7693bb41-c177-482e-800a-95a971cdcd82): created successfully Aug 31 15:28:08 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e1c69f0c-dbab-4d7d-8894-769de94f2e8e tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae316f88-c37a-4516-bda7-3cc194dc60b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:08 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-e1c69f0c-dbab-4d7d-8894-769de94f2e8e tempest-CreateVolumesFromImageTest-1463302820 None] Flow 'volume_create_manager' (6979fdf6-534d-485b-bf6b-6f387dd3a8ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:28:08 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-e1c69f0c-dbab-4d7d-8894-769de94f2e8e tempest-CreateVolumesFromImageTest-1463302820 None] Created volume successfully. Aug 31 15:28:08 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4698211-5e53-4bd7-b155-24ed741ca486 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:28:08 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-d4698211-5e53-4bd7-b155-24ed741ca486 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Flow 'volume_create_manager' (a04a3172-5967-46b3-aecc-ed26bfebacb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:28:08 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-d4698211-5e53-4bd7-b155-24ed741ca486 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9594fbb6-bc0c-4e0f-8221-2cfa2e4986db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:08 devstack sudo[104038]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-350fd668-678f-4cf9-abca-ba21bf5fb44c tempest-CreateVolumesFromImageTest-1463302820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-af27f5bc-d86c-4518-bf81-09e133add3a6 1073741824" returned: 0 in 0.467s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:08 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-d4698211-5e53-4bd7-b155-24ed741ca486 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9594fbb6-bc0c-4e0f-8221-2cfa2e4986db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-881338337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14ae2a90-4975-4c2a-8b3c-fc6e21edd413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2af73b445da4fd685eaf7021b74b5f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:28:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:28:09Z,use_quota=True,user_id='82cb486e63e848f1948d157132fb8006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:08 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-d4698211-5e53-4bd7-b155-24ed741ca486 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4af0cc3e-0939-4158-a283-31e837e40347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:08 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-d4698211-5e53-4bd7-b155-24ed741ca486 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4af0cc3e-0939-4158-a283-31e837e40347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:08 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-d4698211-5e53-4bd7-b155-24ed741ca486 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddeaff8e-842a-49f0-b0ea-5536d1e15c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:08 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-d4698211-5e53-4bd7-b155-24ed741ca486 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddeaff8e-842a-49f0-b0ea-5536d1e15c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14ae2a90-4975-4c2a-8b3c-fc6e21edd413', 'volume_name': 'volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413', 'volume_size': 2}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:08 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-d4698211-5e53-4bd7-b155-24ed741ca486 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58ee33ff-3e0e-4b89-beae-d4e0c282bf71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:08 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-d4698211-5e53-4bd7-b155-24ed741ca486 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58ee33ff-3e0e-4b89-beae-d4e0c282bf71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:08 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-d4698211-5e53-4bd7-b155-24ed741ca486 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ee3187b-9b2d-4162-90bb-a101f708f893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:08 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-d4698211-5e53-4bd7-b155-24ed741ca486 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Volume 14ae2a90-4975-4c2a-8b3c-fc6e21edd413: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413', 'volume_size': 2} Aug 31 15:28:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-d4698211-5e53-4bd7-b155-24ed741ca486 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:28:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-350fd668-678f-4cf9-abca-ba21bf5fb44c tempest-CreateVolumesFromImageTest-1463302820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-af27f5bc-d86c-4518-bf81-09e133add3a6 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:08 devstack sudo[104044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-af27f5bc-d86c-4518-bf81-09e133add3a6 Aug 31 15:28:08 devstack sudo[104044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:09 devstack sudo[104044]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-350fd668-678f-4cf9-abca-ba21bf5fb44c tempest-CreateVolumesFromImageTest-1463302820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-af27f5bc-d86c-4518-bf81-09e133add3a6" returned: 0 in 0.249s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:09 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-350fd668-678f-4cf9-abca-ba21bf5fb44c tempest-CreateVolumesFromImageTest-1463302820 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:28:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-350fd668-678f-4cf9-abca-ba21bf5fb44c tempest-CreateVolumesFromImageTest-1463302820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:28:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-23d23409-ec3a-4c1d-8f0d-7646c792c981 tempest-CreateVolumesFromImageTest-1463302820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.749s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:28:09 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-23d23409-ec3a-4c1d-8f0d-7646c792c981 tempest-CreateVolumesFromImageTest-1463302820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:28:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-351783360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a381c01a-9e93-4fae-9ea7-86a74bd4d718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54557fdbf5234977b34642bd277cd42e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:28:07Z,use_quota=True,user_id='1e2273aff889464180270edeeacd6c96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:28:09 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-23d23409-ec3a-4c1d-8f0d-7646c792c981 tempest-CreateVolumesFromImageTest-1463302820 None] Creating volume a381c01a-9e93-4fae-9ea7-86a74bd4d718 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:28:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-23d23409-ec3a-4c1d-8f0d-7646c792c981 tempest-CreateVolumesFromImageTest-1463302820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:28:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-23d23409-ec3a-4c1d-8f0d-7646c792c981 tempest-CreateVolumesFromImageTest-1463302820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:28:09 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-23d23409-ec3a-4c1d-8f0d-7646c792c981 tempest-CreateVolumesFromImageTest-1463302820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:28:09 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-23d23409-ec3a-4c1d-8f0d-7646c792c981 tempest-CreateVolumesFromImageTest-1463302820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:28:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-23d23409-ec3a-4c1d-8f0d-7646c792c981 tempest-CreateVolumesFromImageTest-1463302820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:28:09 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-23d23409-ec3a-4c1d-8f0d-7646c792c981 tempest-CreateVolumesFromImageTest-1463302820 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:28:09 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-23d23409-ec3a-4c1d-8f0d-7646c792c981 tempest-CreateVolumesFromImageTest-1463302820 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:28:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-23d23409-ec3a-4c1d-8f0d-7646c792c981 tempest-CreateVolumesFromImageTest-1463302820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a381c01a-9e93-4fae-9ea7-86a74bd4d718 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:09 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-350fd668-678f-4cf9-abca-ba21bf5fb44c tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (321e9606-1daf-4e25-b46e-5196d277cd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af27f5bc-d86c-4518-bf81-09e133add3a6', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:09 devstack sudo[104047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a381c01a-9e93-4fae-9ea7-86a74bd4d718 1073741824 Aug 31 15:28:09 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-350fd668-678f-4cf9-abca-ba21bf5fb44c tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (059b90a3-d4de-4779-9f5e-8f6d1ccfdb5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:09 devstack sudo[104047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:09 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-350fd668-678f-4cf9-abca-ba21bf5fb44c tempest-CreateVolumesFromImageTest-1463302820 None] Volume volume-af27f5bc-d86c-4518-bf81-09e133add3a6 (af27f5bc-d86c-4518-bf81-09e133add3a6): created successfully Aug 31 15:28:09 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-350fd668-678f-4cf9-abca-ba21bf5fb44c tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (059b90a3-d4de-4779-9f5e-8f6d1ccfdb5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:09 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-350fd668-678f-4cf9-abca-ba21bf5fb44c tempest-CreateVolumesFromImageTest-1463302820 None] Flow 'volume_create_manager' (31423c1d-5051-4bab-9459-dd3f4f267b33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:28:09 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-350fd668-678f-4cf9-abca-ba21bf5fb44c tempest-CreateVolumesFromImageTest-1463302820 None] Created volume successfully. Aug 31 15:28:09 devstack sudo[104047]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-23d23409-ec3a-4c1d-8f0d-7646c792c981 tempest-CreateVolumesFromImageTest-1463302820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a381c01a-9e93-4fae-9ea7-86a74bd4d718 1073741824" returned: 0 in 0.434s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-23d23409-ec3a-4c1d-8f0d-7646c792c981 tempest-CreateVolumesFromImageTest-1463302820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a381c01a-9e93-4fae-9ea7-86a74bd4d718 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:09 devstack sudo[104053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a381c01a-9e93-4fae-9ea7-86a74bd4d718 Aug 31 15:28:09 devstack sudo[104053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:09 devstack sudo[104053]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-23d23409-ec3a-4c1d-8f0d-7646c792c981 tempest-CreateVolumesFromImageTest-1463302820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a381c01a-9e93-4fae-9ea7-86a74bd4d718" returned: 0 in 0.243s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:09 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-23d23409-ec3a-4c1d-8f0d-7646c792c981 tempest-CreateVolumesFromImageTest-1463302820 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:28:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-23d23409-ec3a-4c1d-8f0d-7646c792c981 tempest-CreateVolumesFromImageTest-1463302820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:28:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-d4698211-5e53-4bd7-b155-24ed741ca486 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.005s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:28:09 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-d4698211-5e53-4bd7-b155-24ed741ca486 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-881338337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14ae2a90-4975-4c2a-8b3c-fc6e21edd413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2af73b445da4fd685eaf7021b74b5f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:28:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:28:09Z,use_quota=True,user_id='82cb486e63e848f1948d157132fb8006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:28:09 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-d4698211-5e53-4bd7-b155-24ed741ca486 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Creating volume 14ae2a90-4975-4c2a-8b3c-fc6e21edd413 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:28:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-d4698211-5e53-4bd7-b155-24ed741ca486 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:28:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-d4698211-5e53-4bd7-b155-24ed741ca486 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:28:09 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-d4698211-5e53-4bd7-b155-24ed741ca486 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:28:09 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-d4698211-5e53-4bd7-b155-24ed741ca486 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:28:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-d4698211-5e53-4bd7-b155-24ed741ca486 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:28:09 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-d4698211-5e53-4bd7-b155-24ed741ca486 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:28:09 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-d4698211-5e53-4bd7-b155-24ed741ca486 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:28:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d4698211-5e53-4bd7-b155-24ed741ca486 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413 2147483648 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:09 devstack sudo[104056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413 2147483648 Aug 31 15:28:09 devstack sudo[104056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:09 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-23d23409-ec3a-4c1d-8f0d-7646c792c981 tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f31645a-93cd-4f38-8830-aafbd298c109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a381c01a-9e93-4fae-9ea7-86a74bd4d718', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:09 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-23d23409-ec3a-4c1d-8f0d-7646c792c981 tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2618a5f-6d38-4d2f-b62c-e1e2077cfc2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:09 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-23d23409-ec3a-4c1d-8f0d-7646c792c981 tempest-CreateVolumesFromImageTest-1463302820 None] Volume volume-a381c01a-9e93-4fae-9ea7-86a74bd4d718 (a381c01a-9e93-4fae-9ea7-86a74bd4d718): created successfully Aug 31 15:28:09 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-23d23409-ec3a-4c1d-8f0d-7646c792c981 tempest-CreateVolumesFromImageTest-1463302820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2618a5f-6d38-4d2f-b62c-e1e2077cfc2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:09 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-23d23409-ec3a-4c1d-8f0d-7646c792c981 tempest-CreateVolumesFromImageTest-1463302820 None] Flow 'volume_create_manager' (d7233f11-0885-444b-9180-5e21499c2d10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:28:09 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-23d23409-ec3a-4c1d-8f0d-7646c792c981 tempest-CreateVolumesFromImageTest-1463302820 None] Created volume successfully. Aug 31 15:28:10 devstack sudo[104056]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d4698211-5e53-4bd7-b155-24ed741ca486 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413 2147483648" returned: 0 in 0.460s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d4698211-5e53-4bd7-b155-24ed741ca486 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:10 devstack sudo[104063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413 Aug 31 15:28:10 devstack sudo[104063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:10 devstack sudo[104063]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d4698211-5e53-4bd7-b155-24ed741ca486 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413" returned: 0 in 0.250s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:10 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-d4698211-5e53-4bd7-b155-24ed741ca486 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:28:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-d4698211-5e53-4bd7-b155-24ed741ca486 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:28:10 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-d4698211-5e53-4bd7-b155-24ed741ca486 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ee3187b-9b2d-4162-90bb-a101f708f893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413', 'volume_size': 2}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:10 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-d4698211-5e53-4bd7-b155-24ed741ca486 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b39fbec0-5f79-4052-a744-894c9665bc28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:10 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-d4698211-5e53-4bd7-b155-24ed741ca486 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Volume volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413 (14ae2a90-4975-4c2a-8b3c-fc6e21edd413): created successfully Aug 31 15:28:10 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-d4698211-5e53-4bd7-b155-24ed741ca486 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b39fbec0-5f79-4052-a744-894c9665bc28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:10 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-d4698211-5e53-4bd7-b155-24ed741ca486 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Flow 'volume_create_manager' (a04a3172-5967-46b3-aecc-ed26bfebacb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:28:10 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-d4698211-5e53-4bd7-b155-24ed741ca486 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Created volume successfully. Aug 31 15:28:10 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-0b268d8d-563d-46e6-9da2-60fc3c4bd6ba tempest-CreateVolumesFromImageTest-1463302820 None] Acquiring lock "cinder-a381c01a-9e93-4fae-9ea7-86a74bd4d718-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:28:10 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-0b268d8d-563d-46e6-9da2-60fc3c4bd6ba tempest-CreateVolumesFromImageTest-1463302820 None] Lock "cinder-a381c01a-9e93-4fae-9ea7-86a74bd4d718-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:28:10 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-0b268d8d-563d-46e6-9da2-60fc3c4bd6ba tempest-CreateVolumesFromImageTest-1463302820 None] Acquiring lock "cinder-quobyte-a381c01a-9e93-4fae-9ea7-86a74bd4d718" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:28:10 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-0b268d8d-563d-46e6-9da2-60fc3c4bd6ba tempest-CreateVolumesFromImageTest-1463302820 None] Lock "cinder-quobyte-a381c01a-9e93-4fae-9ea7-86a74bd4d718" acquired by "delete_volume" :: waited 0.014s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:28:10 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[77227a81-72da-4086-acd9-66e6a128e217]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:28:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0b268d8d-563d-46e6-9da2-60fc3c4bd6ba tempest-CreateVolumesFromImageTest-1463302820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a381c01a-9e93-4fae-9ea7-86a74bd4d718 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:10 devstack sudo[104066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a381c01a-9e93-4fae-9ea7-86a74bd4d718 Aug 31 15:28:10 devstack sudo[104066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-a23305d0-d03e-41f1-bf17-68ba0f4b3f29 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:28:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-a23305d0-d03e-41f1-bf17-68ba0f4b3f29 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:28:10 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-a23305d0-d03e-41f1-bf17-68ba0f4b3f29 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Creating offline snapshot 146f0b9e-2680-41a8-a0fb-d9d3cecbd481 of volume 14ae2a90-4975-4c2a-8b3c-fc6e21edd413 {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:28:10 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d809a7a-d422-4743-9d74-46fc4270ff9f]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:28:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a23305d0-d03e-41f1-bf17-68ba0f4b3f29 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:11 devstack sudo[104068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413 Aug 31 15:28:11 devstack sudo[104068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:11 devstack sudo[104066]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0b268d8d-563d-46e6-9da2-60fc3c4bd6ba tempest-CreateVolumesFromImageTest-1463302820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a381c01a-9e93-4fae-9ea7-86a74bd4d718" returned: 0 in 0.395s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0b268d8d-563d-46e6-9da2-60fc3c4bd6ba tempest-CreateVolumesFromImageTest-1463302820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a381c01a-9e93-4fae-9ea7-86a74bd4d718 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:11 devstack sudo[104073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a381c01a-9e93-4fae-9ea7-86a74bd4d718 Aug 31 15:28:11 devstack sudo[104073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:11 devstack sudo[104068]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a23305d0-d03e-41f1-bf17-68ba0f4b3f29 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413" returned: 0 in 0.368s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a23305d0-d03e-41f1-bf17-68ba0f4b3f29 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413.146f0b9e-2680-41a8-a0fb-d9d3cecbd481 2G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:11 devstack sudo[104073]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0b268d8d-563d-46e6-9da2-60fc3c4bd6ba tempest-CreateVolumesFromImageTest-1463302820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a381c01a-9e93-4fae-9ea7-86a74bd4d718" returned: 0 in 0.256s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:11 devstack sudo[104079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413.146f0b9e-2680-41a8-a0fb-d9d3cecbd481 2G Aug 31 15:28:11 devstack sudo[104079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:11 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-0b268d8d-563d-46e6-9da2-60fc3c4bd6ba tempest-CreateVolumesFromImageTest-1463302820 None] Lock "cinder-quobyte-a381c01a-9e93-4fae-9ea7-86a74bd4d718" released by "delete_volume" :: held 0.691s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:28:11 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-0b268d8d-563d-46e6-9da2-60fc3c4bd6ba tempest-CreateVolumesFromImageTest-1463302820 None] Created reservations ['f5ba5d4a-54ed-4350-92ff-6fde892225a6', '872102bf-0c81-4ee5-940b-54683beb8f58', '929a46ef-acba-492d-b6d7-b09a2ac2e57c', '187f60e2-5829-4df2-a5e6-dc6b423de0fc'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:28:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-0b268d8d-563d-46e6-9da2-60fc3c4bd6ba tempest-CreateVolumesFromImageTest-1463302820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:28:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-0b268d8d-563d-46e6-9da2-60fc3c4bd6ba tempest-CreateVolumesFromImageTest-1463302820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:28:11 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-0b268d8d-563d-46e6-9da2-60fc3c4bd6ba tempest-CreateVolumesFromImageTest-1463302820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:28:11 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-0b268d8d-563d-46e6-9da2-60fc3c4bd6ba tempest-CreateVolumesFromImageTest-1463302820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:28:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-0b268d8d-563d-46e6-9da2-60fc3c4bd6ba tempest-CreateVolumesFromImageTest-1463302820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:28:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0b268d8d-563d-46e6-9da2-60fc3c4bd6ba tempest-CreateVolumesFromImageTest-1463302820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:11 devstack sudo[104081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:28:11 devstack sudo[104081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:11 devstack sudo[104079]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a23305d0-d03e-41f1-bf17-68ba0f4b3f29 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413.146f0b9e-2680-41a8-a0fb-d9d3cecbd481 2G" returned: 0 in 0.418s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a23305d0-d03e-41f1-bf17-68ba0f4b3f29 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413.146f0b9e-2680-41a8-a0fb-d9d3cecbd481 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:11 devstack sudo[104081]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0b268d8d-563d-46e6-9da2-60fc3c4bd6ba tempest-CreateVolumesFromImageTest-1463302820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.283s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:11 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-0b268d8d-563d-46e6-9da2-60fc3c4bd6ba tempest-CreateVolumesFromImageTest-1463302820 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:28:11 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-0b268d8d-563d-46e6-9da2-60fc3c4bd6ba tempest-CreateVolumesFromImageTest-1463302820 None] Deleted volume successfully. Aug 31 15:28:11 devstack sudo[104087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413.146f0b9e-2680-41a8-a0fb-d9d3cecbd481 Aug 31 15:28:11 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-2dd67f81-fb59-4d5d-a7d7-4a8a6912d8ac tempest-CreateVolumesFromImageTest-1463302820 None] Acquiring lock "cinder-af27f5bc-d86c-4518-bf81-09e133add3a6-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:28:11 devstack sudo[104087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:11 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-2dd67f81-fb59-4d5d-a7d7-4a8a6912d8ac tempest-CreateVolumesFromImageTest-1463302820 None] Lock "cinder-af27f5bc-d86c-4518-bf81-09e133add3a6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:28:11 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-0b268d8d-563d-46e6-9da2-60fc3c4bd6ba tempest-CreateVolumesFromImageTest-1463302820 None] Lock "cinder-a381c01a-9e93-4fae-9ea7-86a74bd4d718-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:28:11 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-2dd67f81-fb59-4d5d-a7d7-4a8a6912d8ac tempest-CreateVolumesFromImageTest-1463302820 None] Acquiring lock "cinder-quobyte-af27f5bc-d86c-4518-bf81-09e133add3a6" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:28:11 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-2dd67f81-fb59-4d5d-a7d7-4a8a6912d8ac tempest-CreateVolumesFromImageTest-1463302820 None] Lock "cinder-quobyte-af27f5bc-d86c-4518-bf81-09e133add3a6" acquired by "delete_volume" :: waited 0.020s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:28:11 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8e3f6b-a88c-4a01-819e-4f51c35b9c38]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:28:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2dd67f81-fb59-4d5d-a7d7-4a8a6912d8ac tempest-CreateVolumesFromImageTest-1463302820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-af27f5bc-d86c-4518-bf81-09e133add3a6 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:12 devstack sudo[104089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-af27f5bc-d86c-4518-bf81-09e133add3a6 Aug 31 15:28:12 devstack sudo[104089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:12 devstack sudo[104087]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a23305d0-d03e-41f1-bf17-68ba0f4b3f29 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413.146f0b9e-2680-41a8-a0fb-d9d3cecbd481" returned: 0 in 0.325s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:12 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-a23305d0-d03e-41f1-bf17-68ba0f4b3f29 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413.146f0b9e-2680-41a8-a0fb-d9d3cecbd481 is being set with open permissions: ugo+rw Aug 31 15:28:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a23305d0-d03e-41f1-bf17-68ba0f4b3f29 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413.146f0b9e-2680-41a8-a0fb-d9d3cecbd481 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:12 devstack sudo[104094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413.146f0b9e-2680-41a8-a0fb-d9d3cecbd481 Aug 31 15:28:12 devstack sudo[104094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:12 devstack sudo[104089]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2dd67f81-fb59-4d5d-a7d7-4a8a6912d8ac tempest-CreateVolumesFromImageTest-1463302820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-af27f5bc-d86c-4518-bf81-09e133add3a6" returned: 0 in 0.385s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2dd67f81-fb59-4d5d-a7d7-4a8a6912d8ac tempest-CreateVolumesFromImageTest-1463302820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-af27f5bc-d86c-4518-bf81-09e133add3a6 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:12 devstack sudo[104100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-af27f5bc-d86c-4518-bf81-09e133add3a6 Aug 31 15:28:12 devstack sudo[104100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:12 devstack sudo[104094]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a23305d0-d03e-41f1-bf17-68ba0f4b3f29 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413.146f0b9e-2680-41a8-a0fb-d9d3cecbd481" returned: 0 in 0.261s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a23305d0-d03e-41f1-bf17-68ba0f4b3f29 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:12 devstack sudo[104102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413.info Aug 31 15:28:12 devstack sudo[104102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:12 devstack sudo[104100]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2dd67f81-fb59-4d5d-a7d7-4a8a6912d8ac tempest-CreateVolumesFromImageTest-1463302820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-af27f5bc-d86c-4518-bf81-09e133add3a6" returned: 0 in 0.262s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:12 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-2dd67f81-fb59-4d5d-a7d7-4a8a6912d8ac tempest-CreateVolumesFromImageTest-1463302820 None] Lock "cinder-quobyte-af27f5bc-d86c-4518-bf81-09e133add3a6" released by "delete_volume" :: held 0.694s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:28:12 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-2dd67f81-fb59-4d5d-a7d7-4a8a6912d8ac tempest-CreateVolumesFromImageTest-1463302820 None] Created reservations ['52ddcd7a-a4c0-4b14-9604-94778b27c79f', '71151d54-8736-4907-b5cb-429c302a54fe', '23661b98-e011-4539-938d-a0f0e6611c90', 'cf745682-3594-40c9-92a5-42e01033b6a1'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:28:12 devstack sudo[104102]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a23305d0-d03e-41f1-bf17-68ba0f4b3f29 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413.info" returned: 0 in 0.269s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:12 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-a23305d0-d03e-41f1-bf17-68ba0f4b3f29 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413.info is being set with open permissions: ugo+rw Aug 31 15:28:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a23305d0-d03e-41f1-bf17-68ba0f4b3f29 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:12 devstack sudo[104106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413.info Aug 31 15:28:12 devstack sudo[104106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-2dd67f81-fb59-4d5d-a7d7-4a8a6912d8ac tempest-CreateVolumesFromImageTest-1463302820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:28:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-2dd67f81-fb59-4d5d-a7d7-4a8a6912d8ac tempest-CreateVolumesFromImageTest-1463302820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:28:12 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-2dd67f81-fb59-4d5d-a7d7-4a8a6912d8ac tempest-CreateVolumesFromImageTest-1463302820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:28:12 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-2dd67f81-fb59-4d5d-a7d7-4a8a6912d8ac tempest-CreateVolumesFromImageTest-1463302820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:28:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-2dd67f81-fb59-4d5d-a7d7-4a8a6912d8ac tempest-CreateVolumesFromImageTest-1463302820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:28:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2dd67f81-fb59-4d5d-a7d7-4a8a6912d8ac tempest-CreateVolumesFromImageTest-1463302820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:12 devstack sudo[104108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:28:12 devstack sudo[104108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:12 devstack sudo[104106]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a23305d0-d03e-41f1-bf17-68ba0f4b3f29 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413.info" returned: 0 in 0.266s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-a23305d0-d03e-41f1-bf17-68ba0f4b3f29 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.997s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:28:12 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-bbef7657-007b-497c-a8ca-4a6c47aa9f1b tempest-CreateVolumesFromImageTest-1463302820 None] Acquiring lock "cinder-7693bb41-c177-482e-800a-95a971cdcd82-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:28:12 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-a23305d0-d03e-41f1-bf17-68ba0f4b3f29 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Create snapshot completed successfully Aug 31 15:28:12 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-bbef7657-007b-497c-a8ca-4a6c47aa9f1b tempest-CreateVolumesFromImageTest-1463302820 None] Lock "cinder-7693bb41-c177-482e-800a-95a971cdcd82-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:28:12 devstack sudo[104108]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2dd67f81-fb59-4d5d-a7d7-4a8a6912d8ac tempest-CreateVolumesFromImageTest-1463302820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.298s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:13 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-2dd67f81-fb59-4d5d-a7d7-4a8a6912d8ac tempest-CreateVolumesFromImageTest-1463302820 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:28:13 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-2dd67f81-fb59-4d5d-a7d7-4a8a6912d8ac tempest-CreateVolumesFromImageTest-1463302820 None] Deleted volume successfully. Aug 31 15:28:13 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-2dd67f81-fb59-4d5d-a7d7-4a8a6912d8ac tempest-CreateVolumesFromImageTest-1463302820 None] Lock "cinder-af27f5bc-d86c-4518-bf81-09e133add3a6-delete_volume" released by "delete_volume" :: held 1.233s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:28:13 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-bbef7657-007b-497c-a8ca-4a6c47aa9f1b tempest-CreateVolumesFromImageTest-1463302820 None] Acquiring lock "cinder-quobyte-7693bb41-c177-482e-800a-95a971cdcd82" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:28:13 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-bbef7657-007b-497c-a8ca-4a6c47aa9f1b tempest-CreateVolumesFromImageTest-1463302820 None] Lock "cinder-quobyte-7693bb41-c177-482e-800a-95a971cdcd82" acquired by "delete_volume" :: waited 0.013s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:28:13 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[800682b3-f3de-4feb-b728-387dc4f43c12]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:28:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bbef7657-007b-497c-a8ca-4a6c47aa9f1b tempest-CreateVolumesFromImageTest-1463302820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7693bb41-c177-482e-800a-95a971cdcd82 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:13 devstack sudo[104112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7693bb41-c177-482e-800a-95a971cdcd82 Aug 31 15:28:13 devstack sudo[104112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:13 devstack sudo[104112]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bbef7657-007b-497c-a8ca-4a6c47aa9f1b tempest-CreateVolumesFromImageTest-1463302820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7693bb41-c177-482e-800a-95a971cdcd82" returned: 0 in 0.357s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bbef7657-007b-497c-a8ca-4a6c47aa9f1b tempest-CreateVolumesFromImageTest-1463302820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7693bb41-c177-482e-800a-95a971cdcd82 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:13 devstack sudo[104117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7693bb41-c177-482e-800a-95a971cdcd82 Aug 31 15:28:13 devstack sudo[104117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:13 devstack sudo[104117]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bbef7657-007b-497c-a8ca-4a6c47aa9f1b tempest-CreateVolumesFromImageTest-1463302820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7693bb41-c177-482e-800a-95a971cdcd82" returned: 0 in 0.250s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:13 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-bbef7657-007b-497c-a8ca-4a6c47aa9f1b tempest-CreateVolumesFromImageTest-1463302820 None] Lock "cinder-quobyte-7693bb41-c177-482e-800a-95a971cdcd82" released by "delete_volume" :: held 0.645s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:28:13 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-bbef7657-007b-497c-a8ca-4a6c47aa9f1b tempest-CreateVolumesFromImageTest-1463302820 None] Created reservations ['e8403a31-4b7b-4c19-9c69-bc7e35023afc', 'c328983b-9ef1-4149-86da-807c2cab7db1', 'f0b3e09a-d1a6-4033-9b4a-061d28fb3a01', 'ae499a41-e3ef-479d-93fe-bb9f09154977'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:28:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bbef7657-007b-497c-a8ca-4a6c47aa9f1b tempest-CreateVolumesFromImageTest-1463302820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:28:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bbef7657-007b-497c-a8ca-4a6c47aa9f1b tempest-CreateVolumesFromImageTest-1463302820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:28:13 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-bbef7657-007b-497c-a8ca-4a6c47aa9f1b tempest-CreateVolumesFromImageTest-1463302820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:28:13 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-bbef7657-007b-497c-a8ca-4a6c47aa9f1b tempest-CreateVolumesFromImageTest-1463302820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:28:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bbef7657-007b-497c-a8ca-4a6c47aa9f1b tempest-CreateVolumesFromImageTest-1463302820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:28:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bbef7657-007b-497c-a8ca-4a6c47aa9f1b tempest-CreateVolumesFromImageTest-1463302820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:13 devstack sudo[104120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:28:13 devstack sudo[104120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:14 devstack sudo[104120]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bbef7657-007b-497c-a8ca-4a6c47aa9f1b tempest-CreateVolumesFromImageTest-1463302820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.259s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:14 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-bbef7657-007b-497c-a8ca-4a6c47aa9f1b tempest-CreateVolumesFromImageTest-1463302820 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:28:14 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-bbef7657-007b-497c-a8ca-4a6c47aa9f1b tempest-CreateVolumesFromImageTest-1463302820 None] Deleted volume successfully. Aug 31 15:28:14 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-bbef7657-007b-497c-a8ca-4a6c47aa9f1b tempest-CreateVolumesFromImageTest-1463302820 None] Lock "cinder-7693bb41-c177-482e-800a-95a971cdcd82-delete_volume" released by "delete_volume" :: held 1.114s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:28:14 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-31bc412b-ba38-4ec3-af41-930eb20577aa tempest-CreateVolumesFromImageTest-1463302820 None] Acquiring lock "cinder-4580c6ee-e6e7-4e43-85e2-2219408fedb7-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:28:14 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-31bc412b-ba38-4ec3-af41-930eb20577aa tempest-CreateVolumesFromImageTest-1463302820 None] Lock "cinder-4580c6ee-e6e7-4e43-85e2-2219408fedb7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:28:14 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-69171d66-007e-4eb5-aea4-74e39aa05673 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Acquiring lock "cinder-146f0b9e-2680-41a8-a0fb-d9d3cecbd481-delete_snapshot" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:28:14 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-69171d66-007e-4eb5-aea4-74e39aa05673 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Lock "cinder-146f0b9e-2680-41a8-a0fb-d9d3cecbd481-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:28:14 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-69171d66-007e-4eb5-aea4-74e39aa05673 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Acquiring lock "cinder-quobyte-14ae2a90-4975-4c2a-8b3c-fc6e21edd413" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:28:14 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-69171d66-007e-4eb5-aea4-74e39aa05673 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Lock "cinder-quobyte-14ae2a90-4975-4c2a-8b3c-fc6e21edd413" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:28:14 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-69171d66-007e-4eb5-aea4-74e39aa05673 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Acquiring lock "cinder-quobyte-146f0b9e-2680-41a8-a0fb-d9d3cecbd481" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:28:14 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-31bc412b-ba38-4ec3-af41-930eb20577aa tempest-CreateVolumesFromImageTest-1463302820 None] Acquiring lock "cinder-quobyte-4580c6ee-e6e7-4e43-85e2-2219408fedb7" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:28:14 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-69171d66-007e-4eb5-aea4-74e39aa05673 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Lock "cinder-quobyte-146f0b9e-2680-41a8-a0fb-d9d3cecbd481" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:28:14 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-69171d66-007e-4eb5-aea4-74e39aa05673 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Deleting offline snapshot 146f0b9e-2680-41a8-a0fb-d9d3cecbd481 of volume 14ae2a90-4975-4c2a-8b3c-fc6e21edd413 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:28:14 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-69171d66-007e-4eb5-aea4-74e39aa05673 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] snapshot_file for this snap is: volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413.146f0b9e-2680-41a8-a0fb-d9d3cecbd481 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:28:14 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-31bc412b-ba38-4ec3-af41-930eb20577aa tempest-CreateVolumesFromImageTest-1463302820 None] Lock "cinder-quobyte-4580c6ee-e6e7-4e43-85e2-2219408fedb7" acquired by "delete_volume" :: waited 0.037s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:28:14 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19c590c-41ab-4fa6-a3b3-6505cb07b1dd]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:28:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-69171d66-007e-4eb5-aea4-74e39aa05673 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413.146f0b9e-2680-41a8-a0fb-d9d3cecbd481 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:14 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a29bb57-f891-4a8d-b62a-03b27c173483]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:28:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-31bc412b-ba38-4ec3-af41-930eb20577aa tempest-CreateVolumesFromImageTest-1463302820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4580c6ee-e6e7-4e43-85e2-2219408fedb7 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:14 devstack sudo[104123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413.146f0b9e-2680-41a8-a0fb-d9d3cecbd481 Aug 31 15:28:14 devstack sudo[104123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:14 devstack sudo[104124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4580c6ee-e6e7-4e43-85e2-2219408fedb7 Aug 31 15:28:14 devstack sudo[104124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:14 devstack sudo[104123]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-69171d66-007e-4eb5-aea4-74e39aa05673 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413.146f0b9e-2680-41a8-a0fb-d9d3cecbd481" returned: 0 in 0.367s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:14 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-69171d66-007e-4eb5-aea4-74e39aa05673 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:28:14 devstack sudo[104124]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-31bc412b-ba38-4ec3-af41-930eb20577aa tempest-CreateVolumesFromImageTest-1463302820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4580c6ee-e6e7-4e43-85e2-2219408fedb7" returned: 0 in 0.371s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-31bc412b-ba38-4ec3-af41-930eb20577aa tempest-CreateVolumesFromImageTest-1463302820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4580c6ee-e6e7-4e43-85e2-2219408fedb7 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:14 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7d8eb2-6f21-48c7-af5a-6dceaff22805]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:28:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-69171d66-007e-4eb5-aea4-74e39aa05673 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:14 devstack sudo[104134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4580c6ee-e6e7-4e43-85e2-2219408fedb7 Aug 31 15:28:14 devstack sudo[104134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:14 devstack sudo[104135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413 Aug 31 15:28:14 devstack sudo[104135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:14 devstack sudo[104134]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-31bc412b-ba38-4ec3-af41-930eb20577aa tempest-CreateVolumesFromImageTest-1463302820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4580c6ee-e6e7-4e43-85e2-2219408fedb7" returned: 0 in 0.251s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:14 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-31bc412b-ba38-4ec3-af41-930eb20577aa tempest-CreateVolumesFromImageTest-1463302820 None] Lock "cinder-quobyte-4580c6ee-e6e7-4e43-85e2-2219408fedb7" released by "delete_volume" :: held 0.665s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:28:14 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-31bc412b-ba38-4ec3-af41-930eb20577aa tempest-CreateVolumesFromImageTest-1463302820 None] Created reservations ['61b1ce7e-71b3-446e-91d8-c6e662d0f612', '53ddcc5e-e89a-4a1d-ad2b-cba8a7479702', '6922fd35-131f-4b4b-8b2e-789dc58611e5', 'b7c8ef7a-c705-4785-b220-43482e52c49e'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:28:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-31bc412b-ba38-4ec3-af41-930eb20577aa tempest-CreateVolumesFromImageTest-1463302820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:28:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-31bc412b-ba38-4ec3-af41-930eb20577aa tempest-CreateVolumesFromImageTest-1463302820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:28:15 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-31bc412b-ba38-4ec3-af41-930eb20577aa tempest-CreateVolumesFromImageTest-1463302820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:28:15 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-31bc412b-ba38-4ec3-af41-930eb20577aa tempest-CreateVolumesFromImageTest-1463302820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:28:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-31bc412b-ba38-4ec3-af41-930eb20577aa tempest-CreateVolumesFromImageTest-1463302820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:28:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-31bc412b-ba38-4ec3-af41-930eb20577aa tempest-CreateVolumesFromImageTest-1463302820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:15 devstack sudo[104135]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-69171d66-007e-4eb5-aea4-74e39aa05673 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413" returned: 0 in 0.381s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-69171d66-007e-4eb5-aea4-74e39aa05673 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413.146f0b9e-2680-41a8-a0fb-d9d3cecbd481 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:15 devstack sudo[104142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:28:15 devstack sudo[104142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:15 devstack sudo[104143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413.146f0b9e-2680-41a8-a0fb-d9d3cecbd481 Aug 31 15:28:15 devstack sudo[104143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:15 devstack sudo[104142]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:15 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-d7cb5044-f8c1-42ca-85bd-c45e8e116c5f tempest-CreateVolumesFromImageTest-1463302820 None] Acquiring lock "cinder-2ae1ffff-da47-43d3-ad30-1b4a5bb6c5e2-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:28:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-31bc412b-ba38-4ec3-af41-930eb20577aa tempest-CreateVolumesFromImageTest-1463302820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.290s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:15 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-31bc412b-ba38-4ec3-af41-930eb20577aa tempest-CreateVolumesFromImageTest-1463302820 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:28:15 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-31bc412b-ba38-4ec3-af41-930eb20577aa tempest-CreateVolumesFromImageTest-1463302820 None] Deleted volume successfully. Aug 31 15:28:15 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-d7cb5044-f8c1-42ca-85bd-c45e8e116c5f tempest-CreateVolumesFromImageTest-1463302820 None] Lock "cinder-2ae1ffff-da47-43d3-ad30-1b4a5bb6c5e2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:28:15 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-31bc412b-ba38-4ec3-af41-930eb20577aa tempest-CreateVolumesFromImageTest-1463302820 None] Lock "cinder-4580c6ee-e6e7-4e43-85e2-2219408fedb7-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:28:15 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-d7cb5044-f8c1-42ca-85bd-c45e8e116c5f tempest-CreateVolumesFromImageTest-1463302820 None] Acquiring lock "cinder-quobyte-2ae1ffff-da47-43d3-ad30-1b4a5bb6c5e2" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:28:15 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-d7cb5044-f8c1-42ca-85bd-c45e8e116c5f tempest-CreateVolumesFromImageTest-1463302820 None] Lock "cinder-quobyte-2ae1ffff-da47-43d3-ad30-1b4a5bb6c5e2" acquired by "delete_volume" :: waited 0.018s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:28:15 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd49de9b-764f-4122-8f7e-65bd3d7fda37]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:28:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d7cb5044-f8c1-42ca-85bd-c45e8e116c5f tempest-CreateVolumesFromImageTest-1463302820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2ae1ffff-da47-43d3-ad30-1b4a5bb6c5e2 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:15 devstack sudo[104143]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-69171d66-007e-4eb5-aea4-74e39aa05673 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413.146f0b9e-2680-41a8-a0fb-d9d3cecbd481" returned: 0 in 0.423s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-69171d66-007e-4eb5-aea4-74e39aa05673 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413.146f0b9e-2680-41a8-a0fb-d9d3cecbd481 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:15 devstack sudo[104151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413.146f0b9e-2680-41a8-a0fb-d9d3cecbd481 Aug 31 15:28:15 devstack sudo[104151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:15 devstack sudo[104150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2ae1ffff-da47-43d3-ad30-1b4a5bb6c5e2 Aug 31 15:28:15 devstack sudo[104150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:15 devstack sudo[104151]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-69171d66-007e-4eb5-aea4-74e39aa05673 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413.146f0b9e-2680-41a8-a0fb-d9d3cecbd481" returned: 0 in 0.274s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:15 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-69171d66-007e-4eb5-aea4-74e39aa05673 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Lock "cinder-quobyte-146f0b9e-2680-41a8-a0fb-d9d3cecbd481" released by "_delete_snapshot" :: held 1.559s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:28:15 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-69171d66-007e-4eb5-aea4-74e39aa05673 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Lock "cinder-quobyte-14ae2a90-4975-4c2a-8b3c-fc6e21edd413" released by "delete_snapshot" :: held 1.597s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:28:15 devstack sudo[104150]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d7cb5044-f8c1-42ca-85bd-c45e8e116c5f tempest-CreateVolumesFromImageTest-1463302820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2ae1ffff-da47-43d3-ad30-1b4a5bb6c5e2" returned: 0 in 0.371s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d7cb5044-f8c1-42ca-85bd-c45e8e116c5f tempest-CreateVolumesFromImageTest-1463302820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2ae1ffff-da47-43d3-ad30-1b4a5bb6c5e2 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:15 devstack sudo[104158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2ae1ffff-da47-43d3-ad30-1b4a5bb6c5e2 Aug 31 15:28:15 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:15 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-69171d66-007e-4eb5-aea4-74e39aa05673 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Created reservations ['6972e21c-2366-4ec1-a4d8-3f9ef0b1f554', '197ef85b-acc6-4c95-b6d2-f4e37ce70f67', 'e22e429c-21a8-4cda-9f6b-0d1fceef19dd', '172d3a7f-eda6-4c8f-b36e-0f59475ee14c'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:28:15 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-69171d66-007e-4eb5-aea4-74e39aa05673 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Delete snapshot completed successfully. Aug 31 15:28:15 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-69171d66-007e-4eb5-aea4-74e39aa05673 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Lock "cinder-146f0b9e-2680-41a8-a0fb-d9d3cecbd481-delete_snapshot" released by "delete_snapshot" :: held 1.753s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:28:16 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d7cb5044-f8c1-42ca-85bd-c45e8e116c5f tempest-CreateVolumesFromImageTest-1463302820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2ae1ffff-da47-43d3-ad30-1b4a5bb6c5e2" returned: 0 in 0.266s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:16 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-d7cb5044-f8c1-42ca-85bd-c45e8e116c5f tempest-CreateVolumesFromImageTest-1463302820 None] Lock "cinder-quobyte-2ae1ffff-da47-43d3-ad30-1b4a5bb6c5e2" released by "delete_volume" :: held 0.674s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:28:16 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-d7cb5044-f8c1-42ca-85bd-c45e8e116c5f tempest-CreateVolumesFromImageTest-1463302820 None] Created reservations ['8a85006f-b8ed-41d5-a578-6b80d06dbf17', '4ae6ec99-fa95-4b31-abd3-141bc4599b8b', '3aae25ce-b8d5-404e-8ab7-01bd3e69321e', '757ee76f-2ea3-47e6-8bb7-5c2eb293d1f9'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:28:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-d7cb5044-f8c1-42ca-85bd-c45e8e116c5f tempest-CreateVolumesFromImageTest-1463302820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:28:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-d7cb5044-f8c1-42ca-85bd-c45e8e116c5f tempest-CreateVolumesFromImageTest-1463302820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:28:16 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-d7cb5044-f8c1-42ca-85bd-c45e8e116c5f tempest-CreateVolumesFromImageTest-1463302820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:28:16 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-d7cb5044-f8c1-42ca-85bd-c45e8e116c5f tempest-CreateVolumesFromImageTest-1463302820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:28:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-d7cb5044-f8c1-42ca-85bd-c45e8e116c5f tempest-CreateVolumesFromImageTest-1463302820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:28:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d7cb5044-f8c1-42ca-85bd-c45e8e116c5f tempest-CreateVolumesFromImageTest-1463302820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:16 devstack sudo[104161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:28:16 devstack sudo[104161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:16 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-2a4439d1-f1ed-4149-893a-5be7853e2040 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Acquiring lock "cinder-14ae2a90-4975-4c2a-8b3c-fc6e21edd413-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:28:16 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-2a4439d1-f1ed-4149-893a-5be7853e2040 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Lock "cinder-14ae2a90-4975-4c2a-8b3c-fc6e21edd413-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:28:16 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-2a4439d1-f1ed-4149-893a-5be7853e2040 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Acquiring lock "cinder-quobyte-14ae2a90-4975-4c2a-8b3c-fc6e21edd413" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:28:16 devstack sudo[104161]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d7cb5044-f8c1-42ca-85bd-c45e8e116c5f tempest-CreateVolumesFromImageTest-1463302820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.284s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:16 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-d7cb5044-f8c1-42ca-85bd-c45e8e116c5f tempest-CreateVolumesFromImageTest-1463302820 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:28:16 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-2a4439d1-f1ed-4149-893a-5be7853e2040 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Lock "cinder-quobyte-14ae2a90-4975-4c2a-8b3c-fc6e21edd413" acquired by "delete_volume" :: waited 0.017s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:28:16 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-d7cb5044-f8c1-42ca-85bd-c45e8e116c5f tempest-CreateVolumesFromImageTest-1463302820 None] Deleted volume successfully. Aug 31 15:28:16 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7368e0b-9ed1-4566-b6b9-9b081cda0fa3]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:28:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2a4439d1-f1ed-4149-893a-5be7853e2040 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:16 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-d7cb5044-f8c1-42ca-85bd-c45e8e116c5f tempest-CreateVolumesFromImageTest-1463302820 None] Lock "cinder-2ae1ffff-da47-43d3-ad30-1b4a5bb6c5e2-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:28:16 devstack sudo[104164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413 Aug 31 15:28:16 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:16 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2a4439d1-f1ed-4149-893a-5be7853e2040 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413" returned: 0 in 0.405s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2a4439d1-f1ed-4149-893a-5be7853e2040 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:16 devstack sudo[104169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413 Aug 31 15:28:16 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:17 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2a4439d1-f1ed-4149-893a-5be7853e2040 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-14ae2a90-4975-4c2a-8b3c-fc6e21edd413" returned: 0 in 0.255s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:17 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-2a4439d1-f1ed-4149-893a-5be7853e2040 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Lock "cinder-quobyte-14ae2a90-4975-4c2a-8b3c-fc6e21edd413" released by "delete_volume" :: held 0.731s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:28:17 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-2a4439d1-f1ed-4149-893a-5be7853e2040 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Created reservations ['56379a3e-d58b-4631-b55d-2e70b66fe0e5', 'cebe584a-dbbe-413f-be42-dac14d2f1745', '6500931d-ce0c-4223-848e-4d758532ba94', 'a3a3866f-611c-480b-89f5-acef6787b7f4'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:28:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-2a4439d1-f1ed-4149-893a-5be7853e2040 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:28:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-2a4439d1-f1ed-4149-893a-5be7853e2040 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:28:17 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-2a4439d1-f1ed-4149-893a-5be7853e2040 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:28:17 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-2a4439d1-f1ed-4149-893a-5be7853e2040 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:28:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-2a4439d1-f1ed-4149-893a-5be7853e2040 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:28:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2a4439d1-f1ed-4149-893a-5be7853e2040 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:17 devstack sudo[104172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:28:17 devstack sudo[104172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:17 devstack sudo[104172]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2a4439d1-f1ed-4149-893a-5be7853e2040 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.268s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:17 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-2a4439d1-f1ed-4149-893a-5be7853e2040 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:28:17 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-2a4439d1-f1ed-4149-893a-5be7853e2040 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Deleted volume successfully. Aug 31 15:28:17 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-2a4439d1-f1ed-4149-893a-5be7853e2040 tempest-VolumesSnapshotNegativeTestJSON-1300426815 None] Lock "cinder-14ae2a90-4975-4c2a-8b3c-fc6e21edd413-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:28:22 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:SELECT=139,cinder:UPDATE=205,cinder:INSERT=45,cinder:DELETE=14 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:28:22 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:28:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Flow 'volume_create_manager' (cd211fa7-101c-45be-950d-6faf41472261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:28:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b89ee2ff-dbb3-4476-b655-49c3cda2bb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b89ee2ff-dbb3-4476-b655-49c3cda2bb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a660d45-f76a-4fb2-9215-7030e8d42325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86033a0348304fc1aea9ea8779c34918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:28:22Z,use_quota=True,user_id='893469d611fe42559c23b4ac38af6b3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce339041-e31d-48a1-b227-fe2a5ed7284a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce339041-e31d-48a1-b227-fe2a5ed7284a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (967ceb54-3a8c-4c89-a7e6-d98afde0098e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:22 devstack cinder-volume[86000]: DEBUG cinder.image.glance [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Creating Keystone auth plugin from conf {{(pid=86000) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 31 15:28:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (967ceb54-3a8c-4c89-a7e6-d98afde0098e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8a660d45-f76a-4fb2-9215-7030e8d42325', 'volume_name': 'volume-8a660d45-f76a-4fb2-9215-7030e8d42325', 'volume_size': 1, 'image_id': '85d258d1-4670-462f-be67-0bb992994931', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/85d258d1-4670-462f-be67-0bb992994931', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f728ee431ace9e62d4d25329e04ee1d5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '86033a0348304fc1aea9ea8779c34918', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1c057cfb3608784baff1f055f490dc16490ed7b3cce39348caae55ef8ae3c4dea4f3979cb74f1b3d920eacc0c31420154c025983db1deb4e2340a500e1a6fbe3', 'id': '85d258d1-4670-462f-be67-0bb992994931', 'created_at': datetime.datetime(2026, 8, 31, 13, 28, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 13, 28, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/85d258d1-4670-462f-be67-0bb992994931/file', 'properties': {}}, 'image_service': }' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (585f55e1-2ec2-46f9-9e5a-ba747f66c644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (585f55e1-2ec2-46f9-9e5a-ba747f66c644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d96c962-f1cc-4c72-b26c-79fca0c38207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:22 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Volume 8a660d45-f76a-4fb2-9215-7030e8d42325: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8a660d45-f76a-4fb2-9215-7030e8d42325', 'volume_size': 1, 'image_id': '85d258d1-4670-462f-be67-0bb992994931', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/85d258d1-4670-462f-be67-0bb992994931', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f728ee431ace9e62d4d25329e04ee1d5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '86033a0348304fc1aea9ea8779c34918', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1c057cfb3608784baff1f055f490dc16490ed7b3cce39348caae55ef8ae3c4dea4f3979cb74f1b3d920eacc0c31420154c025983db1deb4e2340a500e1a6fbe3', 'id': '85d258d1-4670-462f-be67-0bb992994931', 'created_at': datetime.datetime(2026, 8, 31, 13, 28, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 13, 28, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/85d258d1-4670-462f-be67-0bb992994931/file', 'properties': {}}, 'image_service': } Aug 31 15:28:22 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Trying to clone 8a660d45-f76a-4fb2-9215-7030e8d42325 from image 85d258d1-4670-462f-be67-0bb992994931 at location (None, [{'url': 'file:///opt/stack/data/glance/images/85d258d1-4670-462f-be67-0bb992994931', 'metadata': {}}]). {{(pid=86000) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 31 15:28:22 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_85d258d1-4670-462f-be67-0bb992994931_d0yym6ncdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86000) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 31 15:28:22 devstack cinder-volume[86000]: INFO cinder.image.image_utils [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Image download 0.00 MB at 0.00 MB/s Aug 31 15:28:22 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[741df83d-1ea7-44e9-81f5-20384d0fd333]: (4, 'raw') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:28:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_85d258d1-4670-462f-be67-0bb992994931_d0yym6ncdevstack@QuobyteHD {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:22 devstack sudo[104179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_85d258d1-4670-462f-be67-0bb992994931_d0yym6ncdevstack@QuobyteHD Aug 31 15:28:22 devstack sudo[104179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:23 devstack sudo[104179]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_85d258d1-4670-462f-be67-0bb992994931_d0yym6ncdevstack@QuobyteHD" returned: 0 in 0.349s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_85d258d1-4670-462f-be67-0bb992994931_d0yym6ncdevstack@QuobyteHD {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:23 devstack sudo[104183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_85d258d1-4670-462f-be67-0bb992994931_d0yym6ncdevstack@QuobyteHD Aug 31 15:28:23 devstack sudo[104183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:23 devstack sudo[104183]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_85d258d1-4670-462f-be67-0bb992994931_d0yym6ncdevstack@QuobyteHD" returned: 1 in 0.354s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_85d258d1-4670-462f-be67-0bb992994931_d0yym6ncdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 31 15:28:23 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Temporary image 85d258d1-4670-462f-be67-0bb992994931 is fetched for user 893469d611fe42559c23b4ac38af6b3e. {{(pid=86000) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 31 15:28:23 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[565959d7-f538-4ab6-b8fa-2253ef9551c8]: (4, 'raw') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:28:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_85d258d1-4670-462f-be67-0bb992994931_d0yym6ncdevstack@QuobyteHD {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:23 devstack sudo[104188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_85d258d1-4670-462f-be67-0bb992994931_d0yym6ncdevstack@QuobyteHD Aug 31 15:28:23 devstack sudo[104188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:23 devstack sudo[104188]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_85d258d1-4670-462f-be67-0bb992994931_d0yym6ncdevstack@QuobyteHD" returned: 0 in 0.337s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_85d258d1-4670-462f-be67-0bb992994931_d0yym6ncdevstack@QuobyteHD {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:23 devstack sudo[104192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_85d258d1-4670-462f-be67-0bb992994931_d0yym6ncdevstack@QuobyteHD Aug 31 15:28:23 devstack sudo[104192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:24 devstack sudo[104192]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_85d258d1-4670-462f-be67-0bb992994931_d0yym6ncdevstack@QuobyteHD" returned: 1 in 0.341s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_85d258d1-4670-462f-be67-0bb992994931_d0yym6ncdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 31 15:28:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:28:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:28:24 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a660d45-f76a-4fb2-9215-7030e8d42325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86033a0348304fc1aea9ea8779c34918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:28:22Z,use_quota=True,user_id='893469d611fe42559c23b4ac38af6b3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:28:24 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Creating volume 8a660d45-f76a-4fb2-9215-7030e8d42325 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:28:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:28:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:28:24 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:28:24 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:28:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:28:24 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:28:24 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:28:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8a660d45-f76a-4fb2-9215-7030e8d42325 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:24 devstack sudo[104197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8a660d45-f76a-4fb2-9215-7030e8d42325 1073741824 Aug 31 15:28:24 devstack sudo[104197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:24 devstack sudo[104197]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8a660d45-f76a-4fb2-9215-7030e8d42325 1073741824" returned: 0 in 0.569s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8a660d45-f76a-4fb2-9215-7030e8d42325 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:24 devstack sudo[104203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8a660d45-f76a-4fb2-9215-7030e8d42325 Aug 31 15:28:24 devstack sudo[104203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:25 devstack sudo[104203]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8a660d45-f76a-4fb2-9215-7030e8d42325" returned: 0 in 0.254s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:25 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:28:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:28:25 devstack cinder-volume[86000]: DEBUG cinder.volume.volume_utils [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Attempting download of 85d258d1-4670-462f-be67-0bb992994931 ((None, [{'url': 'file:///opt/stack/data/glance/images/85d258d1-4670-462f-be67-0bb992994931', 'metadata': {}}])) to volume 8a660d45-f76a-4fb2-9215-7030e8d42325. {{(pid=86000) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 31 15:28:25 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fef6e6a-4941-4589-9bd5-c2b990e45eb6]: (4, 'raw') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:28:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_85d258d1-4670-462f-be67-0bb992994931_wiw6gttn {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:25 devstack sudo[104206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_85d258d1-4670-462f-be67-0bb992994931_wiw6gttn Aug 31 15:28:25 devstack sudo[104206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:25 devstack sudo[104206]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_85d258d1-4670-462f-be67-0bb992994931_wiw6gttn" returned: 0 in 0.331s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_85d258d1-4670-462f-be67-0bb992994931_wiw6gttn {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:25 devstack sudo[104220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_85d258d1-4670-462f-be67-0bb992994931_wiw6gttn Aug 31 15:28:25 devstack sudo[104220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:25 devstack sudo[104220]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_85d258d1-4670-462f-be67-0bb992994931_wiw6gttn" returned: 1 in 0.366s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_85d258d1-4670-462f-be67-0bb992994931_wiw6gttn' failed. Not Retrying. {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 31 15:28:25 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05b6419-2f10-445c-853e-dd0f1b685430]: (4, 'raw') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:28:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_85d258d1-4670-462f-be67-0bb992994931_d0yym6ncdevstack@QuobyteHD {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:26 devstack sudo[104248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_85d258d1-4670-462f-be67-0bb992994931_d0yym6ncdevstack@QuobyteHD Aug 31 15:28:26 devstack sudo[104248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:26 devstack sudo[104248]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_85d258d1-4670-462f-be67-0bb992994931_d0yym6ncdevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_85d258d1-4670-462f-be67-0bb992994931_d0yym6ncdevstack@QuobyteHD {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:26 devstack sudo[104254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_85d258d1-4670-462f-be67-0bb992994931_d0yym6ncdevstack@QuobyteHD Aug 31 15:28:26 devstack sudo[104254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:26 devstack sudo[104254]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_85d258d1-4670-462f-be67-0bb992994931_d0yym6ncdevstack@QuobyteHD" returned: 1 in 0.322s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_85d258d1-4670-462f-be67-0bb992994931_d0yym6ncdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 31 15:28:26 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] 85d258d1-4670-462f-be67-0bb992994931 was raw, converting to qcow2 {{(pid=86000) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 31 15:28:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_85d258d1-4670-462f-be67-0bb992994931_d0yym6ncdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8a660d45-f76a-4fb2-9215-7030e8d42325 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:26 devstack sudo[104259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_85d258d1-4670-462f-be67-0bb992994931_d0yym6ncdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8a660d45-f76a-4fb2-9215-7030e8d42325 Aug 31 15:28:26 devstack sudo[104259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:27 devstack sudo[104259]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_85d258d1-4670-462f-be67-0bb992994931_d0yym6ncdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8a660d45-f76a-4fb2-9215-7030e8d42325" returned: 0 in 0.479s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:27 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_85d258d1-4670-462f-be67-0bb992994931_d0yym6ncdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8a660d45-f76a-4fb2-9215-7030e8d42325 {{(pid=86000) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 31 15:28:27 devstack cinder-volume[86000]: INFO cinder.image.image_utils [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Converted 0.00 MB image at 0.00 MB/s Aug 31 15:28:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8a660d45-f76a-4fb2-9215-7030e8d42325 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:27 devstack sudo[104265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8a660d45-f76a-4fb2-9215-7030e8d42325 1G Aug 31 15:28:27 devstack sudo[104265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:27 devstack sudo[104265]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8a660d45-f76a-4fb2-9215-7030e8d42325 1G" returned: 0 in 0.352s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:27 devstack cinder-volume[86000]: DEBUG cinder.volume.volume_utils [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Downloaded image 85d258d1-4670-462f-be67-0bb992994931 ((None, [{'url': 'file:///opt/stack/data/glance/images/85d258d1-4670-462f-be67-0bb992994931', 'metadata': {}}])) to volume 8a660d45-f76a-4fb2-9215-7030e8d42325 successfully. {{(pid=86000) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 31 15:28:27 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Temporary image 85d258d1-4670-462f-be67-0bb992994931 for user 893469d611fe42559c23b4ac38af6b3e is deleted. {{(pid=86000) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 31 15:28:27 devstack cinder-volume[86000]: DEBUG cinder.volume.volume_utils [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Marking volume 8a660d45-f76a-4fb2-9215-7030e8d42325 as bootable. {{(pid=86000) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 31 15:28:27 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Copying metadata from image 85d258d1-4670-462f-be67-0bb992994931 to 8a660d45-f76a-4fb2-9215-7030e8d42325. {{(pid=86000) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 31 15:28:27 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Creating volume glance metadata for volume 8a660d45-f76a-4fb2-9215-7030e8d42325 backed by image 85d258d1-4670-462f-be67-0bb992994931 with: {'image_id': '85d258d1-4670-462f-be67-0bb992994931', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f728ee431ace9e62d4d25329e04ee1d5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86000) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 31 15:28:27 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d96c962-f1cc-4c72-b26c-79fca0c38207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a660d45-f76a-4fb2-9215-7030e8d42325', 'volume_size': 1, 'image_id': '85d258d1-4670-462f-be67-0bb992994931', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/85d258d1-4670-462f-be67-0bb992994931', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f728ee431ace9e62d4d25329e04ee1d5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '86033a0348304fc1aea9ea8779c34918', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1c057cfb3608784baff1f055f490dc16490ed7b3cce39348caae55ef8ae3c4dea4f3979cb74f1b3d920eacc0c31420154c025983db1deb4e2340a500e1a6fbe3', 'id': '85d258d1-4670-462f-be67-0bb992994931', 'created_at': datetime.datetime(2026, 8, 31, 13, 28, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 13, 28, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/85d258d1-4670-462f-be67-0bb992994931/file', 'properties': {}}, 'image_service': }' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:27 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f95339b8-5c96-443b-b6ef-2db58b2c455a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:27 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Volume volume-8a660d45-f76a-4fb2-9215-7030e8d42325 (8a660d45-f76a-4fb2-9215-7030e8d42325): created successfully Aug 31 15:28:27 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f95339b8-5c96-443b-b6ef-2db58b2c455a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:27 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Flow 'volume_create_manager' (cd211fa7-101c-45be-950d-6faf41472261) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:28:27 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-bd24fbf0-06c5-4455-9d3e-950d07912d70 tempest-VolumeImageDependencyTests-809530296 None] Created volume successfully. Aug 31 15:28:28 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-976eb389-c781-4c5e-b405-16570af71f87 tempest-VolumeImageDependencyTests-809530296 None] Acquiring lock "cinder-8a660d45-f76a-4fb2-9215-7030e8d42325-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:28:28 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-976eb389-c781-4c5e-b405-16570af71f87 tempest-VolumeImageDependencyTests-809530296 None] Lock "cinder-8a660d45-f76a-4fb2-9215-7030e8d42325-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:28:28 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-976eb389-c781-4c5e-b405-16570af71f87 tempest-VolumeImageDependencyTests-809530296 None] Acquiring lock "cinder-quobyte-8a660d45-f76a-4fb2-9215-7030e8d42325" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:28:28 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-976eb389-c781-4c5e-b405-16570af71f87 tempest-VolumeImageDependencyTests-809530296 None] Lock "cinder-quobyte-8a660d45-f76a-4fb2-9215-7030e8d42325" acquired by "delete_volume" :: waited 0.015s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:28:28 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1080ce-145f-46c6-a5f6-909bbf80c367]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:28:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-976eb389-c781-4c5e-b405-16570af71f87 tempest-VolumeImageDependencyTests-809530296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8a660d45-f76a-4fb2-9215-7030e8d42325 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:28 devstack sudo[104270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8a660d45-f76a-4fb2-9215-7030e8d42325 Aug 31 15:28:28 devstack sudo[104270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:29 devstack sudo[104270]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-976eb389-c781-4c5e-b405-16570af71f87 tempest-VolumeImageDependencyTests-809530296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8a660d45-f76a-4fb2-9215-7030e8d42325" returned: 0 in 0.388s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-976eb389-c781-4c5e-b405-16570af71f87 tempest-VolumeImageDependencyTests-809530296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8a660d45-f76a-4fb2-9215-7030e8d42325 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:29 devstack sudo[104275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8a660d45-f76a-4fb2-9215-7030e8d42325 Aug 31 15:28:29 devstack sudo[104275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:29 devstack sudo[104275]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-976eb389-c781-4c5e-b405-16570af71f87 tempest-VolumeImageDependencyTests-809530296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8a660d45-f76a-4fb2-9215-7030e8d42325" returned: 0 in 0.311s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:29 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-976eb389-c781-4c5e-b405-16570af71f87 tempest-VolumeImageDependencyTests-809530296 None] Lock "cinder-quobyte-8a660d45-f76a-4fb2-9215-7030e8d42325" released by "delete_volume" :: held 0.757s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:28:29 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-976eb389-c781-4c5e-b405-16570af71f87 tempest-VolumeImageDependencyTests-809530296 None] Created reservations ['2921a925-b3e6-44c8-af51-37086f3ea35e', '3212c434-a097-4314-92cc-450cc2f3a277', '64009c8b-d1b0-477f-a7a5-ed06dae65a1b', '88ce1380-6292-457f-8d82-a358255ed3e2'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:28:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-976eb389-c781-4c5e-b405-16570af71f87 tempest-VolumeImageDependencyTests-809530296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:28:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-976eb389-c781-4c5e-b405-16570af71f87 tempest-VolumeImageDependencyTests-809530296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:28:29 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-976eb389-c781-4c5e-b405-16570af71f87 tempest-VolumeImageDependencyTests-809530296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:28:29 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-976eb389-c781-4c5e-b405-16570af71f87 tempest-VolumeImageDependencyTests-809530296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:28:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-976eb389-c781-4c5e-b405-16570af71f87 tempest-VolumeImageDependencyTests-809530296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:28:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-976eb389-c781-4c5e-b405-16570af71f87 tempest-VolumeImageDependencyTests-809530296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:29 devstack sudo[104279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:28:29 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:29 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-976eb389-c781-4c5e-b405-16570af71f87 tempest-VolumeImageDependencyTests-809530296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.269s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:29 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-976eb389-c781-4c5e-b405-16570af71f87 tempest-VolumeImageDependencyTests-809530296 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:28:29 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-976eb389-c781-4c5e-b405-16570af71f87 tempest-VolumeImageDependencyTests-809530296 None] Deleted volume successfully. Aug 31 15:28:29 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-976eb389-c781-4c5e-b405-16570af71f87 tempest-VolumeImageDependencyTests-809530296 None] Lock "cinder-8a660d45-f76a-4fb2-9215-7030e8d42325-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:28:39 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:SELECT=148,cinder:UPDATE=168,cinder:DELETE=17,cinder:INSERT=63 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:28:39 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:SELECT=15,cinder:INSERT=5,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:28:42 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2e50c90-f832-4bf2-b9b3-2df382787753 tempest-TestServerVolumeAttachmentScenario-935081602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:28:42 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-d2e50c90-f832-4bf2-b9b3-2df382787753 tempest-TestServerVolumeAttachmentScenario-935081602 None] Flow 'volume_create_manager' (0d7e6a4c-ce6b-4a56-9eb2-2a2ae5497edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:28:42 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-d2e50c90-f832-4bf2-b9b3-2df382787753 tempest-TestServerVolumeAttachmentScenario-935081602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1696e6b7-d2fd-4b06-bcf8-6804134ce33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:42 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-d2e50c90-f832-4bf2-b9b3-2df382787753 tempest-TestServerVolumeAttachmentScenario-935081602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1696e6b7-d2fd-4b06-bcf8-6804134ce33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:28:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1649286994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66edbd78-1ff7-4c4f-8ec1-960433e3905c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c836e92023324c448ef41c45b3b68623',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:28:43Z,use_quota=True,user_id='8aca4f4b5deb49b984e1221fe24212d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:42 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-d2e50c90-f832-4bf2-b9b3-2df382787753 tempest-TestServerVolumeAttachmentScenario-935081602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6337bbe2-8f92-4a75-8019-c682e615a9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:42 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-d2e50c90-f832-4bf2-b9b3-2df382787753 tempest-TestServerVolumeAttachmentScenario-935081602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6337bbe2-8f92-4a75-8019-c682e615a9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:42 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-d2e50c90-f832-4bf2-b9b3-2df382787753 tempest-TestServerVolumeAttachmentScenario-935081602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a791a49-f5f4-447b-8b53-1598599c2f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:42 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-d2e50c90-f832-4bf2-b9b3-2df382787753 tempest-TestServerVolumeAttachmentScenario-935081602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a791a49-f5f4-447b-8b53-1598599c2f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66edbd78-1ff7-4c4f-8ec1-960433e3905c', 'volume_name': 'volume-66edbd78-1ff7-4c4f-8ec1-960433e3905c', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:42 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-d2e50c90-f832-4bf2-b9b3-2df382787753 tempest-TestServerVolumeAttachmentScenario-935081602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4b5e07d-2488-4f11-9d8c-1c200865f595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:42 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-d2e50c90-f832-4bf2-b9b3-2df382787753 tempest-TestServerVolumeAttachmentScenario-935081602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4b5e07d-2488-4f11-9d8c-1c200865f595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:42 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-d2e50c90-f832-4bf2-b9b3-2df382787753 tempest-TestServerVolumeAttachmentScenario-935081602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f28af4fa-ef79-4bd2-b820-6b77d9016db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:42 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-d2e50c90-f832-4bf2-b9b3-2df382787753 tempest-TestServerVolumeAttachmentScenario-935081602 None] Volume 66edbd78-1ff7-4c4f-8ec1-960433e3905c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66edbd78-1ff7-4c4f-8ec1-960433e3905c', 'volume_size': 1} Aug 31 15:28:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-d2e50c90-f832-4bf2-b9b3-2df382787753 tempest-TestServerVolumeAttachmentScenario-935081602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:28:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-d2e50c90-f832-4bf2-b9b3-2df382787753 tempest-TestServerVolumeAttachmentScenario-935081602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:28:42 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-d2e50c90-f832-4bf2-b9b3-2df382787753 tempest-TestServerVolumeAttachmentScenario-935081602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:28:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1649286994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66edbd78-1ff7-4c4f-8ec1-960433e3905c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c836e92023324c448ef41c45b3b68623',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:28:43Z,use_quota=True,user_id='8aca4f4b5deb49b984e1221fe24212d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:28:42 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-d2e50c90-f832-4bf2-b9b3-2df382787753 tempest-TestServerVolumeAttachmentScenario-935081602 None] Creating volume 66edbd78-1ff7-4c4f-8ec1-960433e3905c {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:28:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-d2e50c90-f832-4bf2-b9b3-2df382787753 tempest-TestServerVolumeAttachmentScenario-935081602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:28:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-d2e50c90-f832-4bf2-b9b3-2df382787753 tempest-TestServerVolumeAttachmentScenario-935081602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:28:42 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-d2e50c90-f832-4bf2-b9b3-2df382787753 tempest-TestServerVolumeAttachmentScenario-935081602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:28:42 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-d2e50c90-f832-4bf2-b9b3-2df382787753 tempest-TestServerVolumeAttachmentScenario-935081602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:28:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-d2e50c90-f832-4bf2-b9b3-2df382787753 tempest-TestServerVolumeAttachmentScenario-935081602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:28:42 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-d2e50c90-f832-4bf2-b9b3-2df382787753 tempest-TestServerVolumeAttachmentScenario-935081602 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:28:42 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-d2e50c90-f832-4bf2-b9b3-2df382787753 tempest-TestServerVolumeAttachmentScenario-935081602 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:28:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d2e50c90-f832-4bf2-b9b3-2df382787753 tempest-TestServerVolumeAttachmentScenario-935081602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-66edbd78-1ff7-4c4f-8ec1-960433e3905c 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:42 devstack sudo[104290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-66edbd78-1ff7-4c4f-8ec1-960433e3905c 1073741824 Aug 31 15:28:42 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:42 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-559e9d2b-4b6c-4eeb-8e8c-4a4baed33670 tempest-TestServerVolumeAttachmentScenario-935081602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:28:42 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-559e9d2b-4b6c-4eeb-8e8c-4a4baed33670 tempest-TestServerVolumeAttachmentScenario-935081602 None] Flow 'volume_create_manager' (850e4ba7-e7a4-417b-992e-ac721d56efe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:28:42 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-559e9d2b-4b6c-4eeb-8e8c-4a4baed33670 tempest-TestServerVolumeAttachmentScenario-935081602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2de20f4c-56b5-4862-a8c3-7c841a6dbe84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:42 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-559e9d2b-4b6c-4eeb-8e8c-4a4baed33670 tempest-TestServerVolumeAttachmentScenario-935081602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2de20f4c-56b5-4862-a8c3-7c841a6dbe84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1666441978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fcb2838-8004-45e2-8da6-ab63e384339b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c836e92023324c448ef41c45b3b68623',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:28:43Z,use_quota=True,user_id='8aca4f4b5deb49b984e1221fe24212d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:43 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-559e9d2b-4b6c-4eeb-8e8c-4a4baed33670 tempest-TestServerVolumeAttachmentScenario-935081602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdde1c10-d064-429e-9af7-9bcc84543fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:43 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-559e9d2b-4b6c-4eeb-8e8c-4a4baed33670 tempest-TestServerVolumeAttachmentScenario-935081602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdde1c10-d064-429e-9af7-9bcc84543fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:43 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-559e9d2b-4b6c-4eeb-8e8c-4a4baed33670 tempest-TestServerVolumeAttachmentScenario-935081602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac0c8021-6501-41d4-886e-20659266e1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:43 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-559e9d2b-4b6c-4eeb-8e8c-4a4baed33670 tempest-TestServerVolumeAttachmentScenario-935081602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac0c8021-6501-41d4-886e-20659266e1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fcb2838-8004-45e2-8da6-ab63e384339b', 'volume_name': 'volume-2fcb2838-8004-45e2-8da6-ab63e384339b', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:43 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-559e9d2b-4b6c-4eeb-8e8c-4a4baed33670 tempest-TestServerVolumeAttachmentScenario-935081602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cafa29ac-e9d6-47c9-a82a-c8a63d17dcb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:43 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-559e9d2b-4b6c-4eeb-8e8c-4a4baed33670 tempest-TestServerVolumeAttachmentScenario-935081602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cafa29ac-e9d6-47c9-a82a-c8a63d17dcb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:43 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-559e9d2b-4b6c-4eeb-8e8c-4a4baed33670 tempest-TestServerVolumeAttachmentScenario-935081602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caa9e48f-8094-42e0-8051-ec09395026f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:43 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-559e9d2b-4b6c-4eeb-8e8c-4a4baed33670 tempest-TestServerVolumeAttachmentScenario-935081602 None] Volume 2fcb2838-8004-45e2-8da6-ab63e384339b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fcb2838-8004-45e2-8da6-ab63e384339b', 'volume_size': 1} Aug 31 15:28:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-559e9d2b-4b6c-4eeb-8e8c-4a4baed33670 tempest-TestServerVolumeAttachmentScenario-935081602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:28:43 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d2e50c90-f832-4bf2-b9b3-2df382787753 tempest-TestServerVolumeAttachmentScenario-935081602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-66edbd78-1ff7-4c4f-8ec1-960433e3905c 1073741824" returned: 0 in 0.499s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d2e50c90-f832-4bf2-b9b3-2df382787753 tempest-TestServerVolumeAttachmentScenario-935081602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-66edbd78-1ff7-4c4f-8ec1-960433e3905c {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:43 devstack sudo[104296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-66edbd78-1ff7-4c4f-8ec1-960433e3905c Aug 31 15:28:43 devstack sudo[104296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:43 devstack sudo[104296]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d2e50c90-f832-4bf2-b9b3-2df382787753 tempest-TestServerVolumeAttachmentScenario-935081602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-66edbd78-1ff7-4c4f-8ec1-960433e3905c" returned: 0 in 0.260s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:43 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-d2e50c90-f832-4bf2-b9b3-2df382787753 tempest-TestServerVolumeAttachmentScenario-935081602 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:28:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-d2e50c90-f832-4bf2-b9b3-2df382787753 tempest-TestServerVolumeAttachmentScenario-935081602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:28:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-559e9d2b-4b6c-4eeb-8e8c-4a4baed33670 tempest-TestServerVolumeAttachmentScenario-935081602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.407s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:28:43 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-559e9d2b-4b6c-4eeb-8e8c-4a4baed33670 tempest-TestServerVolumeAttachmentScenario-935081602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1666441978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fcb2838-8004-45e2-8da6-ab63e384339b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c836e92023324c448ef41c45b3b68623',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:28:43Z,use_quota=True,user_id='8aca4f4b5deb49b984e1221fe24212d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:28:43 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-559e9d2b-4b6c-4eeb-8e8c-4a4baed33670 tempest-TestServerVolumeAttachmentScenario-935081602 None] Creating volume 2fcb2838-8004-45e2-8da6-ab63e384339b {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:28:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-559e9d2b-4b6c-4eeb-8e8c-4a4baed33670 tempest-TestServerVolumeAttachmentScenario-935081602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:28:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-559e9d2b-4b6c-4eeb-8e8c-4a4baed33670 tempest-TestServerVolumeAttachmentScenario-935081602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:28:43 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-559e9d2b-4b6c-4eeb-8e8c-4a4baed33670 tempest-TestServerVolumeAttachmentScenario-935081602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:28:43 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-559e9d2b-4b6c-4eeb-8e8c-4a4baed33670 tempest-TestServerVolumeAttachmentScenario-935081602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:28:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-559e9d2b-4b6c-4eeb-8e8c-4a4baed33670 tempest-TestServerVolumeAttachmentScenario-935081602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:28:43 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-559e9d2b-4b6c-4eeb-8e8c-4a4baed33670 tempest-TestServerVolumeAttachmentScenario-935081602 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:28:43 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-559e9d2b-4b6c-4eeb-8e8c-4a4baed33670 tempest-TestServerVolumeAttachmentScenario-935081602 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:28:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-559e9d2b-4b6c-4eeb-8e8c-4a4baed33670 tempest-TestServerVolumeAttachmentScenario-935081602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2fcb2838-8004-45e2-8da6-ab63e384339b 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:43 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-d2e50c90-f832-4bf2-b9b3-2df382787753 tempest-TestServerVolumeAttachmentScenario-935081602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f28af4fa-ef79-4bd2-b820-6b77d9016db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66edbd78-1ff7-4c4f-8ec1-960433e3905c', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:43 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-d2e50c90-f832-4bf2-b9b3-2df382787753 tempest-TestServerVolumeAttachmentScenario-935081602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bbea185-990f-45c0-a296-038f10235c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:43 devstack sudo[104300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2fcb2838-8004-45e2-8da6-ab63e384339b 1073741824 Aug 31 15:28:43 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:43 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-d2e50c90-f832-4bf2-b9b3-2df382787753 tempest-TestServerVolumeAttachmentScenario-935081602 None] Volume volume-66edbd78-1ff7-4c4f-8ec1-960433e3905c (66edbd78-1ff7-4c4f-8ec1-960433e3905c): created successfully Aug 31 15:28:43 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-d2e50c90-f832-4bf2-b9b3-2df382787753 tempest-TestServerVolumeAttachmentScenario-935081602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bbea185-990f-45c0-a296-038f10235c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:43 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-d2e50c90-f832-4bf2-b9b3-2df382787753 tempest-TestServerVolumeAttachmentScenario-935081602 None] Flow 'volume_create_manager' (0d7e6a4c-ce6b-4a56-9eb2-2a2ae5497edc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:28:43 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-d2e50c90-f832-4bf2-b9b3-2df382787753 tempest-TestServerVolumeAttachmentScenario-935081602 None] Created volume successfully. Aug 31 15:28:43 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-559e9d2b-4b6c-4eeb-8e8c-4a4baed33670 tempest-TestServerVolumeAttachmentScenario-935081602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2fcb2838-8004-45e2-8da6-ab63e384339b 1073741824" returned: 0 in 0.468s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-559e9d2b-4b6c-4eeb-8e8c-4a4baed33670 tempest-TestServerVolumeAttachmentScenario-935081602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2fcb2838-8004-45e2-8da6-ab63e384339b {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:43 devstack sudo[104306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2fcb2838-8004-45e2-8da6-ab63e384339b Aug 31 15:28:43 devstack sudo[104306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:44 devstack sudo[104306]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-559e9d2b-4b6c-4eeb-8e8c-4a4baed33670 tempest-TestServerVolumeAttachmentScenario-935081602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2fcb2838-8004-45e2-8da6-ab63e384339b" returned: 0 in 0.272s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:44 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-559e9d2b-4b6c-4eeb-8e8c-4a4baed33670 tempest-TestServerVolumeAttachmentScenario-935081602 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:28:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-559e9d2b-4b6c-4eeb-8e8c-4a4baed33670 tempest-TestServerVolumeAttachmentScenario-935081602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:28:44 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-559e9d2b-4b6c-4eeb-8e8c-4a4baed33670 tempest-TestServerVolumeAttachmentScenario-935081602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caa9e48f-8094-42e0-8051-ec09395026f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fcb2838-8004-45e2-8da6-ab63e384339b', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:44 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-559e9d2b-4b6c-4eeb-8e8c-4a4baed33670 tempest-TestServerVolumeAttachmentScenario-935081602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f58d3a1-e605-46af-9abc-1567dc594d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:28:44 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-559e9d2b-4b6c-4eeb-8e8c-4a4baed33670 tempest-TestServerVolumeAttachmentScenario-935081602 None] Volume volume-2fcb2838-8004-45e2-8da6-ab63e384339b (2fcb2838-8004-45e2-8da6-ab63e384339b): created successfully Aug 31 15:28:44 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-559e9d2b-4b6c-4eeb-8e8c-4a4baed33670 tempest-TestServerVolumeAttachmentScenario-935081602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f58d3a1-e605-46af-9abc-1567dc594d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:28:44 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-559e9d2b-4b6c-4eeb-8e8c-4a4baed33670 tempest-TestServerVolumeAttachmentScenario-935081602 None] Flow 'volume_create_manager' (850e4ba7-e7a4-417b-992e-ac721d56efe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:28:44 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-559e9d2b-4b6c-4eeb-8e8c-4a4baed33670 tempest-TestServerVolumeAttachmentScenario-935081602 None] Created volume successfully. Aug 31 15:28:45 devstack cinder-volume[86000]: DEBUG oslo_service.periodic_task [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86000) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:28:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:28:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:28:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:28:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:28:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:28:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:28:45 devstack sudo[104309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:28:45 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:28:45 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root Aug 31 15:28:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.247s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:28:45 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:28:45 devstack cinder-volume[86000]: DEBUG oslo_service.periodic_task [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running periodic task VolumeManager._thread_info {{(pid=86000) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:28:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] thread count: 28 {{(pid=86000) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 31 15:28:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] thread info: [<_MainThread(MainThread, started 137631281086592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86000) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 31 15:28:54 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:UPDATE=8,cinder:SELECT=5 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:28:54 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4,cinder:INSERT=2,cinder:DELETE=2 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:29:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-f411e80c-b1cb-4bf9-98c9-d1b1c46fa731 req-aa20e34e-a0d1-4c27-9eb5-b246e9e88e11 tempest-TestServerVolumeAttachmentScenario-935081602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:29:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-f411e80c-b1cb-4bf9-98c9-d1b1c46fa731 req-aa20e34e-a0d1-4c27-9eb5-b246e9e88e11 tempest-TestServerVolumeAttachmentScenario-935081602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:29:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-f411e80c-b1cb-4bf9-98c9-d1b1c46fa731 req-aa20e34e-a0d1-4c27-9eb5-b246e9e88e11 tempest-TestServerVolumeAttachmentScenario-935081602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:29:13 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-f411e80c-b1cb-4bf9-98c9-d1b1c46fa731 req-aa20e34e-a0d1-4c27-9eb5-b246e9e88e11 tempest-TestServerVolumeAttachmentScenario-935081602 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77', 'name': 'volume-66edbd78-1ff7-4c4f-8ec1-960433e3905c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '212dae0a-531e-42dc-afd5-2d94065e1d7c', 'enforce_multipath': True} {{(pid=86000) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 31 15:29:14 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-f411e80c-b1cb-4bf9-98c9-d1b1c46fa731 req-aa20e34e-a0d1-4c27-9eb5-b246e9e88e11 tempest-TestServerVolumeAttachmentScenario-935081602 None] attachment_update completed successfully. Aug 31 15:29:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-78faa091-f957-435a-bff1-40fa5804cbdb req-adaf2afc-f607-4d0f-b807-3caa4aec1ddf tempest-TestServerVolumeAttachmentScenario-935081602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:29:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-78faa091-f957-435a-bff1-40fa5804cbdb req-adaf2afc-f607-4d0f-b807-3caa4aec1ddf tempest-TestServerVolumeAttachmentScenario-935081602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:29:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [req-78faa091-f957-435a-bff1-40fa5804cbdb req-adaf2afc-f607-4d0f-b807-3caa4aec1ddf tempest-TestServerVolumeAttachmentScenario-935081602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:29:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-78faa091-f957-435a-bff1-40fa5804cbdb req-adaf2afc-f607-4d0f-b807-3caa4aec1ddf tempest-TestServerVolumeAttachmentScenario-935081602 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77', 'name': 'volume-2fcb2838-8004-45e2-8da6-ab63e384339b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '271c2073-8ae9-4e4b-aa93-7bc587e4b013', 'enforce_multipath': True} {{(pid=86000) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 31 15:29:17 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-78faa091-f957-435a-bff1-40fa5804cbdb req-adaf2afc-f607-4d0f-b807-3caa4aec1ddf tempest-TestServerVolumeAttachmentScenario-935081602 None] attachment_update completed successfully. Aug 31 15:29:18 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-45cabe12-e021-4a70-916f-5eb60c34de19 req-9bf2fe07-81bf-45b2-a99d-a7648f2bc6a5 tempest-TestServerVolumeAttachmentScenario-935081602 None] Terminate volume connection completed successfully. Aug 31 15:29:18 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-45cabe12-e021-4a70-916f-5eb60c34de19 req-9bf2fe07-81bf-45b2-a99d-a7648f2bc6a5 tempest-TestServerVolumeAttachmentScenario-935081602 None] Deleting attachment 271c2073-8ae9-4e4b-aa93-7bc587e4b013. {{(pid=86000) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 31 15:29:20 devstack cinder-volume[86000]: INFO cinder.volume.manager [req-d3606d58-8deb-4f4c-b9f2-82ea039c8908 req-b6c0e7eb-2a67-4522-a335-d030390645d2 tempest-TestServerVolumeAttachmentScenario-935081602 None] Terminate volume connection completed successfully. Aug 31 15:29:20 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [req-d3606d58-8deb-4f4c-b9f2-82ea039c8908 req-b6c0e7eb-2a67-4522-a335-d030390645d2 tempest-TestServerVolumeAttachmentScenario-935081602 None] Deleting attachment 212dae0a-531e-42dc-afd5-2d94065e1d7c. {{(pid=86000) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 31 15:29:24 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5dcad58b-70a9-4716-8be0-3abb3b556788 tempest-TestServerVolumeAttachmentScenario-935081602 None] Acquiring lock "cinder-2fcb2838-8004-45e2-8da6-ab63e384339b-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:29:24 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5dcad58b-70a9-4716-8be0-3abb3b556788 tempest-TestServerVolumeAttachmentScenario-935081602 None] Lock "cinder-2fcb2838-8004-45e2-8da6-ab63e384339b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:29:24 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5dcad58b-70a9-4716-8be0-3abb3b556788 tempest-TestServerVolumeAttachmentScenario-935081602 None] Acquiring lock "cinder-quobyte-2fcb2838-8004-45e2-8da6-ab63e384339b" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:29:24 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5dcad58b-70a9-4716-8be0-3abb3b556788 tempest-TestServerVolumeAttachmentScenario-935081602 None] Lock "cinder-quobyte-2fcb2838-8004-45e2-8da6-ab63e384339b" acquired by "delete_volume" :: waited 0.014s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:29:24 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab211b9-e44e-4aff-bf85-89f11e486958]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:29:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5dcad58b-70a9-4716-8be0-3abb3b556788 tempest-TestServerVolumeAttachmentScenario-935081602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2fcb2838-8004-45e2-8da6-ab63e384339b {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:29:24 devstack sudo[104894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2fcb2838-8004-45e2-8da6-ab63e384339b Aug 31 15:29:24 devstack sudo[104894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:29:25 devstack sudo[104894]: pam_unix(sudo:session): session closed for user root Aug 31 15:29:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5dcad58b-70a9-4716-8be0-3abb3b556788 tempest-TestServerVolumeAttachmentScenario-935081602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2fcb2838-8004-45e2-8da6-ab63e384339b" returned: 0 in 0.363s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:29:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5dcad58b-70a9-4716-8be0-3abb3b556788 tempest-TestServerVolumeAttachmentScenario-935081602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2fcb2838-8004-45e2-8da6-ab63e384339b {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:29:25 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2fcb2838-8004-45e2-8da6-ab63e384339b Aug 31 15:29:25 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:29:25 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Aug 31 15:29:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5dcad58b-70a9-4716-8be0-3abb3b556788 tempest-TestServerVolumeAttachmentScenario-935081602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2fcb2838-8004-45e2-8da6-ab63e384339b" returned: 0 in 0.245s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:29:25 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5dcad58b-70a9-4716-8be0-3abb3b556788 tempest-TestServerVolumeAttachmentScenario-935081602 None] Lock "cinder-quobyte-2fcb2838-8004-45e2-8da6-ab63e384339b" released by "delete_volume" :: held 0.649s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:29:25 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-5dcad58b-70a9-4716-8be0-3abb3b556788 tempest-TestServerVolumeAttachmentScenario-935081602 None] Created reservations ['f500ac6c-d4b0-41d2-9690-fcd8bced698c', 'a6e3c5b7-e8f2-4752-9b59-b4f1bbc28a79', 'b4c83b7a-a9b2-4991-818b-c94d42489a54', 'c5f112ec-a06a-40ee-aa52-0a45574c9b46'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:29:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5dcad58b-70a9-4716-8be0-3abb3b556788 tempest-TestServerVolumeAttachmentScenario-935081602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:29:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5dcad58b-70a9-4716-8be0-3abb3b556788 tempest-TestServerVolumeAttachmentScenario-935081602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:29:25 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5dcad58b-70a9-4716-8be0-3abb3b556788 tempest-TestServerVolumeAttachmentScenario-935081602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:29:25 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5dcad58b-70a9-4716-8be0-3abb3b556788 tempest-TestServerVolumeAttachmentScenario-935081602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:29:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5dcad58b-70a9-4716-8be0-3abb3b556788 tempest-TestServerVolumeAttachmentScenario-935081602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:29:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5dcad58b-70a9-4716-8be0-3abb3b556788 tempest-TestServerVolumeAttachmentScenario-935081602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:29:25 devstack sudo[104902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:29:25 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:29:25 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root Aug 31 15:29:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5dcad58b-70a9-4716-8be0-3abb3b556788 tempest-TestServerVolumeAttachmentScenario-935081602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.234s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:29:25 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-5dcad58b-70a9-4716-8be0-3abb3b556788 tempest-TestServerVolumeAttachmentScenario-935081602 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:29:25 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-5dcad58b-70a9-4716-8be0-3abb3b556788 tempest-TestServerVolumeAttachmentScenario-935081602 None] Deleted volume successfully. Aug 31 15:29:25 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5dcad58b-70a9-4716-8be0-3abb3b556788 tempest-TestServerVolumeAttachmentScenario-935081602 None] Lock "cinder-2fcb2838-8004-45e2-8da6-ab63e384339b-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:29:25 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-1322f48e-7bae-44c1-8ef2-196d37b76dbc tempest-TestServerVolumeAttachmentScenario-935081602 None] Acquiring lock "cinder-66edbd78-1ff7-4c4f-8ec1-960433e3905c-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:29:25 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-1322f48e-7bae-44c1-8ef2-196d37b76dbc tempest-TestServerVolumeAttachmentScenario-935081602 None] Lock "cinder-66edbd78-1ff7-4c4f-8ec1-960433e3905c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:29:25 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-1322f48e-7bae-44c1-8ef2-196d37b76dbc tempest-TestServerVolumeAttachmentScenario-935081602 None] Acquiring lock "cinder-quobyte-66edbd78-1ff7-4c4f-8ec1-960433e3905c" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:29:25 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-1322f48e-7bae-44c1-8ef2-196d37b76dbc tempest-TestServerVolumeAttachmentScenario-935081602 None] Lock "cinder-quobyte-66edbd78-1ff7-4c4f-8ec1-960433e3905c" acquired by "delete_volume" :: waited 0.013s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:29:25 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb877ed-0de1-47df-96c6-c9af402ca999]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:29:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1322f48e-7bae-44c1-8ef2-196d37b76dbc tempest-TestServerVolumeAttachmentScenario-935081602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-66edbd78-1ff7-4c4f-8ec1-960433e3905c {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:29:26 devstack sudo[104905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-66edbd78-1ff7-4c4f-8ec1-960433e3905c Aug 31 15:29:26 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:29:26 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root Aug 31 15:29:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1322f48e-7bae-44c1-8ef2-196d37b76dbc tempest-TestServerVolumeAttachmentScenario-935081602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-66edbd78-1ff7-4c4f-8ec1-960433e3905c" returned: 0 in 0.374s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:29:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1322f48e-7bae-44c1-8ef2-196d37b76dbc tempest-TestServerVolumeAttachmentScenario-935081602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-66edbd78-1ff7-4c4f-8ec1-960433e3905c {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:29:26 devstack sudo[104944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-66edbd78-1ff7-4c4f-8ec1-960433e3905c Aug 31 15:29:26 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:29:26 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root Aug 31 15:29:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1322f48e-7bae-44c1-8ef2-196d37b76dbc tempest-TestServerVolumeAttachmentScenario-935081602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-66edbd78-1ff7-4c4f-8ec1-960433e3905c" returned: 0 in 0.240s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:29:26 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-1322f48e-7bae-44c1-8ef2-196d37b76dbc tempest-TestServerVolumeAttachmentScenario-935081602 None] Lock "cinder-quobyte-66edbd78-1ff7-4c4f-8ec1-960433e3905c" released by "delete_volume" :: held 0.647s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:29:26 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-1322f48e-7bae-44c1-8ef2-196d37b76dbc tempest-TestServerVolumeAttachmentScenario-935081602 None] Created reservations ['e6e7aa07-adc5-4381-b74d-b6f6de0bd4ca', 'a592031e-c60e-4812-abf4-5d66865cd78c', 'd094a23b-c4f3-474b-b8ad-c829bb1b0130', '4e1ce742-063a-4d9c-8c11-e9aecdca9d30'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:29:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1322f48e-7bae-44c1-8ef2-196d37b76dbc tempest-TestServerVolumeAttachmentScenario-935081602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:29:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1322f48e-7bae-44c1-8ef2-196d37b76dbc tempest-TestServerVolumeAttachmentScenario-935081602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:29:26 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1322f48e-7bae-44c1-8ef2-196d37b76dbc tempest-TestServerVolumeAttachmentScenario-935081602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:29:26 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1322f48e-7bae-44c1-8ef2-196d37b76dbc tempest-TestServerVolumeAttachmentScenario-935081602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:29:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1322f48e-7bae-44c1-8ef2-196d37b76dbc tempest-TestServerVolumeAttachmentScenario-935081602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:29:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1322f48e-7bae-44c1-8ef2-196d37b76dbc tempest-TestServerVolumeAttachmentScenario-935081602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:29:26 devstack sudo[104949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:29:26 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:29:26 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root Aug 31 15:29:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1322f48e-7bae-44c1-8ef2-196d37b76dbc tempest-TestServerVolumeAttachmentScenario-935081602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.239s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:29:26 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-1322f48e-7bae-44c1-8ef2-196d37b76dbc tempest-TestServerVolumeAttachmentScenario-935081602 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:29:26 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-1322f48e-7bae-44c1-8ef2-196d37b76dbc tempest-TestServerVolumeAttachmentScenario-935081602 None] Deleted volume successfully. Aug 31 15:29:26 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-1322f48e-7bae-44c1-8ef2-196d37b76dbc tempest-TestServerVolumeAttachmentScenario-935081602 None] Lock "cinder-66edbd78-1ff7-4c4f-8ec1-960433e3905c-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:29:36 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:SELECT=27,cinder:UPDATE=20,cinder:INSERT=5 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:29:36 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:SELECT=24,cinder:UPDATE=19,cinder:INSERT=3,cinder:DELETE=2 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:29:45 devstack cinder-volume[86000]: DEBUG oslo_service.periodic_task [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86000) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:29:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:29:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:29:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:29:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:29:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:29:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:29:45 devstack sudo[104967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:29:45 devstack sudo[104967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:29:45 devstack sudo[104967]: pam_unix(sudo:session): session closed for user root Aug 31 15:29:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.297s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:29:45 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:29:45 devstack cinder-volume[86000]: DEBUG oslo_service.periodic_task [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running periodic task VolumeManager._thread_info {{(pid=86000) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:29:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] thread count: 28 {{(pid=86000) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 31 15:29:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] thread info: [<_MainThread(MainThread, started 137631281086592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86000) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 31 15:29:56 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-1938696e-5387-4779-b1ca-e7a45da23f59 tempest-TestImageHashVerification-114278366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:29:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1938696e-5387-4779-b1ca-e7a45da23f59 tempest-TestImageHashVerification-114278366 None] Flow 'volume_create_manager' (0bbe6973-3e46-4eb7-9d90-6ecf1044b9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:29:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1938696e-5387-4779-b1ca-e7a45da23f59 tempest-TestImageHashVerification-114278366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3270e73-ea4a-47cd-acb5-06e44ea45b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:29:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1938696e-5387-4779-b1ca-e7a45da23f59 tempest-TestImageHashVerification-114278366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3270e73-ea4a-47cd-acb5-06e44ea45b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-421346558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=403d6b51-c909-4898-8ae2-20bf2022562d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b01dc546ea4a12829ded4d9459e141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:29:57Z,use_quota=True,user_id='2b3a57869df84063afaf4b6f67903081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:29:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1938696e-5387-4779-b1ca-e7a45da23f59 tempest-TestImageHashVerification-114278366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30b7e6fa-01e6-4794-a6d2-d17047e1f4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:29:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1938696e-5387-4779-b1ca-e7a45da23f59 tempest-TestImageHashVerification-114278366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30b7e6fa-01e6-4794-a6d2-d17047e1f4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:29:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1938696e-5387-4779-b1ca-e7a45da23f59 tempest-TestImageHashVerification-114278366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (327f890c-fee7-43c3-91b0-1749297a3b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:29:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1938696e-5387-4779-b1ca-e7a45da23f59 tempest-TestImageHashVerification-114278366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (327f890c-fee7-43c3-91b0-1749297a3b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '403d6b51-c909-4898-8ae2-20bf2022562d', 'volume_name': 'volume-403d6b51-c909-4898-8ae2-20bf2022562d', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:29:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1938696e-5387-4779-b1ca-e7a45da23f59 tempest-TestImageHashVerification-114278366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffa75983-46b9-4d13-8d3e-c4112c4eb4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:29:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1938696e-5387-4779-b1ca-e7a45da23f59 tempest-TestImageHashVerification-114278366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffa75983-46b9-4d13-8d3e-c4112c4eb4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:29:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1938696e-5387-4779-b1ca-e7a45da23f59 tempest-TestImageHashVerification-114278366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (344dd974-2bdb-4997-b1f2-d38297b1ccb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:29:56 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-1938696e-5387-4779-b1ca-e7a45da23f59 tempest-TestImageHashVerification-114278366 None] Volume 403d6b51-c909-4898-8ae2-20bf2022562d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-403d6b51-c909-4898-8ae2-20bf2022562d', 'volume_size': 1} Aug 31 15:29:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1938696e-5387-4779-b1ca-e7a45da23f59 tempest-TestImageHashVerification-114278366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:29:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1938696e-5387-4779-b1ca-e7a45da23f59 tempest-TestImageHashVerification-114278366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:29:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1938696e-5387-4779-b1ca-e7a45da23f59 tempest-TestImageHashVerification-114278366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-421346558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=403d6b51-c909-4898-8ae2-20bf2022562d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b01dc546ea4a12829ded4d9459e141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:29:57Z,use_quota=True,user_id='2b3a57869df84063afaf4b6f67903081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:29:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-1938696e-5387-4779-b1ca-e7a45da23f59 tempest-TestImageHashVerification-114278366 None] Creating volume 403d6b51-c909-4898-8ae2-20bf2022562d {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:29:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1938696e-5387-4779-b1ca-e7a45da23f59 tempest-TestImageHashVerification-114278366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:29:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1938696e-5387-4779-b1ca-e7a45da23f59 tempest-TestImageHashVerification-114278366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:29:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1938696e-5387-4779-b1ca-e7a45da23f59 tempest-TestImageHashVerification-114278366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:29:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1938696e-5387-4779-b1ca-e7a45da23f59 tempest-TestImageHashVerification-114278366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:29:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1938696e-5387-4779-b1ca-e7a45da23f59 tempest-TestImageHashVerification-114278366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:29:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1938696e-5387-4779-b1ca-e7a45da23f59 tempest-TestImageHashVerification-114278366 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:29:56 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-1938696e-5387-4779-b1ca-e7a45da23f59 tempest-TestImageHashVerification-114278366 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:29:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1938696e-5387-4779-b1ca-e7a45da23f59 tempest-TestImageHashVerification-114278366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-403d6b51-c909-4898-8ae2-20bf2022562d 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:29:56 devstack sudo[104971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-403d6b51-c909-4898-8ae2-20bf2022562d 1073741824 Aug 31 15:29:56 devstack sudo[104971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:29:57 devstack sudo[104971]: pam_unix(sudo:session): session closed for user root Aug 31 15:29:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1938696e-5387-4779-b1ca-e7a45da23f59 tempest-TestImageHashVerification-114278366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-403d6b51-c909-4898-8ae2-20bf2022562d 1073741824" returned: 0 in 0.393s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:29:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1938696e-5387-4779-b1ca-e7a45da23f59 tempest-TestImageHashVerification-114278366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-403d6b51-c909-4898-8ae2-20bf2022562d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:29:57 devstack sudo[104976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-403d6b51-c909-4898-8ae2-20bf2022562d Aug 31 15:29:57 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:29:57 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root Aug 31 15:29:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1938696e-5387-4779-b1ca-e7a45da23f59 tempest-TestImageHashVerification-114278366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-403d6b51-c909-4898-8ae2-20bf2022562d" returned: 0 in 0.236s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:29:57 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1938696e-5387-4779-b1ca-e7a45da23f59 tempest-TestImageHashVerification-114278366 None] <== create_volume: return (666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:29:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1938696e-5387-4779-b1ca-e7a45da23f59 tempest-TestImageHashVerification-114278366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.668s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:29:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1938696e-5387-4779-b1ca-e7a45da23f59 tempest-TestImageHashVerification-114278366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (344dd974-2bdb-4997-b1f2-d38297b1ccb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-403d6b51-c909-4898-8ae2-20bf2022562d', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:29:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1938696e-5387-4779-b1ca-e7a45da23f59 tempest-TestImageHashVerification-114278366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6b9c347-a422-499d-a84d-cee1482d56d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:29:57 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-1938696e-5387-4779-b1ca-e7a45da23f59 tempest-TestImageHashVerification-114278366 None] Volume volume-403d6b51-c909-4898-8ae2-20bf2022562d (403d6b51-c909-4898-8ae2-20bf2022562d): created successfully Aug 31 15:29:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1938696e-5387-4779-b1ca-e7a45da23f59 tempest-TestImageHashVerification-114278366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6b9c347-a422-499d-a84d-cee1482d56d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:29:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1938696e-5387-4779-b1ca-e7a45da23f59 tempest-TestImageHashVerification-114278366 None] Flow 'volume_create_manager' (0bbe6973-3e46-4eb7-9d90-6ecf1044b9a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:29:57 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-1938696e-5387-4779-b1ca-e7a45da23f59 tempest-TestImageHashVerification-114278366 None] Created volume successfully. Aug 31 15:29:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-17d75b95-c7d7-4d6b-a68b-a1f10c734ee7 tempest-TestImageHashVerification-114278366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:29:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-17d75b95-c7d7-4d6b-a68b-a1f10c734ee7 tempest-TestImageHashVerification-114278366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:29:58 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f82e18-c25f-4ed6-bf1a-de8e32f997d2]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:29:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-17d75b95-c7d7-4d6b-a68b-a1f10c734ee7 tempest-TestImageHashVerification-114278366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-403d6b51-c909-4898-8ae2-20bf2022562d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:29:58 devstack sudo[104979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-403d6b51-c909-4898-8ae2-20bf2022562d Aug 31 15:29:58 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:29:58 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root Aug 31 15:29:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-17d75b95-c7d7-4d6b-a68b-a1f10c734ee7 tempest-TestImageHashVerification-114278366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-403d6b51-c909-4898-8ae2-20bf2022562d" returned: 0 in 0.335s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:29:58 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b695d1-d57a-4547-9d3d-80d54b42b181]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:29:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-17d75b95-c7d7-4d6b-a68b-a1f10c734ee7 tempest-TestImageHashVerification-114278366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-403d6b51-c909-4898-8ae2-20bf2022562d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:29:58 devstack sudo[104984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-403d6b51-c909-4898-8ae2-20bf2022562d Aug 31 15:29:58 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:29:59 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root Aug 31 15:29:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-17d75b95-c7d7-4d6b-a68b-a1f10c734ee7 tempest-TestImageHashVerification-114278366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-403d6b51-c909-4898-8ae2-20bf2022562d" returned: 0 in 0.349s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:29:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-17d75b95-c7d7-4d6b-a68b-a1f10c734ee7 tempest-TestImageHashVerification-114278366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-403d6b51-c909-4898-8ae2-20bf2022562d /opt/stack/data/cinder/conversion/403d6b51-c909-4898-8ae2-20bf2022562d.temp_image.bfd299b4-4ea0-4422-9dd5-e147e79b8d2dpe9kpyze.img {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:29:59 devstack sudo[104990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-403d6b51-c909-4898-8ae2-20bf2022562d /opt/stack/data/cinder/conversion/403d6b51-c909-4898-8ae2-20bf2022562d.temp_image.bfd299b4-4ea0-4422-9dd5-e147e79b8d2dpe9kpyze.img Aug 31 15:29:59 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:30:02 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root Aug 31 15:30:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-17d75b95-c7d7-4d6b-a68b-a1f10c734ee7 tempest-TestImageHashVerification-114278366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-403d6b51-c909-4898-8ae2-20bf2022562d /opt/stack/data/cinder/conversion/403d6b51-c909-4898-8ae2-20bf2022562d.temp_image.bfd299b4-4ea0-4422-9dd5-e147e79b8d2dpe9kpyze.img" returned: 0 in 3.729s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:30:02 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8275259-6d6b-4a80-be22-f2088e588b4b]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:30:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-17d75b95-c7d7-4d6b-a68b-a1f10c734ee7 tempest-TestImageHashVerification-114278366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-403d6b51-c909-4898-8ae2-20bf2022562d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:30:03 devstack sudo[105004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-403d6b51-c909-4898-8ae2-20bf2022562d Aug 31 15:30:03 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:30:03 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root Aug 31 15:30:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-17d75b95-c7d7-4d6b-a68b-a1f10c734ee7 tempest-TestImageHashVerification-114278366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-403d6b51-c909-4898-8ae2-20bf2022562d" returned: 0 in 0.546s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:30:03 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-17d75b95-c7d7-4d6b-a68b-a1f10c734ee7 tempest-TestImageHashVerification-114278366 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-403d6b51-c909-4898-8ae2-20bf2022562d, size 1024.00 MB, duration 3.73 sec, destination /opt/stack/data/cinder/conversion/403d6b51-c909-4898-8ae2-20bf2022562d.temp_image.bfd299b4-4ea0-4422-9dd5-e147e79b8d2dpe9kpyze.img {{(pid=86000) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 31 15:30:03 devstack cinder-volume[86000]: INFO cinder.image.image_utils [None req-17d75b95-c7d7-4d6b-a68b-a1f10c734ee7 tempest-TestImageHashVerification-114278366 None] Converted 1024.00 MB image at 274.51 MB/s Aug 31 15:30:03 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-17d75b95-c7d7-4d6b-a68b-a1f10c734ee7 tempest-TestImageHashVerification-114278366 None] bfd299b4-4ea0-4422-9dd5-e147e79b8d2d was raw, no need to convert to raw {{(pid=86000) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 31 15:30:08 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:30:13 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:30:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-17d75b95-c7d7-4d6b-a68b-a1f10c734ee7 tempest-TestImageHashVerification-114278366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 23.175s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:30:21 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-17d75b95-c7d7-4d6b-a68b-a1f10c734ee7 tempest-TestImageHashVerification-114278366 None] Uploaded volume to glance image-id: bfd299b4-4ea0-4422-9dd5-e147e79b8d2d. {{(pid=86000) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 31 15:30:21 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-17d75b95-c7d7-4d6b-a68b-a1f10c734ee7 tempest-TestImageHashVerification-114278366 None] Copy volume to image completed successfully. Aug 31 15:30:22 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a629b033-9381-4c68-949d-cf7e5b197e0e tempest-TestImageHashVerification-114278366 None] Acquiring lock "cinder-403d6b51-c909-4898-8ae2-20bf2022562d-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:30:22 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a629b033-9381-4c68-949d-cf7e5b197e0e tempest-TestImageHashVerification-114278366 None] Lock "cinder-403d6b51-c909-4898-8ae2-20bf2022562d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:30:22 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a629b033-9381-4c68-949d-cf7e5b197e0e tempest-TestImageHashVerification-114278366 None] Acquiring lock "cinder-quobyte-403d6b51-c909-4898-8ae2-20bf2022562d" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:30:23 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a629b033-9381-4c68-949d-cf7e5b197e0e tempest-TestImageHashVerification-114278366 None] Lock "cinder-quobyte-403d6b51-c909-4898-8ae2-20bf2022562d" acquired by "delete_volume" :: waited 0.017s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:30:23 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[056a600c-3964-417a-801f-a26adaae16e6]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:30:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a629b033-9381-4c68-949d-cf7e5b197e0e tempest-TestImageHashVerification-114278366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-403d6b51-c909-4898-8ae2-20bf2022562d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:30:23 devstack sudo[105014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-403d6b51-c909-4898-8ae2-20bf2022562d Aug 31 15:30:23 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:30:23 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root Aug 31 15:30:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a629b033-9381-4c68-949d-cf7e5b197e0e tempest-TestImageHashVerification-114278366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-403d6b51-c909-4898-8ae2-20bf2022562d" returned: 0 in 0.348s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:30:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a629b033-9381-4c68-949d-cf7e5b197e0e tempest-TestImageHashVerification-114278366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-403d6b51-c909-4898-8ae2-20bf2022562d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:30:23 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-403d6b51-c909-4898-8ae2-20bf2022562d Aug 31 15:30:23 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:30:23 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Aug 31 15:30:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a629b033-9381-4c68-949d-cf7e5b197e0e tempest-TestImageHashVerification-114278366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-403d6b51-c909-4898-8ae2-20bf2022562d" returned: 0 in 0.234s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:30:23 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a629b033-9381-4c68-949d-cf7e5b197e0e tempest-TestImageHashVerification-114278366 None] Lock "cinder-quobyte-403d6b51-c909-4898-8ae2-20bf2022562d" released by "delete_volume" :: held 0.618s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:30:23 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-a629b033-9381-4c68-949d-cf7e5b197e0e tempest-TestImageHashVerification-114278366 None] Created reservations ['898923ea-de5c-4b06-bf0e-dd4b403dc7d4', 'ec4307c5-ed9f-4b00-9ae2-f2949b590bb4', '28f89947-4163-4a9b-88b0-0ef417bde911', 'cb6eec53-901d-4ce2-b229-719af542bb53'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:30:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-a629b033-9381-4c68-949d-cf7e5b197e0e tempest-TestImageHashVerification-114278366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:30:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-a629b033-9381-4c68-949d-cf7e5b197e0e tempest-TestImageHashVerification-114278366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:30:23 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-a629b033-9381-4c68-949d-cf7e5b197e0e tempest-TestImageHashVerification-114278366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:30:23 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-a629b033-9381-4c68-949d-cf7e5b197e0e tempest-TestImageHashVerification-114278366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:30:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-a629b033-9381-4c68-949d-cf7e5b197e0e tempest-TestImageHashVerification-114278366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:30:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a629b033-9381-4c68-949d-cf7e5b197e0e tempest-TestImageHashVerification-114278366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:30:23 devstack sudo[105022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:30:23 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:30:23 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root Aug 31 15:30:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a629b033-9381-4c68-949d-cf7e5b197e0e tempest-TestImageHashVerification-114278366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.234s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:30:23 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-a629b033-9381-4c68-949d-cf7e5b197e0e tempest-TestImageHashVerification-114278366 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:30:23 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-a629b033-9381-4c68-949d-cf7e5b197e0e tempest-TestImageHashVerification-114278366 None] Deleted volume successfully. Aug 31 15:30:23 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a629b033-9381-4c68-949d-cf7e5b197e0e tempest-TestImageHashVerification-114278366 None] Lock "cinder-403d6b51-c909-4898-8ae2-20bf2022562d-delete_volume" released by "delete_volume" :: held 1.042s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:30:33 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:UPDATE=11,cinder:SELECT=3,cinder:INSERT=2 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:30:33 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:30:45 devstack cinder-volume[86000]: DEBUG oslo_service.periodic_task [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86000) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:30:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:30:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:30:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:30:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:30:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:30:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:30:45 devstack sudo[105099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:30:45 devstack sudo[105099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:30:45 devstack sudo[105099]: pam_unix(sudo:session): session closed for user root Aug 31 15:30:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.243s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:30:45 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:30:45 devstack cinder-volume[86000]: DEBUG oslo_service.periodic_task [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running periodic task VolumeManager._thread_info {{(pid=86000) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:30:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] thread count: 28 {{(pid=86000) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 31 15:30:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] thread info: [<_MainThread(MainThread, started 137631281086592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86000) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 31 15:30:53 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-96fad398-48ff-4f2d-9f34-57dc2610e2e2 tempest-CinderUnicodeTest-1215655246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:30:53 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-96fad398-48ff-4f2d-9f34-57dc2610e2e2 tempest-CinderUnicodeTest-1215655246 None] Flow 'volume_create_manager' (34965662-8c61-4691-b459-4205ab66ffbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:30:53 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-96fad398-48ff-4f2d-9f34-57dc2610e2e2 tempest-CinderUnicodeTest-1215655246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cd2c0ff-dd93-47a8-8cff-f50cfa23d3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:53 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-96fad398-48ff-4f2d-9f34-57dc2610e2e2 tempest-CinderUnicodeTest-1215655246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cd2c0ff-dd93-47a8-8cff-f50cfa23d3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:30:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ac385e2-d9e2-489d-9038-4f67a592961d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fa673dc7da24a6a81fb45334637103c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:30:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:30:53Z,use_quota=True,user_id='c5b29ed7b0af4f04b4f5ec0c0c3ac7c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:53 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-96fad398-48ff-4f2d-9f34-57dc2610e2e2 tempest-CinderUnicodeTest-1215655246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5a3c366-27f9-4d2c-89fd-2743f82f2681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:53 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-96fad398-48ff-4f2d-9f34-57dc2610e2e2 tempest-CinderUnicodeTest-1215655246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5a3c366-27f9-4d2c-89fd-2743f82f2681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:53 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-96fad398-48ff-4f2d-9f34-57dc2610e2e2 tempest-CinderUnicodeTest-1215655246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (217f6c39-6f12-413a-afff-e5947dc8d87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:53 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-96fad398-48ff-4f2d-9f34-57dc2610e2e2 tempest-CinderUnicodeTest-1215655246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (217f6c39-6f12-413a-afff-e5947dc8d87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ac385e2-d9e2-489d-9038-4f67a592961d', 'volume_name': 'volume-9ac385e2-d9e2-489d-9038-4f67a592961d', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:53 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-96fad398-48ff-4f2d-9f34-57dc2610e2e2 tempest-CinderUnicodeTest-1215655246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf01efbf-73c6-43d5-8bea-4c22ecbe41fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:53 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-96fad398-48ff-4f2d-9f34-57dc2610e2e2 tempest-CinderUnicodeTest-1215655246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf01efbf-73c6-43d5-8bea-4c22ecbe41fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:53 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-96fad398-48ff-4f2d-9f34-57dc2610e2e2 tempest-CinderUnicodeTest-1215655246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9acc280-5865-4e9a-bc21-94eb45788934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:53 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-96fad398-48ff-4f2d-9f34-57dc2610e2e2 tempest-CinderUnicodeTest-1215655246 None] Volume 9ac385e2-d9e2-489d-9038-4f67a592961d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ac385e2-d9e2-489d-9038-4f67a592961d', 'volume_size': 1} Aug 31 15:30:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-96fad398-48ff-4f2d-9f34-57dc2610e2e2 tempest-CinderUnicodeTest-1215655246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:30:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-96fad398-48ff-4f2d-9f34-57dc2610e2e2 tempest-CinderUnicodeTest-1215655246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:30:53 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-96fad398-48ff-4f2d-9f34-57dc2610e2e2 tempest-CinderUnicodeTest-1215655246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:30:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ac385e2-d9e2-489d-9038-4f67a592961d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fa673dc7da24a6a81fb45334637103c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:30:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:30:53Z,use_quota=True,user_id='c5b29ed7b0af4f04b4f5ec0c0c3ac7c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:30:53 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-96fad398-48ff-4f2d-9f34-57dc2610e2e2 tempest-CinderUnicodeTest-1215655246 None] Creating volume 9ac385e2-d9e2-489d-9038-4f67a592961d {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:30:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-96fad398-48ff-4f2d-9f34-57dc2610e2e2 tempest-CinderUnicodeTest-1215655246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:30:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-96fad398-48ff-4f2d-9f34-57dc2610e2e2 tempest-CinderUnicodeTest-1215655246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:30:53 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-96fad398-48ff-4f2d-9f34-57dc2610e2e2 tempest-CinderUnicodeTest-1215655246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:30:53 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-96fad398-48ff-4f2d-9f34-57dc2610e2e2 tempest-CinderUnicodeTest-1215655246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:30:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-96fad398-48ff-4f2d-9f34-57dc2610e2e2 tempest-CinderUnicodeTest-1215655246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:30:53 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-96fad398-48ff-4f2d-9f34-57dc2610e2e2 tempest-CinderUnicodeTest-1215655246 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:30:53 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-96fad398-48ff-4f2d-9f34-57dc2610e2e2 tempest-CinderUnicodeTest-1215655246 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:30:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-96fad398-48ff-4f2d-9f34-57dc2610e2e2 tempest-CinderUnicodeTest-1215655246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9ac385e2-d9e2-489d-9038-4f67a592961d 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:30:53 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f52205f-7ca6-43b2-b0ed-847458880c3a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:30:53 devstack sudo[105119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9ac385e2-d9e2-489d-9038-4f67a592961d 1073741824 Aug 31 15:30:53 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:30:53 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8f52205f-7ca6-43b2-b0ed-847458880c3a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Flow 'volume_create_manager' (256087d9-be02-4bab-98a5-114b7391a8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:30:53 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8f52205f-7ca6-43b2-b0ed-847458880c3a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0549bd3c-16e0-4305-9020-a43f7eedc1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:53 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8f52205f-7ca6-43b2-b0ed-847458880c3a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0549bd3c-16e0-4305-9020-a43f7eedc1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:30:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1129489806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e74651d-c8fb-46ab-a232-446053999779,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea2771fd90d048eaa15e8883cc33290d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:30:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:30:53Z,use_quota=True,user_id='0f6f4c54bd3045c584958a25fc96e42a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:53 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8f52205f-7ca6-43b2-b0ed-847458880c3a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a47f3b85-6bb7-4c62-9293-3d59ba7da522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:53 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8f52205f-7ca6-43b2-b0ed-847458880c3a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a47f3b85-6bb7-4c62-9293-3d59ba7da522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:53 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8f52205f-7ca6-43b2-b0ed-847458880c3a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bba6074-3e1c-4c28-9689-2efaba14b6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:53 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8f52205f-7ca6-43b2-b0ed-847458880c3a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bba6074-3e1c-4c28-9689-2efaba14b6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e74651d-c8fb-46ab-a232-446053999779', 'volume_name': 'volume-8e74651d-c8fb-46ab-a232-446053999779', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:53 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8f52205f-7ca6-43b2-b0ed-847458880c3a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a580a13-0cc0-43c2-bdc9-1cb0184875fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:53 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8f52205f-7ca6-43b2-b0ed-847458880c3a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a580a13-0cc0-43c2-bdc9-1cb0184875fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:53 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8f52205f-7ca6-43b2-b0ed-847458880c3a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15ad7de2-0b04-44bd-9f39-65d763c2a64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:53 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-8f52205f-7ca6-43b2-b0ed-847458880c3a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Volume 8e74651d-c8fb-46ab-a232-446053999779: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e74651d-c8fb-46ab-a232-446053999779', 'volume_size': 1} Aug 31 15:30:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8f52205f-7ca6-43b2-b0ed-847458880c3a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:30:54 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root Aug 31 15:30:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-96fad398-48ff-4f2d-9f34-57dc2610e2e2 tempest-CinderUnicodeTest-1215655246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9ac385e2-d9e2-489d-9038-4f67a592961d 1073741824" returned: 0 in 0.478s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:30:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-96fad398-48ff-4f2d-9f34-57dc2610e2e2 tempest-CinderUnicodeTest-1215655246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9ac385e2-d9e2-489d-9038-4f67a592961d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:30:54 devstack sudo[105125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9ac385e2-d9e2-489d-9038-4f67a592961d Aug 31 15:30:54 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:30:54 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root Aug 31 15:30:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-96fad398-48ff-4f2d-9f34-57dc2610e2e2 tempest-CinderUnicodeTest-1215655246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9ac385e2-d9e2-489d-9038-4f67a592961d" returned: 0 in 0.260s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:30:54 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-96fad398-48ff-4f2d-9f34-57dc2610e2e2 tempest-CinderUnicodeTest-1215655246 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:30:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-96fad398-48ff-4f2d-9f34-57dc2610e2e2 tempest-CinderUnicodeTest-1215655246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:30:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8f52205f-7ca6-43b2-b0ed-847458880c3a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.693s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:30:54 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-8f52205f-7ca6-43b2-b0ed-847458880c3a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:30:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1129489806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e74651d-c8fb-46ab-a232-446053999779,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea2771fd90d048eaa15e8883cc33290d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:30:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:30:53Z,use_quota=True,user_id='0f6f4c54bd3045c584958a25fc96e42a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:30:54 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-8f52205f-7ca6-43b2-b0ed-847458880c3a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Creating volume 8e74651d-c8fb-46ab-a232-446053999779 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:30:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8f52205f-7ca6-43b2-b0ed-847458880c3a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:30:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8f52205f-7ca6-43b2-b0ed-847458880c3a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:30:54 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-8f52205f-7ca6-43b2-b0ed-847458880c3a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:30:54 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-8f52205f-7ca6-43b2-b0ed-847458880c3a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:30:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8f52205f-7ca6-43b2-b0ed-847458880c3a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:30:54 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-8f52205f-7ca6-43b2-b0ed-847458880c3a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:30:54 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-8f52205f-7ca6-43b2-b0ed-847458880c3a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:30:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8f52205f-7ca6-43b2-b0ed-847458880c3a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8e74651d-c8fb-46ab-a232-446053999779 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:30:54 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-96fad398-48ff-4f2d-9f34-57dc2610e2e2 tempest-CinderUnicodeTest-1215655246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9acc280-5865-4e9a-bc21-94eb45788934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ac385e2-d9e2-489d-9038-4f67a592961d', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:54 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-96fad398-48ff-4f2d-9f34-57dc2610e2e2 tempest-CinderUnicodeTest-1215655246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0957ab83-169c-4c78-91b0-c80b9df404bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:54 devstack sudo[105128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8e74651d-c8fb-46ab-a232-446053999779 1073741824 Aug 31 15:30:54 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:30:54 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-96fad398-48ff-4f2d-9f34-57dc2610e2e2 tempest-CinderUnicodeTest-1215655246 None] Volume volume-9ac385e2-d9e2-489d-9038-4f67a592961d (9ac385e2-d9e2-489d-9038-4f67a592961d): created successfully Aug 31 15:30:54 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-96fad398-48ff-4f2d-9f34-57dc2610e2e2 tempest-CinderUnicodeTest-1215655246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0957ab83-169c-4c78-91b0-c80b9df404bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:54 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-96fad398-48ff-4f2d-9f34-57dc2610e2e2 tempest-CinderUnicodeTest-1215655246 None] Flow 'volume_create_manager' (34965662-8c61-4691-b459-4205ab66ffbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:30:54 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-96fad398-48ff-4f2d-9f34-57dc2610e2e2 tempest-CinderUnicodeTest-1215655246 None] Created volume successfully. Aug 31 15:30:54 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root Aug 31 15:30:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8f52205f-7ca6-43b2-b0ed-847458880c3a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8e74651d-c8fb-46ab-a232-446053999779 1073741824" returned: 0 in 0.481s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:30:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8f52205f-7ca6-43b2-b0ed-847458880c3a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8e74651d-c8fb-46ab-a232-446053999779 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:30:54 devstack sudo[105134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8e74651d-c8fb-46ab-a232-446053999779 Aug 31 15:30:54 devstack sudo[105134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:30:55 devstack sudo[105134]: pam_unix(sudo:session): session closed for user root Aug 31 15:30:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8f52205f-7ca6-43b2-b0ed-847458880c3a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8e74651d-c8fb-46ab-a232-446053999779" returned: 0 in 0.281s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:30:55 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-8f52205f-7ca6-43b2-b0ed-847458880c3a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:30:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8f52205f-7ca6-43b2-b0ed-847458880c3a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:30:55 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8f52205f-7ca6-43b2-b0ed-847458880c3a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15ad7de2-0b04-44bd-9f39-65d763c2a64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e74651d-c8fb-46ab-a232-446053999779', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:55 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8f52205f-7ca6-43b2-b0ed-847458880c3a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3b1fc57-f014-4e1d-9e6b-d3ee1f7f6d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:55 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-8f52205f-7ca6-43b2-b0ed-847458880c3a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Volume volume-8e74651d-c8fb-46ab-a232-446053999779 (8e74651d-c8fb-46ab-a232-446053999779): created successfully Aug 31 15:30:55 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8f52205f-7ca6-43b2-b0ed-847458880c3a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3b1fc57-f014-4e1d-9e6b-d3ee1f7f6d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:55 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-8f52205f-7ca6-43b2-b0ed-847458880c3a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Flow 'volume_create_manager' (256087d9-be02-4bab-98a5-114b7391a8e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:30:55 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-8f52205f-7ca6-43b2-b0ed-847458880c3a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Created volume successfully. Aug 31 15:30:55 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:30:55 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Flow 'volume_create_manager' (08784324-b53a-4c8f-8cc4-5010e968781d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:30:55 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (983472cb-8185-42aa-b58b-ebd34e63f224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (983472cb-8185-42aa-b58b-ebd34e63f224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dbddef8-c247-48c9-b02b-469a122e535a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6b4b0228e6f4547ac1c2ff41d0a8eb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:30:56Z,use_quota=True,user_id='328a230b7075436483695cc28643f33f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cf75b2d-1491-4773-89d2-c0ae9381adb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cf75b2d-1491-4773-89d2-c0ae9381adb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (588154c7-bb9a-404c-8d53-b54d6a8b807e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:56 devstack cinder-volume[86000]: DEBUG cinder.image.glance [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Creating Keystone auth plugin from conf {{(pid=86000) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 31 15:30:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (588154c7-bb9a-404c-8d53-b54d6a8b807e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6dbddef8-c247-48c9-b02b-469a122e535a', 'volume_name': 'volume-6dbddef8-c247-48c9-b02b-469a122e535a', 'volume_size': 1, 'image_id': 'e4bd66a3-adfc-4f59-9ad6-0f8260788d51', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e4bd66a3-adfc-4f59-9ad6-0f8260788d51', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c46856bd040e1e763d55d9990eaac5e6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd6b4b0228e6f4547ac1c2ff41d0a8eb5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '00dfe5be5be1583bf2e4d53c1397982d058d560d5bb04a95162e983d750d44825295e0a04796cd10caf885fcb4ae969a5461caddba3b0b14801425660b3765df', 'id': 'e4bd66a3-adfc-4f59-9ad6-0f8260788d51', 'created_at': datetime.datetime(2026, 8, 31, 13, 30, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 13, 30, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e4bd66a3-adfc-4f59-9ad6-0f8260788d51/file', 'properties': {}}, 'image_service': }' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5af22790-2ff1-4ed3-89bf-94841fd444ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5af22790-2ff1-4ed3-89bf-94841fd444ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf20e981-c947-447b-8911-8fd3ddf076c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:56 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Volume 6dbddef8-c247-48c9-b02b-469a122e535a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6dbddef8-c247-48c9-b02b-469a122e535a', 'volume_size': 1, 'image_id': 'e4bd66a3-adfc-4f59-9ad6-0f8260788d51', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e4bd66a3-adfc-4f59-9ad6-0f8260788d51', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c46856bd040e1e763d55d9990eaac5e6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd6b4b0228e6f4547ac1c2ff41d0a8eb5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '00dfe5be5be1583bf2e4d53c1397982d058d560d5bb04a95162e983d750d44825295e0a04796cd10caf885fcb4ae969a5461caddba3b0b14801425660b3765df', 'id': 'e4bd66a3-adfc-4f59-9ad6-0f8260788d51', 'created_at': datetime.datetime(2026, 8, 31, 13, 30, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 13, 30, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e4bd66a3-adfc-4f59-9ad6-0f8260788d51/file', 'properties': {}}, 'image_service': } Aug 31 15:30:56 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Trying to clone 6dbddef8-c247-48c9-b02b-469a122e535a from image e4bd66a3-adfc-4f59-9ad6-0f8260788d51 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e4bd66a3-adfc-4f59-9ad6-0f8260788d51', 'metadata': {}}]). {{(pid=86000) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 31 15:30:56 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-30f62dd2-ad3e-4b35-95a3-42aac20534be tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:30:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-30f62dd2-ad3e-4b35-95a3-42aac20534be tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Flow 'volume_create_manager' (90484a2f-303d-43ec-80a0-6a7398defd57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:30:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-30f62dd2-ad3e-4b35-95a3-42aac20534be tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2acfebf-ffd9-4020-ba74-b74fc667c22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:56 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e4bd66a3-adfc-4f59-9ad6-0f8260788d51_ai97zbk_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86000) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 31 15:30:56 devstack cinder-volume[86000]: INFO cinder.image.image_utils [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Image download 0.00 MB at 0.00 MB/s Aug 31 15:30:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-30f62dd2-ad3e-4b35-95a3-42aac20534be tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2acfebf-ffd9-4020-ba74-b74fc667c22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-555175774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=997e7122-fde4-49a4-85c8-b86177fa39d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea2771fd90d048eaa15e8883cc33290d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:30:56Z,use_quota=True,user_id='0f6f4c54bd3045c584958a25fc96e42a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-30f62dd2-ad3e-4b35-95a3-42aac20534be tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a0f8335-23cf-483c-a82a-00bf4b389d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-30f62dd2-ad3e-4b35-95a3-42aac20534be tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a0f8335-23cf-483c-a82a-00bf4b389d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-30f62dd2-ad3e-4b35-95a3-42aac20534be tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b84fe40-8948-48c2-bc52-e0eef2f48543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-30f62dd2-ad3e-4b35-95a3-42aac20534be tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b84fe40-8948-48c2-bc52-e0eef2f48543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '997e7122-fde4-49a4-85c8-b86177fa39d0', 'volume_name': 'volume-997e7122-fde4-49a4-85c8-b86177fa39d0', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-30f62dd2-ad3e-4b35-95a3-42aac20534be tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa19dfd0-18b1-49e8-aa87-303d18b61ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-30f62dd2-ad3e-4b35-95a3-42aac20534be tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa19dfd0-18b1-49e8-aa87-303d18b61ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-30f62dd2-ad3e-4b35-95a3-42aac20534be tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (724a9ce1-c478-4f1d-9577-1f6df0a22a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:56 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-30f62dd2-ad3e-4b35-95a3-42aac20534be tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Volume 997e7122-fde4-49a4-85c8-b86177fa39d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-997e7122-fde4-49a4-85c8-b86177fa39d0', 'volume_size': 1} Aug 31 15:30:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-30f62dd2-ad3e-4b35-95a3-42aac20534be tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:30:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-30f62dd2-ad3e-4b35-95a3-42aac20534be tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:30:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-30f62dd2-ad3e-4b35-95a3-42aac20534be tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-555175774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=997e7122-fde4-49a4-85c8-b86177fa39d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea2771fd90d048eaa15e8883cc33290d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:30:56Z,use_quota=True,user_id='0f6f4c54bd3045c584958a25fc96e42a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:30:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-30f62dd2-ad3e-4b35-95a3-42aac20534be tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Creating volume 997e7122-fde4-49a4-85c8-b86177fa39d0 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:30:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-30f62dd2-ad3e-4b35-95a3-42aac20534be tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:30:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-30f62dd2-ad3e-4b35-95a3-42aac20534be tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:30:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-30f62dd2-ad3e-4b35-95a3-42aac20534be tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:30:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-30f62dd2-ad3e-4b35-95a3-42aac20534be tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:30:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-30f62dd2-ad3e-4b35-95a3-42aac20534be tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:30:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-30f62dd2-ad3e-4b35-95a3-42aac20534be tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:30:56 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-30f62dd2-ad3e-4b35-95a3-42aac20534be tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:30:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-30f62dd2-ad3e-4b35-95a3-42aac20534be tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-997e7122-fde4-49a4-85c8-b86177fa39d0 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:30:56 devstack sudo[105137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-997e7122-fde4-49a4-85c8-b86177fa39d0 1073741824 Aug 31 15:30:56 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:30:56 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ec4cec-021b-44cc-982b-36c741fea51d]: (4, 'raw') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:30:56 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-323efd4a-1943-4423-bf9a-f2ad60ea8520 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:30:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-323efd4a-1943-4423-bf9a-f2ad60ea8520 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Flow 'volume_create_manager' (b7fa5549-7ad6-47bc-add1-16317bc0d3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:30:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-323efd4a-1943-4423-bf9a-f2ad60ea8520 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (915876c8-b6d6-4773-8acf-d9d42a809fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4bd66a3-adfc-4f59-9ad6-0f8260788d51_ai97zbk_devstack@QuobyteHD {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:30:56 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a5b6a9b-8eaa-41bc-82f0-4ded671c46f3 tempest-CinderUnicodeTest-1215655246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:30:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6a5b6a9b-8eaa-41bc-82f0-4ded671c46f3 tempest-CinderUnicodeTest-1215655246 None] Flow 'volume_create_manager' (4d1e28a4-1901-44a7-9467-5e5527b71b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:30:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6a5b6a9b-8eaa-41bc-82f0-4ded671c46f3 tempest-CinderUnicodeTest-1215655246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (475f46ac-00f5-4e34-80a7-d0171d0caf1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-323efd4a-1943-4423-bf9a-f2ad60ea8520 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (915876c8-b6d6-4773-8acf-d9d42a809fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-949884188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f188829b-3ef5-4877-8871-2060688583b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea2771fd90d048eaa15e8883cc33290d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:30:57Z,use_quota=True,user_id='0f6f4c54bd3045c584958a25fc96e42a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-323efd4a-1943-4423-bf9a-f2ad60ea8520 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8efc12c8-3a9b-4f29-93a0-d4babaf4d070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-323efd4a-1943-4423-bf9a-f2ad60ea8520 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8efc12c8-3a9b-4f29-93a0-d4babaf4d070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-323efd4a-1943-4423-bf9a-f2ad60ea8520 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f4865bd-a7d2-4e68-b7ec-c2ce0de317ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-323efd4a-1943-4423-bf9a-f2ad60ea8520 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f4865bd-a7d2-4e68-b7ec-c2ce0de317ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f188829b-3ef5-4877-8871-2060688583b0', 'volume_name': 'volume-f188829b-3ef5-4877-8871-2060688583b0', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-323efd4a-1943-4423-bf9a-f2ad60ea8520 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e707e06-eb98-4da6-980c-d6d02aedd81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-323efd4a-1943-4423-bf9a-f2ad60ea8520 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e707e06-eb98-4da6-980c-d6d02aedd81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-323efd4a-1943-4423-bf9a-f2ad60ea8520 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c90a6e3-2ab1-44a0-8f0f-055183cbd80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:57 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-323efd4a-1943-4423-bf9a-f2ad60ea8520 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Volume f188829b-3ef5-4877-8871-2060688583b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f188829b-3ef5-4877-8871-2060688583b0', 'volume_size': 1} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-323efd4a-1943-4423-bf9a-f2ad60ea8520 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:30:57 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4bd66a3-adfc-4f59-9ad6-0f8260788d51_ai97zbk_devstack@QuobyteHD Aug 31 15:30:57 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6a5b6a9b-8eaa-41bc-82f0-4ded671c46f3 tempest-CinderUnicodeTest-1215655246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (475f46ac-00f5-4e34-80a7-d0171d0caf1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:30:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-262871708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68f3cb24-3921-401d-8730-15d82cfab6d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fa673dc7da24a6a81fb45334637103c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:30:56Z,use_quota=True,user_id='c5b29ed7b0af4f04b4f5ec0c0c3ac7c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6a5b6a9b-8eaa-41bc-82f0-4ded671c46f3 tempest-CinderUnicodeTest-1215655246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75e6d46e-f6dc-4fa3-baa5-b294611a4a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6a5b6a9b-8eaa-41bc-82f0-4ded671c46f3 tempest-CinderUnicodeTest-1215655246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75e6d46e-f6dc-4fa3-baa5-b294611a4a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6a5b6a9b-8eaa-41bc-82f0-4ded671c46f3 tempest-CinderUnicodeTest-1215655246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d50acbf-1589-40eb-bd34-2cc7e155f0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6a5b6a9b-8eaa-41bc-82f0-4ded671c46f3 tempest-CinderUnicodeTest-1215655246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d50acbf-1589-40eb-bd34-2cc7e155f0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68f3cb24-3921-401d-8730-15d82cfab6d4', 'volume_name': 'volume-68f3cb24-3921-401d-8730-15d82cfab6d4', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6a5b6a9b-8eaa-41bc-82f0-4ded671c46f3 tempest-CinderUnicodeTest-1215655246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e9bc13-dd5c-43d8-921c-675ddc263890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6a5b6a9b-8eaa-41bc-82f0-4ded671c46f3 tempest-CinderUnicodeTest-1215655246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e9bc13-dd5c-43d8-921c-675ddc263890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6a5b6a9b-8eaa-41bc-82f0-4ded671c46f3 tempest-CinderUnicodeTest-1215655246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12bfaec2-f93a-453c-b9b6-57e8c4af006c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:57 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-6a5b6a9b-8eaa-41bc-82f0-4ded671c46f3 tempest-CinderUnicodeTest-1215655246 None] Volume 68f3cb24-3921-401d-8730-15d82cfab6d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68f3cb24-3921-401d-8730-15d82cfab6d4', 'volume_size': 1} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6a5b6a9b-8eaa-41bc-82f0-4ded671c46f3 tempest-CinderUnicodeTest-1215655246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-9871505f-17c9-41fb-85eb-c0d38aa9ed57 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9871505f-17c9-41fb-85eb-c0d38aa9ed57 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Flow 'volume_create_manager' (a0ae15a7-d075-4df4-8250-27a42eeae597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9871505f-17c9-41fb-85eb-c0d38aa9ed57 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cf75354-45f0-4041-8fc2-c4a37fb48d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9871505f-17c9-41fb-85eb-c0d38aa9ed57 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cf75354-45f0-4041-8fc2-c4a37fb48d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2059443151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eb15d61-3681-4d77-b827-052962b96c55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea2771fd90d048eaa15e8883cc33290d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:30:57Z,use_quota=True,user_id='0f6f4c54bd3045c584958a25fc96e42a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9871505f-17c9-41fb-85eb-c0d38aa9ed57 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa805cbb-0218-47c2-9a98-53fbd261c882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9871505f-17c9-41fb-85eb-c0d38aa9ed57 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa805cbb-0218-47c2-9a98-53fbd261c882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9871505f-17c9-41fb-85eb-c0d38aa9ed57 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d2f3be7-1394-45c7-8fe7-7e00d48e0084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9871505f-17c9-41fb-85eb-c0d38aa9ed57 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d2f3be7-1394-45c7-8fe7-7e00d48e0084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4eb15d61-3681-4d77-b827-052962b96c55', 'volume_name': 'volume-4eb15d61-3681-4d77-b827-052962b96c55', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9871505f-17c9-41fb-85eb-c0d38aa9ed57 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb444b27-6f12-4806-966e-ba4aa88bea0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9871505f-17c9-41fb-85eb-c0d38aa9ed57 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb444b27-6f12-4806-966e-ba4aa88bea0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9871505f-17c9-41fb-85eb-c0d38aa9ed57 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e182175-8fca-4df1-9081-3626dba81724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:57 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-9871505f-17c9-41fb-85eb-c0d38aa9ed57 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Volume 4eb15d61-3681-4d77-b827-052962b96c55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4eb15d61-3681-4d77-b827-052962b96c55', 'volume_size': 1} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9871505f-17c9-41fb-85eb-c0d38aa9ed57 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:30:57 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4bd66a3-adfc-4f59-9ad6-0f8260788d51_ai97zbk_devstack@QuobyteHD" returned: 0 in 0.641s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4bd66a3-adfc-4f59-9ad6-0f8260788d51_ai97zbk_devstack@QuobyteHD {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:30:57 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-30f62dd2-ad3e-4b35-95a3-42aac20534be tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-997e7122-fde4-49a4-85c8-b86177fa39d0 1073741824" returned: 0 in 0.792s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-30f62dd2-ad3e-4b35-95a3-42aac20534be tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-997e7122-fde4-49a4-85c8-b86177fa39d0 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:30:57 devstack sudo[105147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-997e7122-fde4-49a4-85c8-b86177fa39d0 Aug 31 15:30:57 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:30:57 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4bd66a3-adfc-4f59-9ad6-0f8260788d51_ai97zbk_devstack@QuobyteHD Aug 31 15:30:57 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-664cfbbb-cf3c-4206-bf15-eab3bfaf48f2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-664cfbbb-cf3c-4206-bf15-eab3bfaf48f2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Flow 'volume_create_manager' (23bfa356-cc00-4d2d-8deb-dbe8183b459d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-664cfbbb-cf3c-4206-bf15-eab3bfaf48f2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0d77f6e-e877-4665-b025-cdd6ba2f49dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-664cfbbb-cf3c-4206-bf15-eab3bfaf48f2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0d77f6e-e877-4665-b025-cdd6ba2f49dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-594627375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e5d8c6-d1e7-4681-8a1d-d789e1034784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea2771fd90d048eaa15e8883cc33290d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:30:57Z,use_quota=True,user_id='0f6f4c54bd3045c584958a25fc96e42a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-664cfbbb-cf3c-4206-bf15-eab3bfaf48f2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03bfad52-c6f3-42b2-90e9-29243e7ef03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-664cfbbb-cf3c-4206-bf15-eab3bfaf48f2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03bfad52-c6f3-42b2-90e9-29243e7ef03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-664cfbbb-cf3c-4206-bf15-eab3bfaf48f2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (089cd8f0-9be6-4dee-8ee1-f19159f548ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-664cfbbb-cf3c-4206-bf15-eab3bfaf48f2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (089cd8f0-9be6-4dee-8ee1-f19159f548ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77e5d8c6-d1e7-4681-8a1d-d789e1034784', 'volume_name': 'volume-77e5d8c6-d1e7-4681-8a1d-d789e1034784', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-664cfbbb-cf3c-4206-bf15-eab3bfaf48f2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a57c2a6-d117-4c29-89d2-64e1694e403f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-664cfbbb-cf3c-4206-bf15-eab3bfaf48f2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a57c2a6-d117-4c29-89d2-64e1694e403f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-664cfbbb-cf3c-4206-bf15-eab3bfaf48f2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e8cf45f-6394-417d-9c18-8e78d99afb6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:57 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-664cfbbb-cf3c-4206-bf15-eab3bfaf48f2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Volume 77e5d8c6-d1e7-4681-8a1d-d789e1034784: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77e5d8c6-d1e7-4681-8a1d-d789e1034784', 'volume_size': 1} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-664cfbbb-cf3c-4206-bf15-eab3bfaf48f2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Flow 'volume_create_manager' (0f8b9957-8ad3-4691-9732-7b8e78a480bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc1ed1bb-5af4-42c6-b424-0a7e2ff1e7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc1ed1bb-5af4-42c6-b424-0a7e2ff1e7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3e122bf-672b-4403-86a4-465e2cf24cfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cfdb497c54d4f70833aee95e2f7da2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:30:58Z,use_quota=True,user_id='982322d8e6984062aab978090b881359',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49401c-cbb6-4e49-9e11-00bb9884ea90),volume_type_id=fc49401c-cbb6-4e49-9e11-00bb9884ea90)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82b8b51a-fdce-455d-b6c7-3bb4f49ccee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82b8b51a-fdce-455d-b6c7-3bb4f49ccee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f634cb3-1935-4b05-807a-bb7120699acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.image.glance [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Creating Keystone auth plugin from conf {{(pid=86000) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 31 15:30:57 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-30f62dd2-ad3e-4b35-95a3-42aac20534be tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-997e7122-fde4-49a4-85c8-b86177fa39d0" returned: 0 in 0.390s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-30f62dd2-ad3e-4b35-95a3-42aac20534be tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-30f62dd2-ad3e-4b35-95a3-42aac20534be tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.248s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-323efd4a-1943-4423-bf9a-f2ad60ea8520 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.844s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-323efd4a-1943-4423-bf9a-f2ad60ea8520 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-949884188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f188829b-3ef5-4877-8871-2060688583b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea2771fd90d048eaa15e8883cc33290d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:30:57Z,use_quota=True,user_id='0f6f4c54bd3045c584958a25fc96e42a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-323efd4a-1943-4423-bf9a-f2ad60ea8520 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Creating volume f188829b-3ef5-4877-8871-2060688583b0 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-323efd4a-1943-4423-bf9a-f2ad60ea8520 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-323efd4a-1943-4423-bf9a-f2ad60ea8520 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-323efd4a-1943-4423-bf9a-f2ad60ea8520 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-323efd4a-1943-4423-bf9a-f2ad60ea8520 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-323efd4a-1943-4423-bf9a-f2ad60ea8520 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-323efd4a-1943-4423-bf9a-f2ad60ea8520 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:30:57 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-323efd4a-1943-4423-bf9a-f2ad60ea8520 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-323efd4a-1943-4423-bf9a-f2ad60ea8520 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f188829b-3ef5-4877-8871-2060688583b0 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:30:57 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Aug 31 15:30:57 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f188829b-3ef5-4877-8871-2060688583b0 1073741824 Aug 31 15:30:57 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-30f62dd2-ad3e-4b35-95a3-42aac20534be tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (724a9ce1-c478-4f1d-9577-1f6df0a22a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-997e7122-fde4-49a4-85c8-b86177fa39d0', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-30f62dd2-ad3e-4b35-95a3-42aac20534be tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac5bf554-4649-452d-91d7-726be39f8628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4bd66a3-adfc-4f59-9ad6-0f8260788d51_ai97zbk_devstack@QuobyteHD" returned: 1 in 0.523s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:30:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4bd66a3-adfc-4f59-9ad6-0f8260788d51_ai97zbk_devstack@QuobyteHD' failed. Not Retrying. {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Temporary image e4bd66a3-adfc-4f59-9ad6-0f8260788d51 is fetched for user 328a230b7075436483695cc28643f33f. {{(pid=86000) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 31 15:30:58 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-30f62dd2-ad3e-4b35-95a3-42aac20534be tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Volume volume-997e7122-fde4-49a4-85c8-b86177fa39d0 (997e7122-fde4-49a4-85c8-b86177fa39d0): created successfully Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-30f62dd2-ad3e-4b35-95a3-42aac20534be tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac5bf554-4649-452d-91d7-726be39f8628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-30f62dd2-ad3e-4b35-95a3-42aac20534be tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Flow 'volume_create_manager' (90484a2f-303d-43ec-80a0-6a7398defd57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aa4663d-0b29-4787-87a5-03468aae74f4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0aa4663d-0b29-4787-87a5-03468aae74f4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Flow 'volume_create_manager' (44dc1d6d-df16-47b6-ac96-1b3f2fb94704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0aa4663d-0b29-4787-87a5-03468aae74f4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab501199-d6ed-4ac3-b6e2-ba3d0edc4b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:58 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-30f62dd2-ad3e-4b35-95a3-42aac20534be tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Created volume successfully. Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0aa4663d-0b29-4787-87a5-03468aae74f4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab501199-d6ed-4ac3-b6e2-ba3d0edc4b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-479251542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=349e6a8d-1814-4713-8486-a03993940e59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea2771fd90d048eaa15e8883cc33290d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:30:58Z,use_quota=True,user_id='0f6f4c54bd3045c584958a25fc96e42a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0aa4663d-0b29-4787-87a5-03468aae74f4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed2f88a4-f6f8-4fc8-9f7e-4deab0228103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0aa4663d-0b29-4787-87a5-03468aae74f4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed2f88a4-f6f8-4fc8-9f7e-4deab0228103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0aa4663d-0b29-4787-87a5-03468aae74f4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d58f02c-59ef-401f-99b2-1700b5f1b2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0aa4663d-0b29-4787-87a5-03468aae74f4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d58f02c-59ef-401f-99b2-1700b5f1b2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '349e6a8d-1814-4713-8486-a03993940e59', 'volume_name': 'volume-349e6a8d-1814-4713-8486-a03993940e59', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0aa4663d-0b29-4787-87a5-03468aae74f4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcf9f200-5091-4a7e-9388-88256bc02b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0aa4663d-0b29-4787-87a5-03468aae74f4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcf9f200-5091-4a7e-9388-88256bc02b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0aa4663d-0b29-4787-87a5-03468aae74f4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18719dcd-2e34-4ed4-a6fa-d136d63c17de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:58 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-0aa4663d-0b29-4787-87a5-03468aae74f4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Volume 349e6a8d-1814-4713-8486-a03993940e59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-349e6a8d-1814-4713-8486-a03993940e59', 'volume_size': 1} Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-0aa4663d-0b29-4787-87a5-03468aae74f4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bb454a-2ce5-4d2a-a491-5428fd7549a7]: (4, 'raw') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4bd66a3-adfc-4f59-9ad6-0f8260788d51_ai97zbk_devstack@QuobyteHD {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f634cb3-1935-4b05-807a-bb7120699acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a3e122bf-672b-4403-86a4-465e2cf24cfb', 'volume_name': 'volume-a3e122bf-672b-4403-86a4-465e2cf24cfb', 'volume_size': 1, 'image_id': '2aaba549-f833-4731-bbb5-a1a10c86ede1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2aaba549-f833-4731-bbb5-a1a10c86ede1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '88c36a8fb6c42cdb1ea0a833f2c089e1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8cfdb497c54d4f70833aee95e2f7da2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cf80503de09dc8c4d7018d6ae621e6ff59bf4f76823009d1f22cdca2c3d4b8cc689daf3d5ce3b7accb37289ed51f77914b84b20d6e73939402faf14abbf934bc', 'id': '2aaba549-f833-4731-bbb5-a1a10c86ede1', 'created_at': datetime.datetime(2026, 8, 31, 13, 30, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 13, 30, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2aaba549-f833-4731-bbb5-a1a10c86ede1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f14657e3-1440-43a1-bd6c-c23e22fa7335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f14657e3-1440-43a1-bd6c-c23e22fa7335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20a591be-b74c-421a-8225-3237136d0241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:58 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Volume a3e122bf-672b-4403-86a4-465e2cf24cfb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a3e122bf-672b-4403-86a4-465e2cf24cfb', 'volume_size': 1, 'image_id': '2aaba549-f833-4731-bbb5-a1a10c86ede1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2aaba549-f833-4731-bbb5-a1a10c86ede1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '88c36a8fb6c42cdb1ea0a833f2c089e1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8cfdb497c54d4f70833aee95e2f7da2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cf80503de09dc8c4d7018d6ae621e6ff59bf4f76823009d1f22cdca2c3d4b8cc689daf3d5ce3b7accb37289ed51f77914b84b20d6e73939402faf14abbf934bc', 'id': '2aaba549-f833-4731-bbb5-a1a10c86ede1', 'created_at': datetime.datetime(2026, 8, 31, 13, 30, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 13, 30, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2aaba549-f833-4731-bbb5-a1a10c86ede1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Trying to clone a3e122bf-672b-4403-86a4-465e2cf24cfb from image 2aaba549-f833-4731-bbb5-a1a10c86ede1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2aaba549-f833-4731-bbb5-a1a10c86ede1', 'metadata': {}}]). {{(pid=86000) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 31 15:30:58 devstack sudo[105156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4bd66a3-adfc-4f59-9ad6-0f8260788d51_ai97zbk_devstack@QuobyteHD Aug 31 15:30:58 devstack sudo[105156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2aaba549-f833-4731-bbb5-a1a10c86ede1_lxcyj5srdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86000) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 31 15:30:58 devstack cinder-volume[86000]: INFO cinder.image.image_utils [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Image download 0.00 MB at 0.00 MB/s Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[08fd0362-26ee-4512-9e2f-021207cbb726]: (4, 'raw') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2aaba549-f833-4731-bbb5-a1a10c86ede1_lxcyj5srdevstack@QuobyteHD {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:30:58 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-323efd4a-1943-4423-bf9a-f2ad60ea8520 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f188829b-3ef5-4877-8871-2060688583b0 1073741824" returned: 0 in 0.552s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-323efd4a-1943-4423-bf9a-f2ad60ea8520 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f188829b-3ef5-4877-8871-2060688583b0 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:30:58 devstack sudo[105156]: pam_unix(sudo:session): session closed for user root Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4bd66a3-adfc-4f59-9ad6-0f8260788d51_ai97zbk_devstack@QuobyteHD" returned: 0 in 0.378s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4bd66a3-adfc-4f59-9ad6-0f8260788d51_ai97zbk_devstack@QuobyteHD {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:30:58 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f188829b-3ef5-4877-8871-2060688583b0 Aug 31 15:30:58 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:30:58 devstack sudo[105162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2aaba549-f833-4731-bbb5-a1a10c86ede1_lxcyj5srdevstack@QuobyteHD Aug 31 15:30:58 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:30:58 devstack sudo[105166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4bd66a3-adfc-4f59-9ad6-0f8260788d51_ai97zbk_devstack@QuobyteHD Aug 31 15:30:58 devstack sudo[105166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:30:58 devstack sudo[105162]: pam_unix(sudo:session): session closed for user root Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2aaba549-f833-4731-bbb5-a1a10c86ede1_lxcyj5srdevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2aaba549-f833-4731-bbb5-a1a10c86ede1_lxcyj5srdevstack@QuobyteHD {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:30:58 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-323efd4a-1943-4423-bf9a-f2ad60ea8520 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f188829b-3ef5-4877-8871-2060688583b0" returned: 0 in 0.266s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-323efd4a-1943-4423-bf9a-f2ad60ea8520 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-323efd4a-1943-4423-bf9a-f2ad60ea8520 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6a5b6a9b-8eaa-41bc-82f0-4ded671c46f3 tempest-CinderUnicodeTest-1215655246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.669s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6a5b6a9b-8eaa-41bc-82f0-4ded671c46f3 tempest-CinderUnicodeTest-1215655246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:30:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-262871708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68f3cb24-3921-401d-8730-15d82cfab6d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fa673dc7da24a6a81fb45334637103c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:30:56Z,use_quota=True,user_id='c5b29ed7b0af4f04b4f5ec0c0c3ac7c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-6a5b6a9b-8eaa-41bc-82f0-4ded671c46f3 tempest-CinderUnicodeTest-1215655246 None] Creating volume 68f3cb24-3921-401d-8730-15d82cfab6d4 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6a5b6a9b-8eaa-41bc-82f0-4ded671c46f3 tempest-CinderUnicodeTest-1215655246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6a5b6a9b-8eaa-41bc-82f0-4ded671c46f3 tempest-CinderUnicodeTest-1215655246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6a5b6a9b-8eaa-41bc-82f0-4ded671c46f3 tempest-CinderUnicodeTest-1215655246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6a5b6a9b-8eaa-41bc-82f0-4ded671c46f3 tempest-CinderUnicodeTest-1215655246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6a5b6a9b-8eaa-41bc-82f0-4ded671c46f3 tempest-CinderUnicodeTest-1215655246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6a5b6a9b-8eaa-41bc-82f0-4ded671c46f3 tempest-CinderUnicodeTest-1215655246 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:30:58 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-6a5b6a9b-8eaa-41bc-82f0-4ded671c46f3 tempest-CinderUnicodeTest-1215655246 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6a5b6a9b-8eaa-41bc-82f0-4ded671c46f3 tempest-CinderUnicodeTest-1215655246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:30:58 devstack sudo[105174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4 1073741824 Aug 31 15:30:58 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-323efd4a-1943-4423-bf9a-f2ad60ea8520 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c90a6e3-2ab1-44a0-8f0f-055183cbd80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f188829b-3ef5-4877-8871-2060688583b0', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-323efd4a-1943-4423-bf9a-f2ad60ea8520 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dace4b1-cff3-4eff-9a63-6f6163364e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:58 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-323efd4a-1943-4423-bf9a-f2ad60ea8520 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Volume volume-f188829b-3ef5-4877-8871-2060688583b0 (f188829b-3ef5-4877-8871-2060688583b0): created successfully Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-323efd4a-1943-4423-bf9a-f2ad60ea8520 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dace4b1-cff3-4eff-9a63-6f6163364e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:58 devstack sudo[105166]: pam_unix(sudo:session): session closed for user root Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-323efd4a-1943-4423-bf9a-f2ad60ea8520 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Flow 'volume_create_manager' (b7fa5549-7ad6-47bc-add1-16317bc0d3fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4bd66a3-adfc-4f59-9ad6-0f8260788d51_ai97zbk_devstack@QuobyteHD" returned: 1 in 0.358s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4bd66a3-adfc-4f59-9ad6-0f8260788d51_ai97zbk_devstack@QuobyteHD' failed. Not Retrying. {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 31 15:30:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:30:58 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-323efd4a-1943-4423-bf9a-f2ad60ea8520 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Created volume successfully. Aug 31 15:30:58 devstack sudo[105173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2aaba549-f833-4731-bbb5-a1a10c86ede1_lxcyj5srdevstack@QuobyteHD Aug 31 15:30:58 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:30:59 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root Aug 31 15:30:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2aaba549-f833-4731-bbb5-a1a10c86ede1_lxcyj5srdevstack@QuobyteHD" returned: 1 in 0.401s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:30:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2aaba549-f833-4731-bbb5-a1a10c86ede1_lxcyj5srdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 31 15:30:59 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Temporary image 2aaba549-f833-4731-bbb5-a1a10c86ede1 is fetched for user 982322d8e6984062aab978090b881359. {{(pid=86000) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 31 15:30:59 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3cd0eb-1561-4ead-a1f2-efa295a49ed5]: (4, 'raw') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:30:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2aaba549-f833-4731-bbb5-a1a10c86ede1_lxcyj5srdevstack@QuobyteHD {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:30:59 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root Aug 31 15:30:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6a5b6a9b-8eaa-41bc-82f0-4ded671c46f3 tempest-CinderUnicodeTest-1215655246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4 1073741824" returned: 0 in 0.470s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:30:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6a5b6a9b-8eaa-41bc-82f0-4ded671c46f3 tempest-CinderUnicodeTest-1215655246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:30:59 devstack sudo[105187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2aaba549-f833-4731-bbb5-a1a10c86ede1_lxcyj5srdevstack@QuobyteHD Aug 31 15:30:59 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:30:59 devstack sudo[105188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4 Aug 31 15:30:59 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:30:59 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root Aug 31 15:30:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2aaba549-f833-4731-bbb5-a1a10c86ede1_lxcyj5srdevstack@QuobyteHD" returned: 0 in 0.334s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:30:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2aaba549-f833-4731-bbb5-a1a10c86ede1_lxcyj5srdevstack@QuobyteHD {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:30:59 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root Aug 31 15:30:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6a5b6a9b-8eaa-41bc-82f0-4ded671c46f3 tempest-CinderUnicodeTest-1215655246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4" returned: 0 in 0.262s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:30:59 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6a5b6a9b-8eaa-41bc-82f0-4ded671c46f3 tempest-CinderUnicodeTest-1215655246 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:30:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6a5b6a9b-8eaa-41bc-82f0-4ded671c46f3 tempest-CinderUnicodeTest-1215655246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:30:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9871505f-17c9-41fb-85eb-c0d38aa9ed57 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.327s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:30:59 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-9871505f-17c9-41fb-85eb-c0d38aa9ed57 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2059443151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eb15d61-3681-4d77-b827-052962b96c55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea2771fd90d048eaa15e8883cc33290d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:30:57Z,use_quota=True,user_id='0f6f4c54bd3045c584958a25fc96e42a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:30:59 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-9871505f-17c9-41fb-85eb-c0d38aa9ed57 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Creating volume 4eb15d61-3681-4d77-b827-052962b96c55 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:30:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9871505f-17c9-41fb-85eb-c0d38aa9ed57 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:30:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9871505f-17c9-41fb-85eb-c0d38aa9ed57 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:30:59 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-9871505f-17c9-41fb-85eb-c0d38aa9ed57 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:30:59 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-9871505f-17c9-41fb-85eb-c0d38aa9ed57 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:30:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9871505f-17c9-41fb-85eb-c0d38aa9ed57 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:30:59 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-9871505f-17c9-41fb-85eb-c0d38aa9ed57 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:30:59 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-9871505f-17c9-41fb-85eb-c0d38aa9ed57 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:30:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9871505f-17c9-41fb-85eb-c0d38aa9ed57 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4eb15d61-3681-4d77-b827-052962b96c55 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:30:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6a5b6a9b-8eaa-41bc-82f0-4ded671c46f3 tempest-CinderUnicodeTest-1215655246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12bfaec2-f93a-453c-b9b6-57e8c4af006c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68f3cb24-3921-401d-8730-15d82cfab6d4', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:59 devstack sudo[105195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4eb15d61-3681-4d77-b827-052962b96c55 1073741824 Aug 31 15:30:59 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:30:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6a5b6a9b-8eaa-41bc-82f0-4ded671c46f3 tempest-CinderUnicodeTest-1215655246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cf7f75a-66d6-4bd3-b784-797f50784605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:30:59 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-6a5b6a9b-8eaa-41bc-82f0-4ded671c46f3 tempest-CinderUnicodeTest-1215655246 None] Volume volume-68f3cb24-3921-401d-8730-15d82cfab6d4 (68f3cb24-3921-401d-8730-15d82cfab6d4): created successfully Aug 31 15:30:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6a5b6a9b-8eaa-41bc-82f0-4ded671c46f3 tempest-CinderUnicodeTest-1215655246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cf7f75a-66d6-4bd3-b784-797f50784605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:30:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6a5b6a9b-8eaa-41bc-82f0-4ded671c46f3 tempest-CinderUnicodeTest-1215655246 None] Flow 'volume_create_manager' (4d1e28a4-1901-44a7-9467-5e5527b71b50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:30:59 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-6a5b6a9b-8eaa-41bc-82f0-4ded671c46f3 tempest-CinderUnicodeTest-1215655246 None] Created volume successfully. Aug 31 15:30:59 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2aaba549-f833-4731-bbb5-a1a10c86ede1_lxcyj5srdevstack@QuobyteHD Aug 31 15:30:59 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:30:59 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Aug 31 15:30:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2aaba549-f833-4731-bbb5-a1a10c86ede1_lxcyj5srdevstack@QuobyteHD" returned: 1 in 0.350s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:30:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2aaba549-f833-4731-bbb5-a1a10c86ede1_lxcyj5srdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 31 15:30:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:00 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9871505f-17c9-41fb-85eb-c0d38aa9ed57 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4eb15d61-3681-4d77-b827-052962b96c55 1073741824" returned: 0 in 0.446s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9871505f-17c9-41fb-85eb-c0d38aa9ed57 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4eb15d61-3681-4d77-b827-052962b96c55 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:00 devstack sudo[105206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4eb15d61-3681-4d77-b827-052962b96c55 Aug 31 15:31:00 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:00 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9871505f-17c9-41fb-85eb-c0d38aa9ed57 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4eb15d61-3681-4d77-b827-052962b96c55" returned: 0 in 0.244s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:00 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-9871505f-17c9-41fb-85eb-c0d38aa9ed57 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:31:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9871505f-17c9-41fb-85eb-c0d38aa9ed57 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-664cfbbb-cf3c-4206-bf15-eab3bfaf48f2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.542s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:00 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-664cfbbb-cf3c-4206-bf15-eab3bfaf48f2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-594627375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e5d8c6-d1e7-4681-8a1d-d789e1034784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea2771fd90d048eaa15e8883cc33290d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:30:57Z,use_quota=True,user_id='0f6f4c54bd3045c584958a25fc96e42a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:31:00 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-664cfbbb-cf3c-4206-bf15-eab3bfaf48f2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Creating volume 77e5d8c6-d1e7-4681-8a1d-d789e1034784 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:31:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-664cfbbb-cf3c-4206-bf15-eab3bfaf48f2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-664cfbbb-cf3c-4206-bf15-eab3bfaf48f2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:00 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-664cfbbb-cf3c-4206-bf15-eab3bfaf48f2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:31:00 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-664cfbbb-cf3c-4206-bf15-eab3bfaf48f2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:31:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-664cfbbb-cf3c-4206-bf15-eab3bfaf48f2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:00 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-664cfbbb-cf3c-4206-bf15-eab3bfaf48f2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:31:00 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-664cfbbb-cf3c-4206-bf15-eab3bfaf48f2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:31:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-664cfbbb-cf3c-4206-bf15-eab3bfaf48f2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-77e5d8c6-d1e7-4681-8a1d-d789e1034784 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9871505f-17c9-41fb-85eb-c0d38aa9ed57 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e182175-8fca-4df1-9081-3626dba81724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4eb15d61-3681-4d77-b827-052962b96c55', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:00 devstack sudo[105209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-77e5d8c6-d1e7-4681-8a1d-d789e1034784 1073741824 Aug 31 15:31:00 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9871505f-17c9-41fb-85eb-c0d38aa9ed57 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ac165cf-7b69-4a25-bbae-41ca66ab7e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:00 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-9871505f-17c9-41fb-85eb-c0d38aa9ed57 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Volume volume-4eb15d61-3681-4d77-b827-052962b96c55 (4eb15d61-3681-4d77-b827-052962b96c55): created successfully Aug 31 15:31:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9871505f-17c9-41fb-85eb-c0d38aa9ed57 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ac165cf-7b69-4a25-bbae-41ca66ab7e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:00 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-9871505f-17c9-41fb-85eb-c0d38aa9ed57 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Flow 'volume_create_manager' (a0ae15a7-d075-4df4-8250-27a42eeae597) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:31:00 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-9871505f-17c9-41fb-85eb-c0d38aa9ed57 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Created volume successfully. Aug 31 15:31:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9c5e0b97-6fd0-40ec-9e96-653b707a2614 tempest-CinderUnicodeTest-1215655246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:00 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-664cfbbb-cf3c-4206-bf15-eab3bfaf48f2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-77e5d8c6-d1e7-4681-8a1d-d789e1034784 1073741824" returned: 0 in 0.462s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-664cfbbb-cf3c-4206-bf15-eab3bfaf48f2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-77e5d8c6-d1e7-4681-8a1d-d789e1034784 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:00 devstack sudo[105215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-77e5d8c6-d1e7-4681-8a1d-d789e1034784 Aug 31 15:31:00 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:01 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-664cfbbb-cf3c-4206-bf15-eab3bfaf48f2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-77e5d8c6-d1e7-4681-8a1d-d789e1034784" returned: 0 in 0.265s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:01 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-664cfbbb-cf3c-4206-bf15-eab3bfaf48f2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:31:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-664cfbbb-cf3c-4206-bf15-eab3bfaf48f2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-0aa4663d-0b29-4787-87a5-03468aae74f4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.974s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:01 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-0aa4663d-0b29-4787-87a5-03468aae74f4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-479251542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=349e6a8d-1814-4713-8486-a03993940e59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea2771fd90d048eaa15e8883cc33290d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:30:58Z,use_quota=True,user_id='0f6f4c54bd3045c584958a25fc96e42a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:31:01 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-0aa4663d-0b29-4787-87a5-03468aae74f4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Creating volume 349e6a8d-1814-4713-8486-a03993940e59 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:31:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-0aa4663d-0b29-4787-87a5-03468aae74f4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-0aa4663d-0b29-4787-87a5-03468aae74f4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:01 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-0aa4663d-0b29-4787-87a5-03468aae74f4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:31:01 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-0aa4663d-0b29-4787-87a5-03468aae74f4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:31:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-0aa4663d-0b29-4787-87a5-03468aae74f4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:01 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-0aa4663d-0b29-4787-87a5-03468aae74f4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:31:01 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-0aa4663d-0b29-4787-87a5-03468aae74f4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:31:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0aa4663d-0b29-4787-87a5-03468aae74f4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-349e6a8d-1814-4713-8486-a03993940e59 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:01 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-664cfbbb-cf3c-4206-bf15-eab3bfaf48f2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e8cf45f-6394-417d-9c18-8e78d99afb6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77e5d8c6-d1e7-4681-8a1d-d789e1034784', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:01 devstack sudo[105218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-349e6a8d-1814-4713-8486-a03993940e59 1073741824 Aug 31 15:31:01 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-664cfbbb-cf3c-4206-bf15-eab3bfaf48f2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (514bffe4-f8e4-4a4f-93a7-a4b366af48f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:01 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:01 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-664cfbbb-cf3c-4206-bf15-eab3bfaf48f2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Volume volume-77e5d8c6-d1e7-4681-8a1d-d789e1034784 (77e5d8c6-d1e7-4681-8a1d-d789e1034784): created successfully Aug 31 15:31:01 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-664cfbbb-cf3c-4206-bf15-eab3bfaf48f2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (514bffe4-f8e4-4a4f-93a7-a4b366af48f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:01 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-664cfbbb-cf3c-4206-bf15-eab3bfaf48f2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Flow 'volume_create_manager' (23bfa356-cc00-4d2d-8deb-dbe8183b459d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:31:01 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-664cfbbb-cf3c-4206-bf15-eab3bfaf48f2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Created volume successfully. Aug 31 15:31:01 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0aa4663d-0b29-4787-87a5-03468aae74f4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-349e6a8d-1814-4713-8486-a03993940e59 1073741824" returned: 0 in 0.420s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0aa4663d-0b29-4787-87a5-03468aae74f4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-349e6a8d-1814-4713-8486-a03993940e59 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:01 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-349e6a8d-1814-4713-8486-a03993940e59 Aug 31 15:31:01 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:01 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0aa4663d-0b29-4787-87a5-03468aae74f4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-349e6a8d-1814-4713-8486-a03993940e59" returned: 0 in 0.244s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:01 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-0aa4663d-0b29-4787-87a5-03468aae74f4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:31:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-0aa4663d-0b29-4787-87a5-03468aae74f4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.911s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:01 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dbddef8-c247-48c9-b02b-469a122e535a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6b4b0228e6f4547ac1c2ff41d0a8eb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:30:56Z,use_quota=True,user_id='328a230b7075436483695cc28643f33f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:31:01 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Creating volume 6dbddef8-c247-48c9-b02b-469a122e535a {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:31:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:01 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:31:01 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:31:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:01 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:31:01 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:31:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6dbddef8-c247-48c9-b02b-469a122e535a 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:01 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0aa4663d-0b29-4787-87a5-03468aae74f4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18719dcd-2e34-4ed4-a6fa-d136d63c17de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-349e6a8d-1814-4713-8486-a03993940e59', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:01 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6dbddef8-c247-48c9-b02b-469a122e535a 1073741824 Aug 31 15:31:01 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:01 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0aa4663d-0b29-4787-87a5-03468aae74f4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56215b6e-5e66-4aa1-b070-a253953dcedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:01 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-0aa4663d-0b29-4787-87a5-03468aae74f4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Volume volume-349e6a8d-1814-4713-8486-a03993940e59 (349e6a8d-1814-4713-8486-a03993940e59): created successfully Aug 31 15:31:01 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0aa4663d-0b29-4787-87a5-03468aae74f4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56215b6e-5e66-4aa1-b070-a253953dcedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:01 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-0aa4663d-0b29-4787-87a5-03468aae74f4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Flow 'volume_create_manager' (44dc1d6d-df16-47b6-ac96-1b3f2fb94704) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:31:01 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-0aa4663d-0b29-4787-87a5-03468aae74f4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Created volume successfully. Aug 31 15:31:02 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6dbddef8-c247-48c9-b02b-469a122e535a 1073741824" returned: 0 in 0.386s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6dbddef8-c247-48c9-b02b-469a122e535a {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:02 devstack sudo[105232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6dbddef8-c247-48c9-b02b-469a122e535a Aug 31 15:31:02 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:02 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-94f7c998-0c09-464a-892e-7bbe6b3522e2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Acquiring lock "cinder-349e6a8d-1814-4713-8486-a03993940e59-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:02 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-94f7c998-0c09-464a-892e-7bbe6b3522e2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "cinder-349e6a8d-1814-4713-8486-a03993940e59-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:02 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-94f7c998-0c09-464a-892e-7bbe6b3522e2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Acquiring lock "cinder-quobyte-349e6a8d-1814-4713-8486-a03993940e59" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:02 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-94f7c998-0c09-464a-892e-7bbe6b3522e2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "cinder-quobyte-349e6a8d-1814-4713-8486-a03993940e59" acquired by "delete_volume" :: waited 0.018s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:02 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f68ac37-bd3f-4027-8374-11fd659a02da]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:31:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-94f7c998-0c09-464a-892e-7bbe6b3522e2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-349e6a8d-1814-4713-8486-a03993940e59 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:02 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6dbddef8-c247-48c9-b02b-469a122e535a" returned: 0 in 0.254s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:02 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:31:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.564s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:02 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3e122bf-672b-4403-86a4-465e2cf24cfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cfdb497c54d4f70833aee95e2f7da2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:30:58Z,use_quota=True,user_id='982322d8e6984062aab978090b881359',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc49401c-cbb6-4e49-9e11-00bb9884ea90),volume_type_id=fc49401c-cbb6-4e49-9e11-00bb9884ea90)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:31:02 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Creating volume a3e122bf-672b-4403-86a4-465e2cf24cfb {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:31:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:02 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:31:02 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:31:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:02 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:31:02 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:31:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a3e122bf-672b-4403-86a4-465e2cf24cfb 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:02 devstack sudo[105236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a3e122bf-672b-4403-86a4-465e2cf24cfb 1073741824 Aug 31 15:31:02 devstack sudo[105236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:02 devstack cinder-volume[86000]: DEBUG cinder.volume.volume_utils [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Attempting download of e4bd66a3-adfc-4f59-9ad6-0f8260788d51 ((None, [{'url': 'file:///opt/stack/data/glance/images/e4bd66a3-adfc-4f59-9ad6-0f8260788d51', 'metadata': {}}])) to volume 6dbddef8-c247-48c9-b02b-469a122e535a. {{(pid=86000) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 31 15:31:02 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-349e6a8d-1814-4713-8486-a03993940e59 Aug 31 15:31:02 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:02 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbcf32e7-3b8a-47f8-a0f1-48aae6c6ee8b]: (4, 'raw') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:31:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e4bd66a3-adfc-4f59-9ad6-0f8260788d51_4gfl8j8s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:02 devstack sudo[105239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e4bd66a3-adfc-4f59-9ad6-0f8260788d51_4gfl8j8s Aug 31 15:31:02 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:02 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-94f7c998-0c09-464a-892e-7bbe6b3522e2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-349e6a8d-1814-4713-8486-a03993940e59" returned: 0 in 0.408s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-94f7c998-0c09-464a-892e-7bbe6b3522e2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-349e6a8d-1814-4713-8486-a03993940e59 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:02 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-349e6a8d-1814-4713-8486-a03993940e59 Aug 31 15:31:02 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:02 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e4bd66a3-adfc-4f59-9ad6-0f8260788d51_4gfl8j8s" returned: 0 in 0.335s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e4bd66a3-adfc-4f59-9ad6-0f8260788d51_4gfl8j8s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:02 devstack sudo[105236]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a3e122bf-672b-4403-86a4-465e2cf24cfb 1073741824" returned: 0 in 0.475s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a3e122bf-672b-4403-86a4-465e2cf24cfb {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:03 devstack sudo[105253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a3e122bf-672b-4403-86a4-465e2cf24cfb Aug 31 15:31:03 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:03 devstack sudo[105252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e4bd66a3-adfc-4f59-9ad6-0f8260788d51_4gfl8j8s Aug 31 15:31:03 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:03 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-94f7c998-0c09-464a-892e-7bbe6b3522e2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-349e6a8d-1814-4713-8486-a03993940e59" returned: 0 in 0.262s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:03 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-94f7c998-0c09-464a-892e-7bbe6b3522e2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "cinder-quobyte-349e6a8d-1814-4713-8486-a03993940e59" released by "delete_volume" :: held 0.710s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:03 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-94f7c998-0c09-464a-892e-7bbe6b3522e2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Created reservations ['92e64927-aba9-4489-a340-46a964652b8d', '86cf01c5-5741-4803-a633-34a31db4faf0', '09eaa001-f3ad-4bea-bedc-8c36ad158474', 'b062a7ae-71d5-4749-8fe9-3a83e7a2a203'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:31:03 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a3e122bf-672b-4403-86a4-465e2cf24cfb" returned: 0 in 0.264s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:03 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:31:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-94f7c998-0c09-464a-892e-7bbe6b3522e2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-94f7c998-0c09-464a-892e-7bbe6b3522e2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:03 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-94f7c998-0c09-464a-892e-7bbe6b3522e2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:31:03 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-94f7c998-0c09-464a-892e-7bbe6b3522e2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:31:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-94f7c998-0c09-464a-892e-7bbe6b3522e2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-94f7c998-0c09-464a-892e-7bbe6b3522e2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:03 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9c5e0b97-6fd0-40ec-9e96-653b707a2614 tempest-CinderUnicodeTest-1215655246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.524s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e4bd66a3-adfc-4f59-9ad6-0f8260788d51_4gfl8j8s" returned: 1 in 0.383s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e4bd66a3-adfc-4f59-9ad6-0f8260788d51_4gfl8j8s' failed. Not Retrying. {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 31 15:31:03 devstack sudo[105260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:31:03 devstack sudo[105260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:03 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c620aa-0497-4bb8-99ac-aa66e2c8f07d]: (4, 'raw') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:31:03 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-9c5e0b97-6fd0-40ec-9e96-653b707a2614 tempest-CinderUnicodeTest-1215655246 None] Creating offline snapshot b4fec2bb-189a-4bb3-a956-3732e9d3ea06 of volume 68f3cb24-3921-401d-8730-15d82cfab6d4 {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:31:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4bd66a3-adfc-4f59-9ad6-0f8260788d51_ai97zbk_devstack@QuobyteHD {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:03 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d94aaac-87f0-419c-9b80-63c5afbc3fc8]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:31:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9c5e0b97-6fd0-40ec-9e96-653b707a2614 tempest-CinderUnicodeTest-1215655246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:03 devstack cinder-volume[86000]: DEBUG cinder.volume.volume_utils [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Attempting download of 2aaba549-f833-4731-bbb5-a1a10c86ede1 ((None, [{'url': 'file:///opt/stack/data/glance/images/2aaba549-f833-4731-bbb5-a1a10c86ede1', 'metadata': {}}])) to volume a3e122bf-672b-4403-86a4-465e2cf24cfb. {{(pid=86000) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 31 15:31:03 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0faf78ba-7f84-49e8-9ae5-3fad8a1ba3c7]: (4, 'raw') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:31:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2aaba549-f833-4731-bbb5-a1a10c86ede1_nkymgaqx {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:03 devstack sudo[105263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4 Aug 31 15:31:03 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:03 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4bd66a3-adfc-4f59-9ad6-0f8260788d51_ai97zbk_devstack@QuobyteHD Aug 31 15:31:03 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:03 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-52e3648f-2886-4edb-b2d9-f162b4c51ab4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Acquiring lock "cinder-77e5d8c6-d1e7-4681-8a1d-d789e1034784-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:03 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-52e3648f-2886-4edb-b2d9-f162b4c51ab4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "cinder-77e5d8c6-d1e7-4681-8a1d-d789e1034784-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:03 devstack sudo[105264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2aaba549-f833-4731-bbb5-a1a10c86ede1_nkymgaqx Aug 31 15:31:03 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:03 devstack sudo[105260]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-94f7c998-0c09-464a-892e-7bbe6b3522e2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.385s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:03 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-94f7c998-0c09-464a-892e-7bbe6b3522e2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:31:03 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-94f7c998-0c09-464a-892e-7bbe6b3522e2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Deleted volume successfully. Aug 31 15:31:03 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-52e3648f-2886-4edb-b2d9-f162b4c51ab4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Acquiring lock "cinder-quobyte-77e5d8c6-d1e7-4681-8a1d-d789e1034784" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:03 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-52e3648f-2886-4edb-b2d9-f162b4c51ab4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "cinder-quobyte-77e5d8c6-d1e7-4681-8a1d-d789e1034784" acquired by "delete_volume" :: waited 0.031s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:03 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-94f7c998-0c09-464a-892e-7bbe6b3522e2 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "cinder-349e6a8d-1814-4713-8486-a03993940e59-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:03 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fec5d2e-1733-4813-a436-09c82005c33f]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:31:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-52e3648f-2886-4edb-b2d9-f162b4c51ab4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-77e5d8c6-d1e7-4681-8a1d-d789e1034784 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:03 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4bd66a3-adfc-4f59-9ad6-0f8260788d51_ai97zbk_devstack@QuobyteHD" returned: 0 in 0.485s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4bd66a3-adfc-4f59-9ad6-0f8260788d51_ai97zbk_devstack@QuobyteHD {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:03 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9c5e0b97-6fd0-40ec-9e96-653b707a2614 tempest-CinderUnicodeTest-1215655246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4" returned: 0 in 0.503s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9c5e0b97-6fd0-40ec-9e96-653b707a2614 tempest-CinderUnicodeTest-1215655246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4.b4fec2bb-189a-4bb3-a956-3732e9d3ea06 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:03 devstack sudo[105277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4.b4fec2bb-189a-4bb3-a956-3732e9d3ea06 1G Aug 31 15:31:03 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:03 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-77e5d8c6-d1e7-4681-8a1d-d789e1034784 Aug 31 15:31:03 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:03 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2aaba549-f833-4731-bbb5-a1a10c86ede1_nkymgaqx" returned: 0 in 0.478s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2aaba549-f833-4731-bbb5-a1a10c86ede1_nkymgaqx {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:03 devstack sudo[105275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4bd66a3-adfc-4f59-9ad6-0f8260788d51_ai97zbk_devstack@QuobyteHD Aug 31 15:31:03 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:04 devstack sudo[105281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2aaba549-f833-4731-bbb5-a1a10c86ede1_nkymgaqx Aug 31 15:31:04 devstack sudo[105281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:04 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-52e3648f-2886-4edb-b2d9-f162b4c51ab4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-77e5d8c6-d1e7-4681-8a1d-d789e1034784" returned: 0 in 0.413s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-52e3648f-2886-4edb-b2d9-f162b4c51ab4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-77e5d8c6-d1e7-4681-8a1d-d789e1034784 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:04 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4bd66a3-adfc-4f59-9ad6-0f8260788d51_ai97zbk_devstack@QuobyteHD" returned: 1 in 0.382s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4bd66a3-adfc-4f59-9ad6-0f8260788d51_ai97zbk_devstack@QuobyteHD' failed. Not Retrying. {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 31 15:31:04 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] e4bd66a3-adfc-4f59-9ad6-0f8260788d51 was raw, converting to qcow2 {{(pid=86000) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 31 15:31:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e4bd66a3-adfc-4f59-9ad6-0f8260788d51_ai97zbk_devstack@QuobyteHD /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6dbddef8-c247-48c9-b02b-469a122e535a {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:04 devstack sudo[105293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-77e5d8c6-d1e7-4681-8a1d-d789e1034784 Aug 31 15:31:04 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:04 devstack sudo[105295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e4bd66a3-adfc-4f59-9ad6-0f8260788d51_ai97zbk_devstack@QuobyteHD /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6dbddef8-c247-48c9-b02b-469a122e535a Aug 31 15:31:04 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:04 devstack sudo[105281]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2aaba549-f833-4731-bbb5-a1a10c86ede1_nkymgaqx" returned: 1 in 0.342s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2aaba549-f833-4731-bbb5-a1a10c86ede1_nkymgaqx' failed. Not Retrying. {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 31 15:31:04 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7fd3d4-e088-457c-b788-935738c41db4]: (4, 'raw') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:31:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2aaba549-f833-4731-bbb5-a1a10c86ede1_lxcyj5srdevstack@QuobyteHD {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:04 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9c5e0b97-6fd0-40ec-9e96-653b707a2614 tempest-CinderUnicodeTest-1215655246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4.b4fec2bb-189a-4bb3-a956-3732e9d3ea06 1G" returned: 0 in 0.463s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9c5e0b97-6fd0-40ec-9e96-653b707a2614 tempest-CinderUnicodeTest-1215655246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68f3cb24-3921-401d-8730-15d82cfab6d4 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4.b4fec2bb-189a-4bb3-a956-3732e9d3ea06 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:04 devstack sudo[105300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68f3cb24-3921-401d-8730-15d82cfab6d4 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4.b4fec2bb-189a-4bb3-a956-3732e9d3ea06 Aug 31 15:31:04 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:04 devstack sudo[105299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2aaba549-f833-4731-bbb5-a1a10c86ede1_lxcyj5srdevstack@QuobyteHD Aug 31 15:31:04 devstack sudo[105299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:04 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-52e3648f-2886-4edb-b2d9-f162b4c51ab4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-77e5d8c6-d1e7-4681-8a1d-d789e1034784" returned: 0 in 0.283s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:04 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-52e3648f-2886-4edb-b2d9-f162b4c51ab4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "cinder-quobyte-77e5d8c6-d1e7-4681-8a1d-d789e1034784" released by "delete_volume" :: held 0.749s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:04 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-52e3648f-2886-4edb-b2d9-f162b4c51ab4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Created reservations ['5ac4531c-20a7-4aec-b825-6a0439852b09', 'a179df0e-5358-46e2-831a-06fbc936170d', 'b47a94ab-158d-46a4-b435-f14c1c2add16', 'ed1e108f-3d47-4565-941b-4e3df6791752'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:31:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-52e3648f-2886-4edb-b2d9-f162b4c51ab4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-52e3648f-2886-4edb-b2d9-f162b4c51ab4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:04 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-52e3648f-2886-4edb-b2d9-f162b4c51ab4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:31:04 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-52e3648f-2886-4edb-b2d9-f162b4c51ab4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:31:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-52e3648f-2886-4edb-b2d9-f162b4c51ab4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-52e3648f-2886-4edb-b2d9-f162b4c51ab4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:04 devstack sudo[105299]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2aaba549-f833-4731-bbb5-a1a10c86ede1_lxcyj5srdevstack@QuobyteHD" returned: 0 in 0.400s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2aaba549-f833-4731-bbb5-a1a10c86ede1_lxcyj5srdevstack@QuobyteHD {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:04 devstack sudo[105313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:31:04 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:04 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9c5e0b97-6fd0-40ec-9e96-653b707a2614 tempest-CinderUnicodeTest-1215655246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68f3cb24-3921-401d-8730-15d82cfab6d4 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4.b4fec2bb-189a-4bb3-a956-3732e9d3ea06" returned: 0 in 0.386s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:04 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-9c5e0b97-6fd0-40ec-9e96-653b707a2614 tempest-CinderUnicodeTest-1215655246 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4.b4fec2bb-189a-4bb3-a956-3732e9d3ea06 is being set with open permissions: ugo+rw Aug 31 15:31:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9c5e0b97-6fd0-40ec-9e96-653b707a2614 tempest-CinderUnicodeTest-1215655246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4.b4fec2bb-189a-4bb3-a956-3732e9d3ea06 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:04 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:04 devstack sudo[105316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4.b4fec2bb-189a-4bb3-a956-3732e9d3ea06 Aug 31 15:31:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e4bd66a3-adfc-4f59-9ad6-0f8260788d51_ai97zbk_devstack@QuobyteHD /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6dbddef8-c247-48c9-b02b-469a122e535a" returned: 0 in 0.540s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:04 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e4bd66a3-adfc-4f59-9ad6-0f8260788d51_ai97zbk_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6dbddef8-c247-48c9-b02b-469a122e535a {{(pid=86000) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 31 15:31:04 devstack cinder-volume[86000]: INFO cinder.image.image_utils [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Converted 0.00 MB image at 0.00 MB/s Aug 31 15:31:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6dbddef8-c247-48c9-b02b-469a122e535a 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:04 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:04 devstack sudo[105318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6dbddef8-c247-48c9-b02b-469a122e535a 1G Aug 31 15:31:04 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:04 devstack sudo[105315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2aaba549-f833-4731-bbb5-a1a10c86ede1_lxcyj5srdevstack@QuobyteHD Aug 31 15:31:04 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:04 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5f606d7a-a7c9-4957-b30d-6270d9821f51 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Acquiring lock "cinder-4eb15d61-3681-4d77-b827-052962b96c55-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:04 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5f606d7a-a7c9-4957-b30d-6270d9821f51 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "cinder-4eb15d61-3681-4d77-b827-052962b96c55-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:05 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5f606d7a-a7c9-4957-b30d-6270d9821f51 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Acquiring lock "cinder-quobyte-4eb15d61-3681-4d77-b827-052962b96c55" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:05 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-52e3648f-2886-4edb-b2d9-f162b4c51ab4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.380s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:05 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-52e3648f-2886-4edb-b2d9-f162b4c51ab4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:31:05 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5f606d7a-a7c9-4957-b30d-6270d9821f51 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "cinder-quobyte-4eb15d61-3681-4d77-b827-052962b96c55" acquired by "delete_volume" :: waited 0.035s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:05 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-52e3648f-2886-4edb-b2d9-f162b4c51ab4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Deleted volume successfully. Aug 31 15:31:05 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:05 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[74eb3d99-5e97-44a7-8c7b-6159e014e24f]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:31:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9c5e0b97-6fd0-40ec-9e96-653b707a2614 tempest-CinderUnicodeTest-1215655246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4.b4fec2bb-189a-4bb3-a956-3732e9d3ea06" returned: 0 in 0.361s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:05 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-52e3648f-2886-4edb-b2d9-f162b4c51ab4 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "cinder-77e5d8c6-d1e7-4681-8a1d-d789e1034784-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5f606d7a-a7c9-4957-b30d-6270d9821f51 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4eb15d61-3681-4d77-b827-052962b96c55 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9c5e0b97-6fd0-40ec-9e96-653b707a2614 tempest-CinderUnicodeTest-1215655246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:05 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2aaba549-f833-4731-bbb5-a1a10c86ede1_lxcyj5srdevstack@QuobyteHD" returned: 1 in 0.494s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2aaba549-f833-4731-bbb5-a1a10c86ede1_lxcyj5srdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 31 15:31:05 devstack sudo[105330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4.info Aug 31 15:31:05 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] 2aaba549-f833-4731-bbb5-a1a10c86ede1 was raw, converting to qcow2 {{(pid=86000) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 31 15:31:05 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2aaba549-f833-4731-bbb5-a1a10c86ede1_lxcyj5srdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a3e122bf-672b-4403-86a4-465e2cf24cfb {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:05 devstack sudo[105324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4eb15d61-3681-4d77-b827-052962b96c55 Aug 31 15:31:05 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:05 devstack sudo[105332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2aaba549-f833-4731-bbb5-a1a10c86ede1_lxcyj5srdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a3e122bf-672b-4403-86a4-465e2cf24cfb Aug 31 15:31:05 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:05 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6dbddef8-c247-48c9-b02b-469a122e535a 1G" returned: 0 in 0.460s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:05 devstack cinder-volume[86000]: DEBUG cinder.volume.volume_utils [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Downloaded image e4bd66a3-adfc-4f59-9ad6-0f8260788d51 ((None, [{'url': 'file:///opt/stack/data/glance/images/e4bd66a3-adfc-4f59-9ad6-0f8260788d51', 'metadata': {}}])) to volume 6dbddef8-c247-48c9-b02b-469a122e535a successfully. {{(pid=86000) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 31 15:31:05 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Temporary image e4bd66a3-adfc-4f59-9ad6-0f8260788d51 for user 328a230b7075436483695cc28643f33f is deleted. {{(pid=86000) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 31 15:31:05 devstack cinder-volume[86000]: DEBUG cinder.volume.volume_utils [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Marking volume 6dbddef8-c247-48c9-b02b-469a122e535a as bootable. {{(pid=86000) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 31 15:31:05 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Copying metadata from image e4bd66a3-adfc-4f59-9ad6-0f8260788d51 to 6dbddef8-c247-48c9-b02b-469a122e535a. {{(pid=86000) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 31 15:31:05 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Creating volume glance metadata for volume 6dbddef8-c247-48c9-b02b-469a122e535a backed by image e4bd66a3-adfc-4f59-9ad6-0f8260788d51 with: {'image_id': 'e4bd66a3-adfc-4f59-9ad6-0f8260788d51', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'c46856bd040e1e763d55d9990eaac5e6', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86000) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 31 15:31:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf20e981-c947-447b-8911-8fd3ddf076c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dbddef8-c247-48c9-b02b-469a122e535a', 'volume_size': 1, 'image_id': 'e4bd66a3-adfc-4f59-9ad6-0f8260788d51', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e4bd66a3-adfc-4f59-9ad6-0f8260788d51', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c46856bd040e1e763d55d9990eaac5e6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd6b4b0228e6f4547ac1c2ff41d0a8eb5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '00dfe5be5be1583bf2e4d53c1397982d058d560d5bb04a95162e983d750d44825295e0a04796cd10caf885fcb4ae969a5461caddba3b0b14801425660b3765df', 'id': 'e4bd66a3-adfc-4f59-9ad6-0f8260788d51', 'created_at': datetime.datetime(2026, 8, 31, 13, 30, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 13, 30, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e4bd66a3-adfc-4f59-9ad6-0f8260788d51/file', 'properties': {}}, 'image_service': }' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79008f47-8572-4b56-92e9-bd5357ec70da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:05 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Volume volume-6dbddef8-c247-48c9-b02b-469a122e535a (6dbddef8-c247-48c9-b02b-469a122e535a): created successfully Aug 31 15:31:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79008f47-8572-4b56-92e9-bd5357ec70da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:05 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Flow 'volume_create_manager' (08784324-b53a-4c8f-8cc4-5010e968781d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:31:05 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-5f09bedc-0eb5-4c27-9dd6-549f62805627 tempest-VolumeImageDependencyTests-1657593883 None] Created volume successfully. Aug 31 15:31:05 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9c5e0b97-6fd0-40ec-9e96-653b707a2614 tempest-CinderUnicodeTest-1215655246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4.info" returned: 0 in 0.282s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:05 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-9c5e0b97-6fd0-40ec-9e96-653b707a2614 tempest-CinderUnicodeTest-1215655246 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4.info is being set with open permissions: ugo+rw Aug 31 15:31:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9c5e0b97-6fd0-40ec-9e96-653b707a2614 tempest-CinderUnicodeTest-1215655246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:05 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4.info Aug 31 15:31:05 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:05 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5f606d7a-a7c9-4957-b30d-6270d9821f51 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4eb15d61-3681-4d77-b827-052962b96c55" returned: 0 in 0.406s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5f606d7a-a7c9-4957-b30d-6270d9821f51 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4eb15d61-3681-4d77-b827-052962b96c55 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:05 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4eb15d61-3681-4d77-b827-052962b96c55 Aug 31 15:31:05 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:05 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2aaba549-f833-4731-bbb5-a1a10c86ede1_lxcyj5srdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a3e122bf-672b-4403-86a4-465e2cf24cfb" returned: 0 in 0.478s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:05 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2aaba549-f833-4731-bbb5-a1a10c86ede1_lxcyj5srdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a3e122bf-672b-4403-86a4-465e2cf24cfb {{(pid=86000) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 31 15:31:05 devstack cinder-volume[86000]: INFO cinder.image.image_utils [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Converted 0.00 MB image at 0.00 MB/s Aug 31 15:31:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a3e122bf-672b-4403-86a4-465e2cf24cfb 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:05 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a3e122bf-672b-4403-86a4-465e2cf24cfb 1G Aug 31 15:31:05 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:05 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9c5e0b97-6fd0-40ec-9e96-653b707a2614 tempest-CinderUnicodeTest-1215655246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4.info" returned: 0 in 0.271s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9c5e0b97-6fd0-40ec-9e96-653b707a2614 tempest-CinderUnicodeTest-1215655246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.410s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:05 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-9c5e0b97-6fd0-40ec-9e96-653b707a2614 tempest-CinderUnicodeTest-1215655246 None] Create snapshot completed successfully Aug 31 15:31:05 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5f606d7a-a7c9-4957-b30d-6270d9821f51 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4eb15d61-3681-4d77-b827-052962b96c55" returned: 0 in 0.289s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:05 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5f606d7a-a7c9-4957-b30d-6270d9821f51 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "cinder-quobyte-4eb15d61-3681-4d77-b827-052962b96c55" released by "delete_volume" :: held 0.771s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:05 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-5f606d7a-a7c9-4957-b30d-6270d9821f51 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Created reservations ['372f476b-80e7-44a6-ae3b-6b3bea1bdbd0', 'fca7b03a-3950-44ab-9647-caab13f9b0ac', '056f6451-bf7f-474d-b6dc-f152fbcfb959', '2a1453d7-0a93-4059-b85a-e83c5256bc5a'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:31:05 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-66e05b76-6fa0-4583-9011-da0f2cd3fda8 tempest-VolumeImageDependencyTests-1657593883 None] Acquiring lock "cinder-6dbddef8-c247-48c9-b02b-469a122e535a-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5f606d7a-a7c9-4957-b30d-6270d9821f51 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5f606d7a-a7c9-4957-b30d-6270d9821f51 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:05 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5f606d7a-a7c9-4957-b30d-6270d9821f51 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:31:05 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5f606d7a-a7c9-4957-b30d-6270d9821f51 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:31:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5f606d7a-a7c9-4957-b30d-6270d9821f51 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5f606d7a-a7c9-4957-b30d-6270d9821f51 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:06 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-66e05b76-6fa0-4583-9011-da0f2cd3fda8 tempest-VolumeImageDependencyTests-1657593883 None] Lock "cinder-6dbddef8-c247-48c9-b02b-469a122e535a-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:06 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:31:06 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:06 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-66e05b76-6fa0-4583-9011-da0f2cd3fda8 tempest-VolumeImageDependencyTests-1657593883 None] Acquiring lock "cinder-quobyte-6dbddef8-c247-48c9-b02b-469a122e535a" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:06 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-66e05b76-6fa0-4583-9011-da0f2cd3fda8 tempest-VolumeImageDependencyTests-1657593883 None] Lock "cinder-quobyte-6dbddef8-c247-48c9-b02b-469a122e535a" acquired by "delete_volume" :: waited 0.017s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:06 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c380ba23-4c89-4641-85b7-a1ca3a99ed19]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:31:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-66e05b76-6fa0-4583-9011-da0f2cd3fda8 tempest-VolumeImageDependencyTests-1657593883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6dbddef8-c247-48c9-b02b-469a122e535a {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:06 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a3e122bf-672b-4403-86a4-465e2cf24cfb 1G" returned: 0 in 0.448s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:06 devstack cinder-volume[86000]: DEBUG cinder.volume.volume_utils [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Downloaded image 2aaba549-f833-4731-bbb5-a1a10c86ede1 ((None, [{'url': 'file:///opt/stack/data/glance/images/2aaba549-f833-4731-bbb5-a1a10c86ede1', 'metadata': {}}])) to volume a3e122bf-672b-4403-86a4-465e2cf24cfb successfully. {{(pid=86000) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 31 15:31:06 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Temporary image 2aaba549-f833-4731-bbb5-a1a10c86ede1 for user 982322d8e6984062aab978090b881359 is deleted. {{(pid=86000) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 31 15:31:06 devstack cinder-volume[86000]: DEBUG cinder.volume.volume_utils [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Marking volume a3e122bf-672b-4403-86a4-465e2cf24cfb as bootable. {{(pid=86000) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 31 15:31:06 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Copying metadata from image 2aaba549-f833-4731-bbb5-a1a10c86ede1 to a3e122bf-672b-4403-86a4-465e2cf24cfb. {{(pid=86000) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 31 15:31:06 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Creating volume glance metadata for volume a3e122bf-672b-4403-86a4-465e2cf24cfb backed by image 2aaba549-f833-4731-bbb5-a1a10c86ede1 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '2aaba549-f833-4731-bbb5-a1a10c86ede1', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '88c36a8fb6c42cdb1ea0a833f2c089e1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86000) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 31 15:31:06 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-789e10f3-0958-45d9-ac69-91b4bea49569 tempest-CinderUnicodeTest-1215655246 None] Acquiring lock "cinder-b4fec2bb-189a-4bb3-a956-3732e9d3ea06-delete_snapshot" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:06 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-2f18177c-044c-4e38-9770-6e108641b86c tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Acquiring lock "cinder-f188829b-3ef5-4877-8871-2060688583b0-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:06 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-2f18177c-044c-4e38-9770-6e108641b86c tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "cinder-f188829b-3ef5-4877-8871-2060688583b0-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:06 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-789e10f3-0958-45d9-ac69-91b4bea49569 tempest-CinderUnicodeTest-1215655246 None] Lock "cinder-b4fec2bb-189a-4bb3-a956-3732e9d3ea06-delete_snapshot" acquired by "delete_snapshot" :: waited 0.074s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:06 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-789e10f3-0958-45d9-ac69-91b4bea49569 tempest-CinderUnicodeTest-1215655246 None] Acquiring lock "cinder-quobyte-68f3cb24-3921-401d-8730-15d82cfab6d4" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:06 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-789e10f3-0958-45d9-ac69-91b4bea49569 tempest-CinderUnicodeTest-1215655246 None] Lock "cinder-quobyte-68f3cb24-3921-401d-8730-15d82cfab6d4" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:06 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-789e10f3-0958-45d9-ac69-91b4bea49569 tempest-CinderUnicodeTest-1215655246 None] Acquiring lock "cinder-quobyte-b4fec2bb-189a-4bb3-a956-3732e9d3ea06" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:06 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6dbddef8-c247-48c9-b02b-469a122e535a Aug 31 15:31:06 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:06 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-2f18177c-044c-4e38-9770-6e108641b86c tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Acquiring lock "cinder-quobyte-f188829b-3ef5-4877-8871-2060688583b0" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:06 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-789e10f3-0958-45d9-ac69-91b4bea49569 tempest-CinderUnicodeTest-1215655246 None] Lock "cinder-quobyte-b4fec2bb-189a-4bb3-a956-3732e9d3ea06" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:06 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-789e10f3-0958-45d9-ac69-91b4bea49569 tempest-CinderUnicodeTest-1215655246 None] Deleting offline snapshot b4fec2bb-189a-4bb3-a956-3732e9d3ea06 of volume 68f3cb24-3921-401d-8730-15d82cfab6d4 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:31:06 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-789e10f3-0958-45d9-ac69-91b4bea49569 tempest-CinderUnicodeTest-1215655246 None] snapshot_file for this snap is: volume-68f3cb24-3921-401d-8730-15d82cfab6d4.b4fec2bb-189a-4bb3-a956-3732e9d3ea06 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:31:06 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20a591be-b74c-421a-8225-3237136d0241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3e122bf-672b-4403-86a4-465e2cf24cfb', 'volume_size': 1, 'image_id': '2aaba549-f833-4731-bbb5-a1a10c86ede1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2aaba549-f833-4731-bbb5-a1a10c86ede1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '88c36a8fb6c42cdb1ea0a833f2c089e1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8cfdb497c54d4f70833aee95e2f7da2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cf80503de09dc8c4d7018d6ae621e6ff59bf4f76823009d1f22cdca2c3d4b8cc689daf3d5ce3b7accb37289ed51f77914b84b20d6e73939402faf14abbf934bc', 'id': '2aaba549-f833-4731-bbb5-a1a10c86ede1', 'created_at': datetime.datetime(2026, 8, 31, 13, 30, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 13, 30, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2aaba549-f833-4731-bbb5-a1a10c86ede1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13f4d5c8-bf43-45d8-96a7-a1829de86011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5f606d7a-a7c9-4957-b30d-6270d9821f51 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.429s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:06 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b8b5c2-6d86-49d3-8baf-e18ac1c28496]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:31:06 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-5f606d7a-a7c9-4957-b30d-6270d9821f51 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:31:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-789e10f3-0958-45d9-ac69-91b4bea49569 tempest-CinderUnicodeTest-1215655246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4.b4fec2bb-189a-4bb3-a956-3732e9d3ea06 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:06 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-5f606d7a-a7c9-4957-b30d-6270d9821f51 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Deleted volume successfully. Aug 31 15:31:06 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-2f18177c-044c-4e38-9770-6e108641b86c tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "cinder-quobyte-f188829b-3ef5-4877-8871-2060688583b0" acquired by "delete_volume" :: waited 0.109s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:06 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Volume volume-a3e122bf-672b-4403-86a4-465e2cf24cfb (a3e122bf-672b-4403-86a4-465e2cf24cfb): created successfully Aug 31 15:31:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13f4d5c8-bf43-45d8-96a7-a1829de86011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Flow 'volume_create_manager' (0f8b9957-8ad3-4691-9732-7b8e78a480bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:31:06 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d1415b-a907-451c-92a3-f3a19a5287f0]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:31:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2f18177c-044c-4e38-9770-6e108641b86c tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f188829b-3ef5-4877-8871-2060688583b0 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:06 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-f4c8ebf2-2803-4644-812f-96224099dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Created volume successfully. Aug 31 15:31:06 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5f606d7a-a7c9-4957-b30d-6270d9821f51 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "cinder-4eb15d61-3681-4d77-b827-052962b96c55-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:06 devstack sudo[105359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4.b4fec2bb-189a-4bb3-a956-3732e9d3ea06 Aug 31 15:31:06 devstack sudo[105359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:06 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-66e05b76-6fa0-4583-9011-da0f2cd3fda8 tempest-VolumeImageDependencyTests-1657593883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6dbddef8-c247-48c9-b02b-469a122e535a" returned: 0 in 0.498s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-66e05b76-6fa0-4583-9011-da0f2cd3fda8 tempest-VolumeImageDependencyTests-1657593883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6dbddef8-c247-48c9-b02b-469a122e535a {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:06 devstack sudo[105361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f188829b-3ef5-4877-8871-2060688583b0 Aug 31 15:31:06 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:06 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6dbddef8-c247-48c9-b02b-469a122e535a Aug 31 15:31:06 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:06 devstack sudo[105359]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-789e10f3-0958-45d9-ac69-91b4bea49569 tempest-CinderUnicodeTest-1215655246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4.b4fec2bb-189a-4bb3-a956-3732e9d3ea06" returned: 0 in 0.403s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:06 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-789e10f3-0958-45d9-ac69-91b4bea49569 tempest-CinderUnicodeTest-1215655246 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68f3cb24-3921-401d-8730-15d82cfab6d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:31:06 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1e090a-2e3a-4c11-8d7a-413ddaa072a8]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:31:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-789e10f3-0958-45d9-ac69-91b4bea49569 tempest-CinderUnicodeTest-1215655246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:06 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:06 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-66e05b76-6fa0-4583-9011-da0f2cd3fda8 tempest-VolumeImageDependencyTests-1657593883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6dbddef8-c247-48c9-b02b-469a122e535a" returned: 0 in 0.259s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2f18177c-044c-4e38-9770-6e108641b86c tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f188829b-3ef5-4877-8871-2060688583b0" returned: 0 in 0.389s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2f18177c-044c-4e38-9770-6e108641b86c tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f188829b-3ef5-4877-8871-2060688583b0 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:06 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-66e05b76-6fa0-4583-9011-da0f2cd3fda8 tempest-VolumeImageDependencyTests-1657593883 None] Lock "cinder-quobyte-6dbddef8-c247-48c9-b02b-469a122e535a" released by "delete_volume" :: held 0.840s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:06 devstack sudo[105376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f188829b-3ef5-4877-8871-2060688583b0 Aug 31 15:31:06 devstack sudo[105376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:06 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-66e05b76-6fa0-4583-9011-da0f2cd3fda8 tempest-VolumeImageDependencyTests-1657593883 None] Created reservations ['7af2d822-0836-49d4-a9eb-a6f990ae67b6', 'b5208af5-a715-4793-bc14-55972169cb00', 'a537a112-550b-490a-a501-8efb396351bc', '72d93eed-cab5-4d30-9a2c-503058c2f918'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:31:06 devstack sudo[105375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4 Aug 31 15:31:06 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-66e05b76-6fa0-4583-9011-da0f2cd3fda8 tempest-VolumeImageDependencyTests-1657593883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-66e05b76-6fa0-4583-9011-da0f2cd3fda8 tempest-VolumeImageDependencyTests-1657593883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:07 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-66e05b76-6fa0-4583-9011-da0f2cd3fda8 tempest-VolumeImageDependencyTests-1657593883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:31:07 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-66e05b76-6fa0-4583-9011-da0f2cd3fda8 tempest-VolumeImageDependencyTests-1657593883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:31:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-66e05b76-6fa0-4583-9011-da0f2cd3fda8 tempest-VolumeImageDependencyTests-1657593883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-66e05b76-6fa0-4583-9011-da0f2cd3fda8 tempest-VolumeImageDependencyTests-1657593883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:07 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:31:07 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:07 devstack sudo[105376]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2f18177c-044c-4e38-9770-6e108641b86c tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f188829b-3ef5-4877-8871-2060688583b0" returned: 0 in 0.296s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:07 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-2f18177c-044c-4e38-9770-6e108641b86c tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "cinder-quobyte-f188829b-3ef5-4877-8871-2060688583b0" released by "delete_volume" :: held 0.768s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:07 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-de423374-5815-445b-9abd-1d294e93cb63 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Acquiring lock "cinder-a3e122bf-672b-4403-86a4-465e2cf24cfb-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:07 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:07 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-de423374-5815-445b-9abd-1d294e93cb63 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Lock "cinder-a3e122bf-672b-4403-86a4-465e2cf24cfb-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-789e10f3-0958-45d9-ac69-91b4bea49569 tempest-CinderUnicodeTest-1215655246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4" returned: 0 in 0.537s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-789e10f3-0958-45d9-ac69-91b4bea49569 tempest-CinderUnicodeTest-1215655246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4.b4fec2bb-189a-4bb3-a956-3732e9d3ea06 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:07 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-2f18177c-044c-4e38-9770-6e108641b86c tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Created reservations ['71f47ef8-a5e0-42ae-8c7f-9afd047e5e89', '1099fc45-e7e7-4bed-b21c-7792f333988a', '38ae023b-e2f6-424c-ab11-c31a40d80b71', '98e5e62d-d8bf-4f96-82ee-40e7c66d7776'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:31:07 devstack sudo[105385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4.b4fec2bb-189a-4bb3-a956-3732e9d3ea06 Aug 31 15:31:07 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:07 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-de423374-5815-445b-9abd-1d294e93cb63 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Acquiring lock "cinder-quobyte-a3e122bf-672b-4403-86a4-465e2cf24cfb" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:07 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-de423374-5815-445b-9abd-1d294e93cb63 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Lock "cinder-quobyte-a3e122bf-672b-4403-86a4-465e2cf24cfb" acquired by "delete_volume" :: waited 0.033s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:07 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-66e05b76-6fa0-4583-9011-da0f2cd3fda8 tempest-VolumeImageDependencyTests-1657593883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.473s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:07 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-66e05b76-6fa0-4583-9011-da0f2cd3fda8 tempest-VolumeImageDependencyTests-1657593883 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:31:07 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[19466227-78f9-42a3-a9a4-691f7348d34c]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:31:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-de423374-5815-445b-9abd-1d294e93cb63 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a3e122bf-672b-4403-86a4-465e2cf24cfb {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:07 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-66e05b76-6fa0-4583-9011-da0f2cd3fda8 tempest-VolumeImageDependencyTests-1657593883 None] Deleted volume successfully. Aug 31 15:31:07 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-66e05b76-6fa0-4583-9011-da0f2cd3fda8 tempest-VolumeImageDependencyTests-1657593883 None] Lock "cinder-6dbddef8-c247-48c9-b02b-469a122e535a-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-2f18177c-044c-4e38-9770-6e108641b86c tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-2f18177c-044c-4e38-9770-6e108641b86c tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:07 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-2f18177c-044c-4e38-9770-6e108641b86c tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:31:07 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-2f18177c-044c-4e38-9770-6e108641b86c tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:31:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-2f18177c-044c-4e38-9770-6e108641b86c tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2f18177c-044c-4e38-9770-6e108641b86c tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:07 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:31:07 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:07 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a3e122bf-672b-4403-86a4-465e2cf24cfb Aug 31 15:31:07 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:07 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-789e10f3-0958-45d9-ac69-91b4bea49569 tempest-CinderUnicodeTest-1215655246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4.b4fec2bb-189a-4bb3-a956-3732e9d3ea06" returned: 0 in 0.448s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-789e10f3-0958-45d9-ac69-91b4bea49569 tempest-CinderUnicodeTest-1215655246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4.b4fec2bb-189a-4bb3-a956-3732e9d3ea06 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:07 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:07 devstack sudo[105397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4.b4fec2bb-189a-4bb3-a956-3732e9d3ea06 Aug 31 15:31:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2f18177c-044c-4e38-9770-6e108641b86c tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.279s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:07 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-2f18177c-044c-4e38-9770-6e108641b86c tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:31:07 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:07 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-2f18177c-044c-4e38-9770-6e108641b86c tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Deleted volume successfully. Aug 31 15:31:07 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-2f18177c-044c-4e38-9770-6e108641b86c tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "cinder-f188829b-3ef5-4877-8871-2060688583b0-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:08 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-de423374-5815-445b-9abd-1d294e93cb63 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a3e122bf-672b-4403-86a4-465e2cf24cfb" returned: 0 in 0.482s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-de423374-5815-445b-9abd-1d294e93cb63 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a3e122bf-672b-4403-86a4-465e2cf24cfb {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:08 devstack sudo[105402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a3e122bf-672b-4403-86a4-465e2cf24cfb Aug 31 15:31:08 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:08 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-789e10f3-0958-45d9-ac69-91b4bea49569 tempest-CinderUnicodeTest-1215655246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4.b4fec2bb-189a-4bb3-a956-3732e9d3ea06" returned: 0 in 0.297s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:08 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-789e10f3-0958-45d9-ac69-91b4bea49569 tempest-CinderUnicodeTest-1215655246 None] Lock "cinder-quobyte-b4fec2bb-189a-4bb3-a956-3732e9d3ea06" released by "_delete_snapshot" :: held 1.827s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:08 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-789e10f3-0958-45d9-ac69-91b4bea49569 tempest-CinderUnicodeTest-1215655246 None] Lock "cinder-quobyte-68f3cb24-3921-401d-8730-15d82cfab6d4" released by "delete_snapshot" :: held 1.876s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:08 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-789e10f3-0958-45d9-ac69-91b4bea49569 tempest-CinderUnicodeTest-1215655246 None] Created reservations ['83985c60-ea75-4834-9394-d143dd629722', '73c5ce9a-fd59-44e8-86dc-9dab63cfdc92', '87c4dd99-6b8e-41f0-9f76-bc9ddeea782e', 'fa67b09d-5baf-4def-8897-38d73f96658c'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:31:08 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-de423374-5815-445b-9abd-1d294e93cb63 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-a3e122bf-672b-4403-86a4-465e2cf24cfb" returned: 0 in 0.317s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:08 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-789e10f3-0958-45d9-ac69-91b4bea49569 tempest-CinderUnicodeTest-1215655246 None] Delete snapshot completed successfully. Aug 31 15:31:08 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-de423374-5815-445b-9abd-1d294e93cb63 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Lock "cinder-quobyte-a3e122bf-672b-4403-86a4-465e2cf24cfb" released by "delete_volume" :: held 0.865s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:08 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-789e10f3-0958-45d9-ac69-91b4bea49569 tempest-CinderUnicodeTest-1215655246 None] Lock "cinder-b4fec2bb-189a-4bb3-a956-3732e9d3ea06-delete_snapshot" released by "delete_snapshot" :: held 2.086s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:08 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4e550008-934e-4403-bf19-80863619ff7c tempest-CinderUnicodeTest-1215655246 None] Acquiring lock "cinder-68f3cb24-3921-401d-8730-15d82cfab6d4-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:08 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-de423374-5815-445b-9abd-1d294e93cb63 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Created reservations ['ae681c2e-fa14-45d1-9ba6-48552574ce5b', '31a71b34-72e6-42f3-a4d3-5f736ccb7bde', '20de04d3-7992-47a5-9189-7d263fb1a489', '11a418bd-b6c5-461c-9305-22542da15718'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:31:08 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4e550008-934e-4403-bf19-80863619ff7c tempest-CinderUnicodeTest-1215655246 None] Lock "cinder-68f3cb24-3921-401d-8730-15d82cfab6d4-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:08 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4e550008-934e-4403-bf19-80863619ff7c tempest-CinderUnicodeTest-1215655246 None] Acquiring lock "cinder-quobyte-68f3cb24-3921-401d-8730-15d82cfab6d4" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:08 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4e550008-934e-4403-bf19-80863619ff7c tempest-CinderUnicodeTest-1215655246 None] Lock "cinder-quobyte-68f3cb24-3921-401d-8730-15d82cfab6d4" acquired by "delete_volume" :: waited 0.020s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:08 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-0a5a8e82-63bb-4b2a-8349-985ccd3bd65a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Acquiring lock "cinder-997e7122-fde4-49a4-85c8-b86177fa39d0-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-de423374-5815-445b-9abd-1d294e93cb63 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-de423374-5815-445b-9abd-1d294e93cb63 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:08 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-de423374-5815-445b-9abd-1d294e93cb63 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:31:08 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-de423374-5815-445b-9abd-1d294e93cb63 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:31:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-de423374-5815-445b-9abd-1d294e93cb63 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-de423374-5815-445b-9abd-1d294e93cb63 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:08 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7ca1a0-7fc7-4ba4-a10b-611d221c5044]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:31:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4e550008-934e-4403-bf19-80863619ff7c tempest-CinderUnicodeTest-1215655246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:08 devstack sudo[105406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:31:08 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:08 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-0a5a8e82-63bb-4b2a-8349-985ccd3bd65a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "cinder-997e7122-fde4-49a4-85c8-b86177fa39d0-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:08 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-0a5a8e82-63bb-4b2a-8349-985ccd3bd65a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Acquiring lock "cinder-quobyte-997e7122-fde4-49a4-85c8-b86177fa39d0" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:08 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-0a5a8e82-63bb-4b2a-8349-985ccd3bd65a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "cinder-quobyte-997e7122-fde4-49a4-85c8-b86177fa39d0" acquired by "delete_volume" :: waited 0.017s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:08 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0b3818-1dab-42ec-ba67-6e05a5db5e0d]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:31:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0a5a8e82-63bb-4b2a-8349-985ccd3bd65a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-997e7122-fde4-49a4-85c8-b86177fa39d0 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:08 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4 Aug 31 15:31:08 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:08 devstack sudo[105409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-997e7122-fde4-49a4-85c8-b86177fa39d0 Aug 31 15:31:08 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:08 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-de423374-5815-445b-9abd-1d294e93cb63 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.300s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:08 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-de423374-5815-445b-9abd-1d294e93cb63 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:31:08 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-de423374-5815-445b-9abd-1d294e93cb63 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Deleted volume successfully. Aug 31 15:31:08 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-de423374-5815-445b-9abd-1d294e93cb63 tempest-VolumeAndVolumeTypeFromImageTest-1832429094 None] Lock "cinder-a3e122bf-672b-4403-86a4-465e2cf24cfb-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:09 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4e550008-934e-4403-bf19-80863619ff7c tempest-CinderUnicodeTest-1215655246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4" returned: 0 in 0.484s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4e550008-934e-4403-bf19-80863619ff7c tempest-CinderUnicodeTest-1215655246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:09 devstack sudo[105418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4 Aug 31 15:31:09 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:09 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0a5a8e82-63bb-4b2a-8349-985ccd3bd65a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-997e7122-fde4-49a4-85c8-b86177fa39d0" returned: 0 in 0.437s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0a5a8e82-63bb-4b2a-8349-985ccd3bd65a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-997e7122-fde4-49a4-85c8-b86177fa39d0 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:09 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-997e7122-fde4-49a4-85c8-b86177fa39d0 Aug 31 15:31:09 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:09 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4e550008-934e-4403-bf19-80863619ff7c tempest-CinderUnicodeTest-1215655246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-68f3cb24-3921-401d-8730-15d82cfab6d4" returned: 0 in 0.266s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:09 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4e550008-934e-4403-bf19-80863619ff7c tempest-CinderUnicodeTest-1215655246 None] Lock "cinder-quobyte-68f3cb24-3921-401d-8730-15d82cfab6d4" released by "delete_volume" :: held 0.862s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:09 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0a5a8e82-63bb-4b2a-8349-985ccd3bd65a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-997e7122-fde4-49a4-85c8-b86177fa39d0" returned: 0 in 0.255s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:09 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-0a5a8e82-63bb-4b2a-8349-985ccd3bd65a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "cinder-quobyte-997e7122-fde4-49a4-85c8-b86177fa39d0" released by "delete_volume" :: held 0.750s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:09 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-4e550008-934e-4403-bf19-80863619ff7c tempest-CinderUnicodeTest-1215655246 None] Created reservations ['6acc44d9-5316-4823-b586-913495064169', 'c81ca42f-399e-480c-9ba5-fcb6879c7f61', 'ea9ba760-733e-4cb6-a81a-809bb4bc6a81', 'f4f1ae85-6ee7-4743-acff-1f52df850356'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:31:09 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-0a5a8e82-63bb-4b2a-8349-985ccd3bd65a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Created reservations ['da5238f3-7660-4197-aa59-de3e83be09fe', '53da39c6-f235-465a-b803-ea6fb28eebdf', '65542b4e-583f-496d-a5e7-22b64c73772c', 'be5b17b5-b368-44fc-9eae-5dad2b7e27d4'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:31:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4e550008-934e-4403-bf19-80863619ff7c tempest-CinderUnicodeTest-1215655246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4e550008-934e-4403-bf19-80863619ff7c tempest-CinderUnicodeTest-1215655246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:09 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4e550008-934e-4403-bf19-80863619ff7c tempest-CinderUnicodeTest-1215655246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:31:09 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4e550008-934e-4403-bf19-80863619ff7c tempest-CinderUnicodeTest-1215655246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:31:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4e550008-934e-4403-bf19-80863619ff7c tempest-CinderUnicodeTest-1215655246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4e550008-934e-4403-bf19-80863619ff7c tempest-CinderUnicodeTest-1215655246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:09 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:31:09 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:09 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b279e66f-dd7b-4031-8f67-779b06f7fc25 tempest-CinderUnicodeTest-1215655246 None] Acquiring lock "cinder-9ac385e2-d9e2-489d-9038-4f67a592961d-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-0a5a8e82-63bb-4b2a-8349-985ccd3bd65a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-0a5a8e82-63bb-4b2a-8349-985ccd3bd65a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:09 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-0a5a8e82-63bb-4b2a-8349-985ccd3bd65a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:31:09 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-0a5a8e82-63bb-4b2a-8349-985ccd3bd65a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:31:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-0a5a8e82-63bb-4b2a-8349-985ccd3bd65a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0a5a8e82-63bb-4b2a-8349-985ccd3bd65a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:09 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b279e66f-dd7b-4031-8f67-779b06f7fc25 tempest-CinderUnicodeTest-1215655246 None] Lock "cinder-9ac385e2-d9e2-489d-9038-4f67a592961d-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:09 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:31:09 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:09 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b279e66f-dd7b-4031-8f67-779b06f7fc25 tempest-CinderUnicodeTest-1215655246 None] Acquiring lock "cinder-quobyte-9ac385e2-d9e2-489d-9038-4f67a592961d" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:09 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b279e66f-dd7b-4031-8f67-779b06f7fc25 tempest-CinderUnicodeTest-1215655246 None] Lock "cinder-quobyte-9ac385e2-d9e2-489d-9038-4f67a592961d" acquired by "delete_volume" :: waited 0.029s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:09 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5bb7fecb-7766-46a9-b70a-fde1b7205ed7 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Acquiring lock "cinder-8e74651d-c8fb-46ab-a232-446053999779-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:09 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d979b347-ac48-44ec-8daf-87185a3a4704]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:31:09 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5bb7fecb-7766-46a9-b70a-fde1b7205ed7 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "cinder-8e74651d-c8fb-46ab-a232-446053999779-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b279e66f-dd7b-4031-8f67-779b06f7fc25 tempest-CinderUnicodeTest-1215655246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9ac385e2-d9e2-489d-9038-4f67a592961d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:10 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5bb7fecb-7766-46a9-b70a-fde1b7205ed7 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Acquiring lock "cinder-quobyte-8e74651d-c8fb-46ab-a232-446053999779" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:10 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5bb7fecb-7766-46a9-b70a-fde1b7205ed7 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "cinder-quobyte-8e74651d-c8fb-46ab-a232-446053999779" acquired by "delete_volume" :: waited 0.027s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:10 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e07770-cc0f-4548-93b8-6d63471ebbae]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:31:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5bb7fecb-7766-46a9-b70a-fde1b7205ed7 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8e74651d-c8fb-46ab-a232-446053999779 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:10 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9ac385e2-d9e2-489d-9038-4f67a592961d Aug 31 15:31:10 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:10 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4e550008-934e-4403-bf19-80863619ff7c tempest-CinderUnicodeTest-1215655246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.493s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:10 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-4e550008-934e-4403-bf19-80863619ff7c tempest-CinderUnicodeTest-1215655246 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:31:10 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-4e550008-934e-4403-bf19-80863619ff7c tempest-CinderUnicodeTest-1215655246 None] Deleted volume successfully. Aug 31 15:31:10 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4e550008-934e-4403-bf19-80863619ff7c tempest-CinderUnicodeTest-1215655246 None] Lock "cinder-68f3cb24-3921-401d-8730-15d82cfab6d4-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:10 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0a5a8e82-63bb-4b2a-8349-985ccd3bd65a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.468s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:10 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-0a5a8e82-63bb-4b2a-8349-985ccd3bd65a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:31:10 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-0a5a8e82-63bb-4b2a-8349-985ccd3bd65a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Deleted volume successfully. Aug 31 15:31:10 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-0a5a8e82-63bb-4b2a-8349-985ccd3bd65a tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "cinder-997e7122-fde4-49a4-85c8-b86177fa39d0-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:10 devstack sudo[105431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8e74651d-c8fb-46ab-a232-446053999779 Aug 31 15:31:10 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:10 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b279e66f-dd7b-4031-8f67-779b06f7fc25 tempest-CinderUnicodeTest-1215655246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9ac385e2-d9e2-489d-9038-4f67a592961d" returned: 0 in 0.497s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b279e66f-dd7b-4031-8f67-779b06f7fc25 tempest-CinderUnicodeTest-1215655246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9ac385e2-d9e2-489d-9038-4f67a592961d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:10 devstack sudo[105439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9ac385e2-d9e2-489d-9038-4f67a592961d Aug 31 15:31:10 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:10 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5bb7fecb-7766-46a9-b70a-fde1b7205ed7 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8e74651d-c8fb-46ab-a232-446053999779" returned: 0 in 0.503s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5bb7fecb-7766-46a9-b70a-fde1b7205ed7 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8e74651d-c8fb-46ab-a232-446053999779 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:10 devstack sudo[105444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8e74651d-c8fb-46ab-a232-446053999779 Aug 31 15:31:10 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:10 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b279e66f-dd7b-4031-8f67-779b06f7fc25 tempest-CinderUnicodeTest-1215655246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9ac385e2-d9e2-489d-9038-4f67a592961d" returned: 0 in 0.310s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:10 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b279e66f-dd7b-4031-8f67-779b06f7fc25 tempest-CinderUnicodeTest-1215655246 None] Lock "cinder-quobyte-9ac385e2-d9e2-489d-9038-4f67a592961d" released by "delete_volume" :: held 0.889s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:10 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-b279e66f-dd7b-4031-8f67-779b06f7fc25 tempest-CinderUnicodeTest-1215655246 None] Created reservations ['485002f3-8757-444a-8889-292d461d99dd', 'c6974f9c-c285-433b-b970-882f39102bb4', '9ea19c7d-d37f-40e1-9b48-55bff486e910', 'b55a7b2d-86d3-40e0-a7fa-52cb8825b6ee'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:31:10 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5bb7fecb-7766-46a9-b70a-fde1b7205ed7 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8e74651d-c8fb-46ab-a232-446053999779" returned: 0 in 0.323s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:10 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5bb7fecb-7766-46a9-b70a-fde1b7205ed7 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "cinder-quobyte-8e74651d-c8fb-46ab-a232-446053999779" released by "delete_volume" :: held 0.876s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b279e66f-dd7b-4031-8f67-779b06f7fc25 tempest-CinderUnicodeTest-1215655246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b279e66f-dd7b-4031-8f67-779b06f7fc25 tempest-CinderUnicodeTest-1215655246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:10 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-b279e66f-dd7b-4031-8f67-779b06f7fc25 tempest-CinderUnicodeTest-1215655246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:31:10 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-b279e66f-dd7b-4031-8f67-779b06f7fc25 tempest-CinderUnicodeTest-1215655246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:31:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b279e66f-dd7b-4031-8f67-779b06f7fc25 tempest-CinderUnicodeTest-1215655246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b279e66f-dd7b-4031-8f67-779b06f7fc25 tempest-CinderUnicodeTest-1215655246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:11 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:31:11 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:11 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-5bb7fecb-7766-46a9-b70a-fde1b7205ed7 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Created reservations ['62d9f3a8-584d-49b5-bf79-6c45727616ff', 'd684f498-380c-48a6-9123-6536f5066bc6', '0643a756-4903-4d44-8da8-a1b553179a7e', '614ffd20-7a98-4a23-b577-f9a4e07172e9'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:31:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5bb7fecb-7766-46a9-b70a-fde1b7205ed7 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5bb7fecb-7766-46a9-b70a-fde1b7205ed7 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:11 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5bb7fecb-7766-46a9-b70a-fde1b7205ed7 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:31:11 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5bb7fecb-7766-46a9-b70a-fde1b7205ed7 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:31:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5bb7fecb-7766-46a9-b70a-fde1b7205ed7 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5bb7fecb-7766-46a9-b70a-fde1b7205ed7 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:11 devstack sudo[105450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:31:11 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:11 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b279e66f-dd7b-4031-8f67-779b06f7fc25 tempest-CinderUnicodeTest-1215655246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.319s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:11 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-b279e66f-dd7b-4031-8f67-779b06f7fc25 tempest-CinderUnicodeTest-1215655246 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:31:11 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-b279e66f-dd7b-4031-8f67-779b06f7fc25 tempest-CinderUnicodeTest-1215655246 None] Deleted volume successfully. Aug 31 15:31:11 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b279e66f-dd7b-4031-8f67-779b06f7fc25 tempest-CinderUnicodeTest-1215655246 None] Lock "cinder-9ac385e2-d9e2-489d-9038-4f67a592961d-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:11 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5bb7fecb-7766-46a9-b70a-fde1b7205ed7 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.295s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:11 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-5bb7fecb-7766-46a9-b70a-fde1b7205ed7 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:31:11 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-5bb7fecb-7766-46a9-b70a-fde1b7205ed7 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Deleted volume successfully. Aug 31 15:31:11 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5bb7fecb-7766-46a9-b70a-fde1b7205ed7 tempest-CreateVolumesFromSourceVolumeTest-1555168367 None] Lock "cinder-8e74651d-c8fb-46ab-a232-446053999779-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:11 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-d9688116-215e-467e-9fd3-5d00e80b6c99 tempest-ProjectAdminTests-259778992 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.3757095336914, 'free_capacity_gb': 1774.3757095336914, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86000) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 31 15:31:16 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c5d7260-642f-4e3c-9d61-7438392b73a6 tempest-CreateVolumesFromImageTest-1149543286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:31:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6c5d7260-642f-4e3c-9d61-7438392b73a6 tempest-CreateVolumesFromImageTest-1149543286 None] Flow 'volume_create_manager' (e73ff86a-4a9c-40a5-a1b1-7c53c2c9964e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:31:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6c5d7260-642f-4e3c-9d61-7438392b73a6 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52a6a050-6729-41a9-a6e2-dd062accaa5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6c5d7260-642f-4e3c-9d61-7438392b73a6 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52a6a050-6729-41a9-a6e2-dd062accaa5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-871123639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fe4bb19-86f9-405a-9714-f5903bc93720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcba25f9d3a24e9b9b992c5c243fe9be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:31:16Z,use_quota=True,user_id='c3b030eb1d174f1fa7f94b1601c954c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6c5d7260-642f-4e3c-9d61-7438392b73a6 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65a3339d-172e-439e-9a7d-6fe1617deaeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6c5d7260-642f-4e3c-9d61-7438392b73a6 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65a3339d-172e-439e-9a7d-6fe1617deaeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6c5d7260-642f-4e3c-9d61-7438392b73a6 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c97f073-529f-4e96-ab64-ce94105368cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6c5d7260-642f-4e3c-9d61-7438392b73a6 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c97f073-529f-4e96-ab64-ce94105368cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fe4bb19-86f9-405a-9714-f5903bc93720', 'volume_name': 'volume-8fe4bb19-86f9-405a-9714-f5903bc93720', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6c5d7260-642f-4e3c-9d61-7438392b73a6 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e68dacb-9d59-447d-8c01-317dea69cd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6c5d7260-642f-4e3c-9d61-7438392b73a6 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e68dacb-9d59-447d-8c01-317dea69cd9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6c5d7260-642f-4e3c-9d61-7438392b73a6 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30d1c72a-1677-4f12-82e8-88477252292c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:16 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-6c5d7260-642f-4e3c-9d61-7438392b73a6 tempest-CreateVolumesFromImageTest-1149543286 None] Volume 8fe4bb19-86f9-405a-9714-f5903bc93720: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fe4bb19-86f9-405a-9714-f5903bc93720', 'volume_size': 1} Aug 31 15:31:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6c5d7260-642f-4e3c-9d61-7438392b73a6 tempest-CreateVolumesFromImageTest-1149543286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6c5d7260-642f-4e3c-9d61-7438392b73a6 tempest-CreateVolumesFromImageTest-1149543286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:16 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6c5d7260-642f-4e3c-9d61-7438392b73a6 tempest-CreateVolumesFromImageTest-1149543286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-871123639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fe4bb19-86f9-405a-9714-f5903bc93720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcba25f9d3a24e9b9b992c5c243fe9be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:31:16Z,use_quota=True,user_id='c3b030eb1d174f1fa7f94b1601c954c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:31:16 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-6c5d7260-642f-4e3c-9d61-7438392b73a6 tempest-CreateVolumesFromImageTest-1149543286 None] Creating volume 8fe4bb19-86f9-405a-9714-f5903bc93720 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:31:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6c5d7260-642f-4e3c-9d61-7438392b73a6 tempest-CreateVolumesFromImageTest-1149543286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6c5d7260-642f-4e3c-9d61-7438392b73a6 tempest-CreateVolumesFromImageTest-1149543286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:16 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6c5d7260-642f-4e3c-9d61-7438392b73a6 tempest-CreateVolumesFromImageTest-1149543286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:31:16 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6c5d7260-642f-4e3c-9d61-7438392b73a6 tempest-CreateVolumesFromImageTest-1149543286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:31:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6c5d7260-642f-4e3c-9d61-7438392b73a6 tempest-CreateVolumesFromImageTest-1149543286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:16 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6c5d7260-642f-4e3c-9d61-7438392b73a6 tempest-CreateVolumesFromImageTest-1149543286 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:31:16 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-6c5d7260-642f-4e3c-9d61-7438392b73a6 tempest-CreateVolumesFromImageTest-1149543286 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:31:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6c5d7260-642f-4e3c-9d61-7438392b73a6 tempest-CreateVolumesFromImageTest-1149543286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8fe4bb19-86f9-405a-9714-f5903bc93720 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:16 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8fe4bb19-86f9-405a-9714-f5903bc93720 1073741824 Aug 31 15:31:16 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:16 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-f294c706-0ab0-4c1b-9b6a-805b88309cf4 tempest-CreateVolumesFromImageTest-1149543286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:31:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f294c706-0ab0-4c1b-9b6a-805b88309cf4 tempest-CreateVolumesFromImageTest-1149543286 None] Flow 'volume_create_manager' (6fecbb9b-412c-4367-bb07-0fca1505658c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:31:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f294c706-0ab0-4c1b-9b6a-805b88309cf4 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abdb7052-a823-43e1-9bb2-9d023db5fb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f294c706-0ab0-4c1b-9b6a-805b88309cf4 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abdb7052-a823-43e1-9bb2-9d023db5fb58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-76866017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1734f9e2-0604-4cba-a78e-4e2bb8b9d332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcba25f9d3a24e9b9b992c5c243fe9be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:31:17Z,use_quota=True,user_id='c3b030eb1d174f1fa7f94b1601c954c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f294c706-0ab0-4c1b-9b6a-805b88309cf4 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46e40825-f762-4234-bad6-6cac19c79463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f294c706-0ab0-4c1b-9b6a-805b88309cf4 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46e40825-f762-4234-bad6-6cac19c79463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f294c706-0ab0-4c1b-9b6a-805b88309cf4 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34327daa-2a6d-49db-8263-0a3cbb980bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f294c706-0ab0-4c1b-9b6a-805b88309cf4 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34327daa-2a6d-49db-8263-0a3cbb980bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1734f9e2-0604-4cba-a78e-4e2bb8b9d332', 'volume_name': 'volume-1734f9e2-0604-4cba-a78e-4e2bb8b9d332', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f294c706-0ab0-4c1b-9b6a-805b88309cf4 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5d5dbee-9d71-4f2d-8c34-5754fadd91c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f294c706-0ab0-4c1b-9b6a-805b88309cf4 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5d5dbee-9d71-4f2d-8c34-5754fadd91c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:16 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f294c706-0ab0-4c1b-9b6a-805b88309cf4 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e14e5e9d-8f37-4f28-8893-cd80a2433c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:16 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-f294c706-0ab0-4c1b-9b6a-805b88309cf4 tempest-CreateVolumesFromImageTest-1149543286 None] Volume 1734f9e2-0604-4cba-a78e-4e2bb8b9d332: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1734f9e2-0604-4cba-a78e-4e2bb8b9d332', 'volume_size': 1} Aug 31 15:31:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f294c706-0ab0-4c1b-9b6a-805b88309cf4 tempest-CreateVolumesFromImageTest-1149543286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:16 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6c5d7260-642f-4e3c-9d61-7438392b73a6 tempest-CreateVolumesFromImageTest-1149543286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8fe4bb19-86f9-405a-9714-f5903bc93720 1073741824" returned: 0 in 0.608s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6c5d7260-642f-4e3c-9d61-7438392b73a6 tempest-CreateVolumesFromImageTest-1149543286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8fe4bb19-86f9-405a-9714-f5903bc93720 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:16 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8fe4bb19-86f9-405a-9714-f5903bc93720 Aug 31 15:31:16 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:17 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6c5d7260-642f-4e3c-9d61-7438392b73a6 tempest-CreateVolumesFromImageTest-1149543286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8fe4bb19-86f9-405a-9714-f5903bc93720" returned: 0 in 0.351s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:17 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6c5d7260-642f-4e3c-9d61-7438392b73a6 tempest-CreateVolumesFromImageTest-1149543286 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:31:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6c5d7260-642f-4e3c-9d61-7438392b73a6 tempest-CreateVolumesFromImageTest-1149543286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f294c706-0ab0-4c1b-9b6a-805b88309cf4 tempest-CreateVolumesFromImageTest-1149543286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.497s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:17 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f294c706-0ab0-4c1b-9b6a-805b88309cf4 tempest-CreateVolumesFromImageTest-1149543286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-76866017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1734f9e2-0604-4cba-a78e-4e2bb8b9d332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcba25f9d3a24e9b9b992c5c243fe9be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:31:17Z,use_quota=True,user_id='c3b030eb1d174f1fa7f94b1601c954c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:31:17 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-f294c706-0ab0-4c1b-9b6a-805b88309cf4 tempest-CreateVolumesFromImageTest-1149543286 None] Creating volume 1734f9e2-0604-4cba-a78e-4e2bb8b9d332 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:31:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f294c706-0ab0-4c1b-9b6a-805b88309cf4 tempest-CreateVolumesFromImageTest-1149543286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f294c706-0ab0-4c1b-9b6a-805b88309cf4 tempest-CreateVolumesFromImageTest-1149543286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:17 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f294c706-0ab0-4c1b-9b6a-805b88309cf4 tempest-CreateVolumesFromImageTest-1149543286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:31:17 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f294c706-0ab0-4c1b-9b6a-805b88309cf4 tempest-CreateVolumesFromImageTest-1149543286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:31:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f294c706-0ab0-4c1b-9b6a-805b88309cf4 tempest-CreateVolumesFromImageTest-1149543286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:17 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f294c706-0ab0-4c1b-9b6a-805b88309cf4 tempest-CreateVolumesFromImageTest-1149543286 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:31:17 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-f294c706-0ab0-4c1b-9b6a-805b88309cf4 tempest-CreateVolumesFromImageTest-1149543286 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:31:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f294c706-0ab0-4c1b-9b6a-805b88309cf4 tempest-CreateVolumesFromImageTest-1149543286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1734f9e2-0604-4cba-a78e-4e2bb8b9d332 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6c5d7260-642f-4e3c-9d61-7438392b73a6 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30d1c72a-1677-4f12-82e8-88477252292c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fe4bb19-86f9-405a-9714-f5903bc93720', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6c5d7260-642f-4e3c-9d61-7438392b73a6 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (250c46fc-7e7f-48d8-a7ed-f25b68ab92f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:17 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbf1be53-bf7d-4bba-bad3-a787a8dbb110 tempest-CreateVolumesFromImageTest-1149543286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:31:17 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1734f9e2-0604-4cba-a78e-4e2bb8b9d332 1073741824 Aug 31 15:31:17 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dbf1be53-bf7d-4bba-bad3-a787a8dbb110 tempest-CreateVolumesFromImageTest-1149543286 None] Flow 'volume_create_manager' (0c4017f7-47b8-4d00-a745-b3959c362c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:31:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dbf1be53-bf7d-4bba-bad3-a787a8dbb110 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2f458c1-f862-4a71-b10c-df2dfdf111dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dbf1be53-bf7d-4bba-bad3-a787a8dbb110 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2f458c1-f862-4a71-b10c-df2dfdf111dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1210922621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=596cf5f6-51a0-4369-b473-c661b89fb171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcba25f9d3a24e9b9b992c5c243fe9be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:31:17Z,use_quota=True,user_id='c3b030eb1d174f1fa7f94b1601c954c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dbf1be53-bf7d-4bba-bad3-a787a8dbb110 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b50b97c-17d7-455e-b70f-7a7941b6df5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dbf1be53-bf7d-4bba-bad3-a787a8dbb110 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b50b97c-17d7-455e-b70f-7a7941b6df5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dbf1be53-bf7d-4bba-bad3-a787a8dbb110 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cc2f2c0-02ba-4595-88f6-a496f621f05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dbf1be53-bf7d-4bba-bad3-a787a8dbb110 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cc2f2c0-02ba-4595-88f6-a496f621f05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '596cf5f6-51a0-4369-b473-c661b89fb171', 'volume_name': 'volume-596cf5f6-51a0-4369-b473-c661b89fb171', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dbf1be53-bf7d-4bba-bad3-a787a8dbb110 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a31e3f-9c74-4e46-ba6e-5b7bf56e8bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dbf1be53-bf7d-4bba-bad3-a787a8dbb110 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a31e3f-9c74-4e46-ba6e-5b7bf56e8bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dbf1be53-bf7d-4bba-bad3-a787a8dbb110 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70fb17c4-845d-4977-86e3-76407ddba8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:17 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-dbf1be53-bf7d-4bba-bad3-a787a8dbb110 tempest-CreateVolumesFromImageTest-1149543286 None] Volume 596cf5f6-51a0-4369-b473-c661b89fb171: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-596cf5f6-51a0-4369-b473-c661b89fb171', 'volume_size': 1} Aug 31 15:31:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-dbf1be53-bf7d-4bba-bad3-a787a8dbb110 tempest-CreateVolumesFromImageTest-1149543286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:17 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-6c5d7260-642f-4e3c-9d61-7438392b73a6 tempest-CreateVolumesFromImageTest-1149543286 None] Volume volume-8fe4bb19-86f9-405a-9714-f5903bc93720 (8fe4bb19-86f9-405a-9714-f5903bc93720): created successfully Aug 31 15:31:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6c5d7260-642f-4e3c-9d61-7438392b73a6 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (250c46fc-7e7f-48d8-a7ed-f25b68ab92f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6c5d7260-642f-4e3c-9d61-7438392b73a6 tempest-CreateVolumesFromImageTest-1149543286 None] Flow 'volume_create_manager' (e73ff86a-4a9c-40a5-a1b1-7c53c2c9964e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:31:17 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-6c5d7260-642f-4e3c-9d61-7438392b73a6 tempest-CreateVolumesFromImageTest-1149543286 None] Created volume successfully. Aug 31 15:31:17 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-f542fc2e-c2a0-4763-8fec-af602061d6ef tempest-CreateVolumesFromImageTest-1149543286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:31:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f542fc2e-c2a0-4763-8fec-af602061d6ef tempest-CreateVolumesFromImageTest-1149543286 None] Flow 'volume_create_manager' (5ed721f8-b42f-4048-8e8e-aaca5115ec93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:31:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f542fc2e-c2a0-4763-8fec-af602061d6ef tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59edf5fe-9812-4205-b956-4f69cb51c11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f542fc2e-c2a0-4763-8fec-af602061d6ef tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59edf5fe-9812-4205-b956-4f69cb51c11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2088509216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f23173a3-b755-4416-ae01-d06cb2bc9d06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcba25f9d3a24e9b9b992c5c243fe9be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:31:18Z,use_quota=True,user_id='c3b030eb1d174f1fa7f94b1601c954c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f542fc2e-c2a0-4763-8fec-af602061d6ef tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acf9bad1-0915-4c26-9e9d-9a64b80e18a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f542fc2e-c2a0-4763-8fec-af602061d6ef tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acf9bad1-0915-4c26-9e9d-9a64b80e18a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f542fc2e-c2a0-4763-8fec-af602061d6ef tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f350c00b-91ad-43e8-b4d7-63b3669e0b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f542fc2e-c2a0-4763-8fec-af602061d6ef tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f350c00b-91ad-43e8-b4d7-63b3669e0b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f23173a3-b755-4416-ae01-d06cb2bc9d06', 'volume_name': 'volume-f23173a3-b755-4416-ae01-d06cb2bc9d06', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f542fc2e-c2a0-4763-8fec-af602061d6ef tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e27475d5-66bc-457f-8dbd-b389c5649880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f542fc2e-c2a0-4763-8fec-af602061d6ef tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e27475d5-66bc-457f-8dbd-b389c5649880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f542fc2e-c2a0-4763-8fec-af602061d6ef tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e43fec62-53e8-4354-bf6c-a64083cfab4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:17 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-f542fc2e-c2a0-4763-8fec-af602061d6ef tempest-CreateVolumesFromImageTest-1149543286 None] Volume f23173a3-b755-4416-ae01-d06cb2bc9d06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f23173a3-b755-4416-ae01-d06cb2bc9d06', 'volume_size': 1} Aug 31 15:31:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f542fc2e-c2a0-4763-8fec-af602061d6ef tempest-CreateVolumesFromImageTest-1149543286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:18 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-79339cb4-7bb8-47d4-b699-0befe58a95c2 tempest-VolumeDependencyTests-289667774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:31:18 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-79339cb4-7bb8-47d4-b699-0befe58a95c2 tempest-VolumeDependencyTests-289667774 None] Flow 'volume_create_manager' (7f9c2272-d674-43cb-b9d7-0816952e2c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:31:18 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-79339cb4-7bb8-47d4-b699-0befe58a95c2 tempest-VolumeDependencyTests-289667774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e9e2082-4009-4f4b-9ee9-0902c982a8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:18 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f294c706-0ab0-4c1b-9b6a-805b88309cf4 tempest-CreateVolumesFromImageTest-1149543286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1734f9e2-0604-4cba-a78e-4e2bb8b9d332 1073741824" returned: 0 in 0.866s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:18 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-79339cb4-7bb8-47d4-b699-0befe58a95c2 tempest-VolumeDependencyTests-289667774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e9e2082-4009-4f4b-9ee9-0902c982a8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-107945120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8030fa77-ccec-4fb8-b962-a640a57f50f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='429ab50b0dff4691adfe34e4f30133ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:31:18Z,use_quota=True,user_id='a0350ea6f95e455d9021444d3dc9d97e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:18 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-79339cb4-7bb8-47d4-b699-0befe58a95c2 tempest-VolumeDependencyTests-289667774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4f12e5e-17fc-4831-a995-dae0bbe70998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:18 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-79339cb4-7bb8-47d4-b699-0befe58a95c2 tempest-VolumeDependencyTests-289667774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4f12e5e-17fc-4831-a995-dae0bbe70998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:18 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-79339cb4-7bb8-47d4-b699-0befe58a95c2 tempest-VolumeDependencyTests-289667774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d4f36d2-179d-4a30-9f12-d8df03a4748f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:18 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-79339cb4-7bb8-47d4-b699-0befe58a95c2 tempest-VolumeDependencyTests-289667774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d4f36d2-179d-4a30-9f12-d8df03a4748f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8030fa77-ccec-4fb8-b962-a640a57f50f1', 'volume_name': 'volume-8030fa77-ccec-4fb8-b962-a640a57f50f1', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:18 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-79339cb4-7bb8-47d4-b699-0befe58a95c2 tempest-VolumeDependencyTests-289667774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6ba778f-1ef0-44a1-87ef-896470b856eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:18 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-79339cb4-7bb8-47d4-b699-0befe58a95c2 tempest-VolumeDependencyTests-289667774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6ba778f-1ef0-44a1-87ef-896470b856eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:18 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-79339cb4-7bb8-47d4-b699-0befe58a95c2 tempest-VolumeDependencyTests-289667774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb63a1f2-9f88-4500-b470-888e924bbfd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:18 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-79339cb4-7bb8-47d4-b699-0befe58a95c2 tempest-VolumeDependencyTests-289667774 None] Volume 8030fa77-ccec-4fb8-b962-a640a57f50f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8030fa77-ccec-4fb8-b962-a640a57f50f1', 'volume_size': 1} Aug 31 15:31:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-79339cb4-7bb8-47d4-b699-0befe58a95c2 tempest-VolumeDependencyTests-289667774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f294c706-0ab0-4c1b-9b6a-805b88309cf4 tempest-CreateVolumesFromImageTest-1149543286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1734f9e2-0604-4cba-a78e-4e2bb8b9d332 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:18 devstack sudo[105469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1734f9e2-0604-4cba-a78e-4e2bb8b9d332 Aug 31 15:31:18 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:18 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-976bfbff-e23b-45a0-8bc4-f390f7ac60e0 tempest-CreateVolumesFromImageTest-1149543286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:31:18 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-976bfbff-e23b-45a0-8bc4-f390f7ac60e0 tempest-CreateVolumesFromImageTest-1149543286 None] Flow 'volume_create_manager' (ed16d3dd-907e-4323-bb53-5ab698a5a303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:31:18 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-976bfbff-e23b-45a0-8bc4-f390f7ac60e0 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bee9bf7f-a16d-4045-9d7b-1b1be339f550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:18 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-976bfbff-e23b-45a0-8bc4-f390f7ac60e0 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bee9bf7f-a16d-4045-9d7b-1b1be339f550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1143340265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bf7b503-8f5b-4fa6-8815-d006778efe7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcba25f9d3a24e9b9b992c5c243fe9be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:31:18Z,use_quota=True,user_id='c3b030eb1d174f1fa7f94b1601c954c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:18 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-976bfbff-e23b-45a0-8bc4-f390f7ac60e0 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a31a15d-273b-4a2a-8f53-c0e8b6128d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:18 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-976bfbff-e23b-45a0-8bc4-f390f7ac60e0 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a31a15d-273b-4a2a-8f53-c0e8b6128d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:18 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-976bfbff-e23b-45a0-8bc4-f390f7ac60e0 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65651050-8741-4dc1-b94b-b276c942ac3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:18 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-976bfbff-e23b-45a0-8bc4-f390f7ac60e0 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65651050-8741-4dc1-b94b-b276c942ac3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bf7b503-8f5b-4fa6-8815-d006778efe7d', 'volume_name': 'volume-8bf7b503-8f5b-4fa6-8815-d006778efe7d', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:18 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-976bfbff-e23b-45a0-8bc4-f390f7ac60e0 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00477b17-4043-41c3-afac-8bf25db45104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:18 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-976bfbff-e23b-45a0-8bc4-f390f7ac60e0 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00477b17-4043-41c3-afac-8bf25db45104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:18 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-976bfbff-e23b-45a0-8bc4-f390f7ac60e0 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb8882d2-0649-4360-924e-d040093a5a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:18 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:18 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-976bfbff-e23b-45a0-8bc4-f390f7ac60e0 tempest-CreateVolumesFromImageTest-1149543286 None] Volume 8bf7b503-8f5b-4fa6-8815-d006778efe7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bf7b503-8f5b-4fa6-8815-d006778efe7d', 'volume_size': 1} Aug 31 15:31:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-976bfbff-e23b-45a0-8bc4-f390f7ac60e0 tempest-CreateVolumesFromImageTest-1149543286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f294c706-0ab0-4c1b-9b6a-805b88309cf4 tempest-CreateVolumesFromImageTest-1149543286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1734f9e2-0604-4cba-a78e-4e2bb8b9d332" returned: 0 in 0.315s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:18 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f294c706-0ab0-4c1b-9b6a-805b88309cf4 tempest-CreateVolumesFromImageTest-1149543286 None] <== create_volume: return (1374ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:31:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f294c706-0ab0-4c1b-9b6a-805b88309cf4 tempest-CreateVolumesFromImageTest-1149543286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.380s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-dbf1be53-bf7d-4bba-bad3-a787a8dbb110 tempest-CreateVolumesFromImageTest-1149543286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.187s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:18 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-dbf1be53-bf7d-4bba-bad3-a787a8dbb110 tempest-CreateVolumesFromImageTest-1149543286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1210922621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=596cf5f6-51a0-4369-b473-c661b89fb171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcba25f9d3a24e9b9b992c5c243fe9be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:31:17Z,use_quota=True,user_id='c3b030eb1d174f1fa7f94b1601c954c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:31:18 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-dbf1be53-bf7d-4bba-bad3-a787a8dbb110 tempest-CreateVolumesFromImageTest-1149543286 None] Creating volume 596cf5f6-51a0-4369-b473-c661b89fb171 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:31:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-dbf1be53-bf7d-4bba-bad3-a787a8dbb110 tempest-CreateVolumesFromImageTest-1149543286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-dbf1be53-bf7d-4bba-bad3-a787a8dbb110 tempest-CreateVolumesFromImageTest-1149543286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:18 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-dbf1be53-bf7d-4bba-bad3-a787a8dbb110 tempest-CreateVolumesFromImageTest-1149543286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:31:18 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-dbf1be53-bf7d-4bba-bad3-a787a8dbb110 tempest-CreateVolumesFromImageTest-1149543286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:31:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-dbf1be53-bf7d-4bba-bad3-a787a8dbb110 tempest-CreateVolumesFromImageTest-1149543286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:18 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-dbf1be53-bf7d-4bba-bad3-a787a8dbb110 tempest-CreateVolumesFromImageTest-1149543286 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:31:18 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-dbf1be53-bf7d-4bba-bad3-a787a8dbb110 tempest-CreateVolumesFromImageTest-1149543286 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:31:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-dbf1be53-bf7d-4bba-bad3-a787a8dbb110 tempest-CreateVolumesFromImageTest-1149543286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-596cf5f6-51a0-4369-b473-c661b89fb171 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:18 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f294c706-0ab0-4c1b-9b6a-805b88309cf4 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e14e5e9d-8f37-4f28-8893-cd80a2433c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1734f9e2-0604-4cba-a78e-4e2bb8b9d332', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:18 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f294c706-0ab0-4c1b-9b6a-805b88309cf4 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72386831-9582-460d-93cd-8e1a2584bba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:18 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-596cf5f6-51a0-4369-b473-c661b89fb171 1073741824 Aug 31 15:31:18 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:18 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-f294c706-0ab0-4c1b-9b6a-805b88309cf4 tempest-CreateVolumesFromImageTest-1149543286 None] Volume volume-1734f9e2-0604-4cba-a78e-4e2bb8b9d332 (1734f9e2-0604-4cba-a78e-4e2bb8b9d332): created successfully Aug 31 15:31:18 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f294c706-0ab0-4c1b-9b6a-805b88309cf4 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72386831-9582-460d-93cd-8e1a2584bba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:18 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f294c706-0ab0-4c1b-9b6a-805b88309cf4 tempest-CreateVolumesFromImageTest-1149543286 None] Flow 'volume_create_manager' (6fecbb9b-412c-4367-bb07-0fca1505658c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:31:18 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-f294c706-0ab0-4c1b-9b6a-805b88309cf4 tempest-CreateVolumesFromImageTest-1149543286 None] Created volume successfully. Aug 31 15:31:19 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-dbf1be53-bf7d-4bba-bad3-a787a8dbb110 tempest-CreateVolumesFromImageTest-1149543286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-596cf5f6-51a0-4369-b473-c661b89fb171 1073741824" returned: 0 in 0.518s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-dbf1be53-bf7d-4bba-bad3-a787a8dbb110 tempest-CreateVolumesFromImageTest-1149543286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-596cf5f6-51a0-4369-b473-c661b89fb171 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:19 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-596cf5f6-51a0-4369-b473-c661b89fb171 Aug 31 15:31:19 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:19 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-dbf1be53-bf7d-4bba-bad3-a787a8dbb110 tempest-CreateVolumesFromImageTest-1149543286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-596cf5f6-51a0-4369-b473-c661b89fb171" returned: 0 in 0.296s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:19 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-dbf1be53-bf7d-4bba-bad3-a787a8dbb110 tempest-CreateVolumesFromImageTest-1149543286 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:31:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-dbf1be53-bf7d-4bba-bad3-a787a8dbb110 tempest-CreateVolumesFromImageTest-1149543286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f542fc2e-c2a0-4763-8fec-af602061d6ef tempest-CreateVolumesFromImageTest-1149543286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.513s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:19 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f542fc2e-c2a0-4763-8fec-af602061d6ef tempest-CreateVolumesFromImageTest-1149543286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2088509216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f23173a3-b755-4416-ae01-d06cb2bc9d06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcba25f9d3a24e9b9b992c5c243fe9be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:31:18Z,use_quota=True,user_id='c3b030eb1d174f1fa7f94b1601c954c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:31:19 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-f542fc2e-c2a0-4763-8fec-af602061d6ef tempest-CreateVolumesFromImageTest-1149543286 None] Creating volume f23173a3-b755-4416-ae01-d06cb2bc9d06 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:31:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f542fc2e-c2a0-4763-8fec-af602061d6ef tempest-CreateVolumesFromImageTest-1149543286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f542fc2e-c2a0-4763-8fec-af602061d6ef tempest-CreateVolumesFromImageTest-1149543286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:19 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f542fc2e-c2a0-4763-8fec-af602061d6ef tempest-CreateVolumesFromImageTest-1149543286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:31:19 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f542fc2e-c2a0-4763-8fec-af602061d6ef tempest-CreateVolumesFromImageTest-1149543286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:31:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f542fc2e-c2a0-4763-8fec-af602061d6ef tempest-CreateVolumesFromImageTest-1149543286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:19 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f542fc2e-c2a0-4763-8fec-af602061d6ef tempest-CreateVolumesFromImageTest-1149543286 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:31:19 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-f542fc2e-c2a0-4763-8fec-af602061d6ef tempest-CreateVolumesFromImageTest-1149543286 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:31:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f542fc2e-c2a0-4763-8fec-af602061d6ef tempest-CreateVolumesFromImageTest-1149543286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f23173a3-b755-4416-ae01-d06cb2bc9d06 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:19 devstack sudo[105482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f23173a3-b755-4416-ae01-d06cb2bc9d06 1073741824 Aug 31 15:31:19 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:19 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dbf1be53-bf7d-4bba-bad3-a787a8dbb110 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70fb17c4-845d-4977-86e3-76407ddba8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-596cf5f6-51a0-4369-b473-c661b89fb171', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:19 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dbf1be53-bf7d-4bba-bad3-a787a8dbb110 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4dbfd75-8837-4102-9251-f1267a30db37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:19 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-dbf1be53-bf7d-4bba-bad3-a787a8dbb110 tempest-CreateVolumesFromImageTest-1149543286 None] Volume volume-596cf5f6-51a0-4369-b473-c661b89fb171 (596cf5f6-51a0-4369-b473-c661b89fb171): created successfully Aug 31 15:31:19 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dbf1be53-bf7d-4bba-bad3-a787a8dbb110 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4dbfd75-8837-4102-9251-f1267a30db37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:19 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-dbf1be53-bf7d-4bba-bad3-a787a8dbb110 tempest-CreateVolumesFromImageTest-1149543286 None] Flow 'volume_create_manager' (0c4017f7-47b8-4d00-a745-b3959c362c5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:31:19 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-dbf1be53-bf7d-4bba-bad3-a787a8dbb110 tempest-CreateVolumesFromImageTest-1149543286 None] Created volume successfully. Aug 31 15:31:20 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f542fc2e-c2a0-4763-8fec-af602061d6ef tempest-CreateVolumesFromImageTest-1149543286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f23173a3-b755-4416-ae01-d06cb2bc9d06 1073741824" returned: 0 in 0.542s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f542fc2e-c2a0-4763-8fec-af602061d6ef tempest-CreateVolumesFromImageTest-1149543286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f23173a3-b755-4416-ae01-d06cb2bc9d06 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:20 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f23173a3-b755-4416-ae01-d06cb2bc9d06 Aug 31 15:31:20 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:20 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f542fc2e-c2a0-4763-8fec-af602061d6ef tempest-CreateVolumesFromImageTest-1149543286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f23173a3-b755-4416-ae01-d06cb2bc9d06" returned: 0 in 0.301s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:20 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f542fc2e-c2a0-4763-8fec-af602061d6ef tempest-CreateVolumesFromImageTest-1149543286 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:31:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f542fc2e-c2a0-4763-8fec-af602061d6ef tempest-CreateVolumesFromImageTest-1149543286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-79339cb4-7bb8-47d4-b699-0befe58a95c2 tempest-VolumeDependencyTests-289667774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.148s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:20 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-79339cb4-7bb8-47d4-b699-0befe58a95c2 tempest-VolumeDependencyTests-289667774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-107945120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8030fa77-ccec-4fb8-b962-a640a57f50f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='429ab50b0dff4691adfe34e4f30133ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:31:18Z,use_quota=True,user_id='a0350ea6f95e455d9021444d3dc9d97e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:31:20 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-79339cb4-7bb8-47d4-b699-0befe58a95c2 tempest-VolumeDependencyTests-289667774 None] Creating volume 8030fa77-ccec-4fb8-b962-a640a57f50f1 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:31:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-79339cb4-7bb8-47d4-b699-0befe58a95c2 tempest-VolumeDependencyTests-289667774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-79339cb4-7bb8-47d4-b699-0befe58a95c2 tempest-VolumeDependencyTests-289667774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:20 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-79339cb4-7bb8-47d4-b699-0befe58a95c2 tempest-VolumeDependencyTests-289667774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:31:20 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-79339cb4-7bb8-47d4-b699-0befe58a95c2 tempest-VolumeDependencyTests-289667774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:31:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-79339cb4-7bb8-47d4-b699-0befe58a95c2 tempest-VolumeDependencyTests-289667774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:20 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-79339cb4-7bb8-47d4-b699-0befe58a95c2 tempest-VolumeDependencyTests-289667774 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:31:20 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-79339cb4-7bb8-47d4-b699-0befe58a95c2 tempest-VolumeDependencyTests-289667774 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:31:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-79339cb4-7bb8-47d4-b699-0befe58a95c2 tempest-VolumeDependencyTests-289667774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:20 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1 1073741824 Aug 31 15:31:20 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:20 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f542fc2e-c2a0-4763-8fec-af602061d6ef tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e43fec62-53e8-4354-bf6c-a64083cfab4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f23173a3-b755-4416-ae01-d06cb2bc9d06', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:20 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f542fc2e-c2a0-4763-8fec-af602061d6ef tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48d81e70-8db4-4f45-9fbf-6e39282486e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:20 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-f542fc2e-c2a0-4763-8fec-af602061d6ef tempest-CreateVolumesFromImageTest-1149543286 None] Volume volume-f23173a3-b755-4416-ae01-d06cb2bc9d06 (f23173a3-b755-4416-ae01-d06cb2bc9d06): created successfully Aug 31 15:31:20 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f542fc2e-c2a0-4763-8fec-af602061d6ef tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48d81e70-8db4-4f45-9fbf-6e39282486e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:20 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f542fc2e-c2a0-4763-8fec-af602061d6ef tempest-CreateVolumesFromImageTest-1149543286 None] Flow 'volume_create_manager' (5ed721f8-b42f-4048-8e8e-aaca5115ec93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:31:20 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-f542fc2e-c2a0-4763-8fec-af602061d6ef tempest-CreateVolumesFromImageTest-1149543286 None] Created volume successfully. Aug 31 15:31:20 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-79339cb4-7bb8-47d4-b699-0befe58a95c2 tempest-VolumeDependencyTests-289667774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1 1073741824" returned: 0 in 0.540s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-79339cb4-7bb8-47d4-b699-0befe58a95c2 tempest-VolumeDependencyTests-289667774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:20 devstack sudo[105497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1 Aug 31 15:31:21 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:21 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-79339cb4-7bb8-47d4-b699-0befe58a95c2 tempest-VolumeDependencyTests-289667774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1" returned: 0 in 0.348s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:21 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-79339cb4-7bb8-47d4-b699-0befe58a95c2 tempest-VolumeDependencyTests-289667774 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:31:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-79339cb4-7bb8-47d4-b699-0befe58a95c2 tempest-VolumeDependencyTests-289667774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-976bfbff-e23b-45a0-8bc4-f390f7ac60e0 tempest-CreateVolumesFromImageTest-1149543286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.727s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:21 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-976bfbff-e23b-45a0-8bc4-f390f7ac60e0 tempest-CreateVolumesFromImageTest-1149543286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1143340265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bf7b503-8f5b-4fa6-8815-d006778efe7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcba25f9d3a24e9b9b992c5c243fe9be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:31:18Z,use_quota=True,user_id='c3b030eb1d174f1fa7f94b1601c954c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:31:21 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-976bfbff-e23b-45a0-8bc4-f390f7ac60e0 tempest-CreateVolumesFromImageTest-1149543286 None] Creating volume 8bf7b503-8f5b-4fa6-8815-d006778efe7d {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:31:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-976bfbff-e23b-45a0-8bc4-f390f7ac60e0 tempest-CreateVolumesFromImageTest-1149543286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-976bfbff-e23b-45a0-8bc4-f390f7ac60e0 tempest-CreateVolumesFromImageTest-1149543286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:21 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-976bfbff-e23b-45a0-8bc4-f390f7ac60e0 tempest-CreateVolumesFromImageTest-1149543286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:31:21 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-976bfbff-e23b-45a0-8bc4-f390f7ac60e0 tempest-CreateVolumesFromImageTest-1149543286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:31:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-976bfbff-e23b-45a0-8bc4-f390f7ac60e0 tempest-CreateVolumesFromImageTest-1149543286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:21 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-976bfbff-e23b-45a0-8bc4-f390f7ac60e0 tempest-CreateVolumesFromImageTest-1149543286 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:31:21 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-976bfbff-e23b-45a0-8bc4-f390f7ac60e0 tempest-CreateVolumesFromImageTest-1149543286 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:31:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-976bfbff-e23b-45a0-8bc4-f390f7ac60e0 tempest-CreateVolumesFromImageTest-1149543286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8bf7b503-8f5b-4fa6-8815-d006778efe7d 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:21 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-79339cb4-7bb8-47d4-b699-0befe58a95c2 tempest-VolumeDependencyTests-289667774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb63a1f2-9f88-4500-b470-888e924bbfd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8030fa77-ccec-4fb8-b962-a640a57f50f1', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:21 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-79339cb4-7bb8-47d4-b699-0befe58a95c2 tempest-VolumeDependencyTests-289667774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8a8088d-0e1f-482a-a05c-6f3611fdfb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:21 devstack sudo[105501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8bf7b503-8f5b-4fa6-8815-d006778efe7d 1073741824 Aug 31 15:31:21 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:21 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-79339cb4-7bb8-47d4-b699-0befe58a95c2 tempest-VolumeDependencyTests-289667774 None] Volume volume-8030fa77-ccec-4fb8-b962-a640a57f50f1 (8030fa77-ccec-4fb8-b962-a640a57f50f1): created successfully Aug 31 15:31:21 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-79339cb4-7bb8-47d4-b699-0befe58a95c2 tempest-VolumeDependencyTests-289667774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8a8088d-0e1f-482a-a05c-6f3611fdfb22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:21 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-79339cb4-7bb8-47d4-b699-0befe58a95c2 tempest-VolumeDependencyTests-289667774 None] Flow 'volume_create_manager' (7f9c2272-d674-43cb-b9d7-0816952e2c78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:31:21 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-79339cb4-7bb8-47d4-b699-0befe58a95c2 tempest-VolumeDependencyTests-289667774 None] Created volume successfully. Aug 31 15:31:21 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-976bfbff-e23b-45a0-8bc4-f390f7ac60e0 tempest-CreateVolumesFromImageTest-1149543286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8bf7b503-8f5b-4fa6-8815-d006778efe7d 1073741824" returned: 0 in 0.506s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-976bfbff-e23b-45a0-8bc4-f390f7ac60e0 tempest-CreateVolumesFromImageTest-1149543286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8bf7b503-8f5b-4fa6-8815-d006778efe7d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:21 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8bf7b503-8f5b-4fa6-8815-d006778efe7d Aug 31 15:31:21 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:22 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-976bfbff-e23b-45a0-8bc4-f390f7ac60e0 tempest-CreateVolumesFromImageTest-1149543286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8bf7b503-8f5b-4fa6-8815-d006778efe7d" returned: 0 in 0.283s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:22 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-976bfbff-e23b-45a0-8bc4-f390f7ac60e0 tempest-CreateVolumesFromImageTest-1149543286 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:31:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-976bfbff-e23b-45a0-8bc4-f390f7ac60e0 tempest-CreateVolumesFromImageTest-1149543286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-976bfbff-e23b-45a0-8bc4-f390f7ac60e0 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb8882d2-0649-4360-924e-d040093a5a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bf7b503-8f5b-4fa6-8815-d006778efe7d', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-976bfbff-e23b-45a0-8bc4-f390f7ac60e0 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86b2ea24-ce12-4acd-bfe5-00112570a761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:22 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-976bfbff-e23b-45a0-8bc4-f390f7ac60e0 tempest-CreateVolumesFromImageTest-1149543286 None] Volume volume-8bf7b503-8f5b-4fa6-8815-d006778efe7d (8bf7b503-8f5b-4fa6-8815-d006778efe7d): created successfully Aug 31 15:31:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-976bfbff-e23b-45a0-8bc4-f390f7ac60e0 tempest-CreateVolumesFromImageTest-1149543286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86b2ea24-ce12-4acd-bfe5-00112570a761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-976bfbff-e23b-45a0-8bc4-f390f7ac60e0 tempest-CreateVolumesFromImageTest-1149543286 None] Flow 'volume_create_manager' (ed16d3dd-907e-4323-bb53-5ab698a5a303) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:31:22 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-976bfbff-e23b-45a0-8bc4-f390f7ac60e0 tempest-CreateVolumesFromImageTest-1149543286 None] Created volume successfully. Aug 31 15:31:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f8e4949d-ad41-46c0-88a3-a010efff9c88 tempest-VolumeDependencyTests-289667774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f8e4949d-ad41-46c0-88a3-a010efff9c88 tempest-VolumeDependencyTests-289667774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:22 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-f8e4949d-ad41-46c0-88a3-a010efff9c88 tempest-VolumeDependencyTests-289667774 None] Creating offline snapshot 6ac087c1-dd1d-4c8d-9707-8f16fbd2c060 of volume 8030fa77-ccec-4fb8-b962-a640a57f50f1 {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:31:22 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fb1c0c-a8b3-4f74-9aa4-85abe01a6bcb]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:31:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f8e4949d-ad41-46c0-88a3-a010efff9c88 tempest-VolumeDependencyTests-289667774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:22 devstack sudo[105511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1 Aug 31 15:31:22 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:22 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f8e4949d-ad41-46c0-88a3-a010efff9c88 tempest-VolumeDependencyTests-289667774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1" returned: 0 in 0.423s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f8e4949d-ad41-46c0-88a3-a010efff9c88 tempest-VolumeDependencyTests-289667774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1.6ac087c1-dd1d-4c8d-9707-8f16fbd2c060 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:22 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1.6ac087c1-dd1d-4c8d-9707-8f16fbd2c060 1G Aug 31 15:31:22 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:23 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-53a4a8c9-953d-4605-9943-56291a9101eb tempest-CreateVolumesFromImageTest-1149543286 None] Acquiring lock "cinder-8bf7b503-8f5b-4fa6-8815-d006778efe7d-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:23 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-53a4a8c9-953d-4605-9943-56291a9101eb tempest-CreateVolumesFromImageTest-1149543286 None] Lock "cinder-8bf7b503-8f5b-4fa6-8815-d006778efe7d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:23 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-53a4a8c9-953d-4605-9943-56291a9101eb tempest-CreateVolumesFromImageTest-1149543286 None] Acquiring lock "cinder-quobyte-8bf7b503-8f5b-4fa6-8815-d006778efe7d" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:23 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-53a4a8c9-953d-4605-9943-56291a9101eb tempest-CreateVolumesFromImageTest-1149543286 None] Lock "cinder-quobyte-8bf7b503-8f5b-4fa6-8815-d006778efe7d" acquired by "delete_volume" :: waited 0.026s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:23 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d0e2cb-ab03-41bf-ab87-4563122fcd35]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:31:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-53a4a8c9-953d-4605-9943-56291a9101eb tempest-CreateVolumesFromImageTest-1149543286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8bf7b503-8f5b-4fa6-8815-d006778efe7d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:23 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8bf7b503-8f5b-4fa6-8815-d006778efe7d Aug 31 15:31:23 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:23 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f8e4949d-ad41-46c0-88a3-a010efff9c88 tempest-VolumeDependencyTests-289667774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1.6ac087c1-dd1d-4c8d-9707-8f16fbd2c060 1G" returned: 0 in 0.610s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f8e4949d-ad41-46c0-88a3-a010efff9c88 tempest-VolumeDependencyTests-289667774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8030fa77-ccec-4fb8-b962-a640a57f50f1 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1.6ac087c1-dd1d-4c8d-9707-8f16fbd2c060 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:23 devstack sudo[105524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8030fa77-ccec-4fb8-b962-a640a57f50f1 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1.6ac087c1-dd1d-4c8d-9707-8f16fbd2c060 Aug 31 15:31:23 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:23 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-53a4a8c9-953d-4605-9943-56291a9101eb tempest-CreateVolumesFromImageTest-1149543286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8bf7b503-8f5b-4fa6-8815-d006778efe7d" returned: 0 in 0.509s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-53a4a8c9-953d-4605-9943-56291a9101eb tempest-CreateVolumesFromImageTest-1149543286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8bf7b503-8f5b-4fa6-8815-d006778efe7d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:23 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8bf7b503-8f5b-4fa6-8815-d006778efe7d Aug 31 15:31:23 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:23 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f8e4949d-ad41-46c0-88a3-a010efff9c88 tempest-VolumeDependencyTests-289667774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8030fa77-ccec-4fb8-b962-a640a57f50f1 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1.6ac087c1-dd1d-4c8d-9707-8f16fbd2c060" returned: 0 in 0.397s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:23 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-f8e4949d-ad41-46c0-88a3-a010efff9c88 tempest-VolumeDependencyTests-289667774 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1.6ac087c1-dd1d-4c8d-9707-8f16fbd2c060 is being set with open permissions: ugo+rw Aug 31 15:31:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f8e4949d-ad41-46c0-88a3-a010efff9c88 tempest-VolumeDependencyTests-289667774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1.6ac087c1-dd1d-4c8d-9707-8f16fbd2c060 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:24 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1.6ac087c1-dd1d-4c8d-9707-8f16fbd2c060 Aug 31 15:31:24 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:24 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-53a4a8c9-953d-4605-9943-56291a9101eb tempest-CreateVolumesFromImageTest-1149543286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8bf7b503-8f5b-4fa6-8815-d006778efe7d" returned: 0 in 0.390s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:24 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-53a4a8c9-953d-4605-9943-56291a9101eb tempest-CreateVolumesFromImageTest-1149543286 None] Lock "cinder-quobyte-8bf7b503-8f5b-4fa6-8815-d006778efe7d" released by "delete_volume" :: held 0.966s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:24 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-53a4a8c9-953d-4605-9943-56291a9101eb tempest-CreateVolumesFromImageTest-1149543286 None] Created reservations ['fc03c6b7-7dfd-452a-853b-6ecc1159430c', '09014622-7bd5-4810-aa6d-1256dc0c7d9e', '27036187-f175-4eff-bc7e-00a471bf721b', 'd632395c-039b-492d-8580-2d57047b64d0'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:31:24 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f8e4949d-ad41-46c0-88a3-a010efff9c88 tempest-VolumeDependencyTests-289667774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1.6ac087c1-dd1d-4c8d-9707-8f16fbd2c060" returned: 0 in 0.332s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f8e4949d-ad41-46c0-88a3-a010efff9c88 tempest-VolumeDependencyTests-289667774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-53a4a8c9-953d-4605-9943-56291a9101eb tempest-CreateVolumesFromImageTest-1149543286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-53a4a8c9-953d-4605-9943-56291a9101eb tempest-CreateVolumesFromImageTest-1149543286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:24 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-53a4a8c9-953d-4605-9943-56291a9101eb tempest-CreateVolumesFromImageTest-1149543286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:31:24 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-53a4a8c9-953d-4605-9943-56291a9101eb tempest-CreateVolumesFromImageTest-1149543286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:31:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-53a4a8c9-953d-4605-9943-56291a9101eb tempest-CreateVolumesFromImageTest-1149543286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-53a4a8c9-953d-4605-9943-56291a9101eb tempest-CreateVolumesFromImageTest-1149543286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:24 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1.info Aug 31 15:31:24 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:24 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:31:24 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:24 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:24 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f8e4949d-ad41-46c0-88a3-a010efff9c88 tempest-VolumeDependencyTests-289667774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1.info" returned: 0 in 0.276s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:24 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-f8e4949d-ad41-46c0-88a3-a010efff9c88 tempest-VolumeDependencyTests-289667774 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1.info is being set with open permissions: ugo+rw Aug 31 15:31:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f8e4949d-ad41-46c0-88a3-a010efff9c88 tempest-VolumeDependencyTests-289667774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-53a4a8c9-953d-4605-9943-56291a9101eb tempest-CreateVolumesFromImageTest-1149543286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.262s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:24 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-53a4a8c9-953d-4605-9943-56291a9101eb tempest-CreateVolumesFromImageTest-1149543286 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:31:24 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1.info Aug 31 15:31:24 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-53a4a8c9-953d-4605-9943-56291a9101eb tempest-CreateVolumesFromImageTest-1149543286 None] Deleted volume successfully. Aug 31 15:31:24 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:24 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-53a4a8c9-953d-4605-9943-56291a9101eb tempest-CreateVolumesFromImageTest-1149543286 None] Lock "cinder-8bf7b503-8f5b-4fa6-8815-d006778efe7d-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:24 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f8e4949d-ad41-46c0-88a3-a010efff9c88 tempest-VolumeDependencyTests-289667774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1.info" returned: 0 in 0.267s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f8e4949d-ad41-46c0-88a3-a010efff9c88 tempest-VolumeDependencyTests-289667774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.436s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:24 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-f8e4949d-ad41-46c0-88a3-a010efff9c88 tempest-VolumeDependencyTests-289667774 None] Create snapshot completed successfully Aug 31 15:31:25 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-d5f115b1-8118-45e5-a6ad-42784b83c2a3 tempest-CreateVolumesFromImageTest-1149543286 None] Acquiring lock "cinder-f23173a3-b755-4416-ae01-d06cb2bc9d06-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:25 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-d5f115b1-8118-45e5-a6ad-42784b83c2a3 tempest-CreateVolumesFromImageTest-1149543286 None] Lock "cinder-f23173a3-b755-4416-ae01-d06cb2bc9d06-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:25 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-d5f115b1-8118-45e5-a6ad-42784b83c2a3 tempest-CreateVolumesFromImageTest-1149543286 None] Acquiring lock "cinder-quobyte-f23173a3-b755-4416-ae01-d06cb2bc9d06" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:25 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-d5f115b1-8118-45e5-a6ad-42784b83c2a3 tempest-CreateVolumesFromImageTest-1149543286 None] Lock "cinder-quobyte-f23173a3-b755-4416-ae01-d06cb2bc9d06" acquired by "delete_volume" :: waited 0.024s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:25 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[70803afe-b0b1-4c5b-88a9-9244798a55c0]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:31:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d5f115b1-8118-45e5-a6ad-42784b83c2a3 tempest-CreateVolumesFromImageTest-1149543286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f23173a3-b755-4416-ae01-d06cb2bc9d06 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:25 devstack sudo[105547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f23173a3-b755-4416-ae01-d06cb2bc9d06 Aug 31 15:31:25 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:26 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d5f115b1-8118-45e5-a6ad-42784b83c2a3 tempest-CreateVolumesFromImageTest-1149543286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f23173a3-b755-4416-ae01-d06cb2bc9d06" returned: 0 in 0.464s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d5f115b1-8118-45e5-a6ad-42784b83c2a3 tempest-CreateVolumesFromImageTest-1149543286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f23173a3-b755-4416-ae01-d06cb2bc9d06 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:26 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f23173a3-b755-4416-ae01-d06cb2bc9d06 Aug 31 15:31:26 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:26 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d5f115b1-8118-45e5-a6ad-42784b83c2a3 tempest-CreateVolumesFromImageTest-1149543286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-f23173a3-b755-4416-ae01-d06cb2bc9d06" returned: 0 in 0.428s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:26 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-d5f115b1-8118-45e5-a6ad-42784b83c2a3 tempest-CreateVolumesFromImageTest-1149543286 None] Lock "cinder-quobyte-f23173a3-b755-4416-ae01-d06cb2bc9d06" released by "delete_volume" :: held 0.936s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:26 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:31:26 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Flow 'volume_create_manager' (d0d00bd3-cfb1-4d13-987d-5c8e72fad0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:31:26 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (157af63c-f069-4254-a8f2-8d4bc7ae0c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:26 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (157af63c-f069-4254-a8f2-8d4bc7ae0c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:31:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-846455688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cab274a1-d223-4c02-b127-2aa0eb2325ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='429ab50b0dff4691adfe34e4f30133ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:31:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6ac087c1-dd1d-4c8d-9707-8f16fbd2c060,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:31:26Z,use_quota=True,user_id='a0350ea6f95e455d9021444d3dc9d97e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:26 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58dc25cc-41ea-4528-b3ff-61fcd0e04a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:26 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58dc25cc-41ea-4528-b3ff-61fcd0e04a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:26 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fb2a6b7-5c95-4460-8a6a-7f0784ed808c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:26 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fb2a6b7-5c95-4460-8a6a-7f0784ed808c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cab274a1-d223-4c02-b127-2aa0eb2325ea', 'volume_name': 'volume-cab274a1-d223-4c02-b127-2aa0eb2325ea', 'volume_size': 1, 'snapshot_id': '6ac087c1-dd1d-4c8d-9707-8f16fbd2c060'}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:26 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc0b8438-6db1-4c38-902c-5164f457acfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:26 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc0b8438-6db1-4c38-902c-5164f457acfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:26 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83fc0cf0-f577-4a64-80ba-6568f7ea3e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:26 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Volume cab274a1-d223-4c02-b127-2aa0eb2325ea: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cab274a1-d223-4c02-b127-2aa0eb2325ea', 'volume_size': 1, 'snapshot_id': '6ac087c1-dd1d-4c8d-9707-8f16fbd2c060'} Aug 31 15:31:26 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-d5f115b1-8118-45e5-a6ad-42784b83c2a3 tempest-CreateVolumesFromImageTest-1149543286 None] Created reservations ['a996291f-c2d8-4a49-a044-a916495539f0', '65239926-fc4d-4fba-9a76-7c52f22c7766', '10046e3c-44a1-4ede-a2da-c86495e0599a', 'e9156139-c51c-48b7-b6bc-c4993d41b775'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:31:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:26 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Acquiring lock "cinder-quobyte-6ac087c1-dd1d-4c8d-9707-8f16fbd2c060-cab274a1-d223-4c02-b127-2aa0eb2325ea" by "_create_volume_from_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:26 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Lock "cinder-quobyte-6ac087c1-dd1d-4c8d-9707-8f16fbd2c060-cab274a1-d223-4c02-b127-2aa0eb2325ea" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:26 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Creating volume cab274a1-d223-4c02-b127-2aa0eb2325ea from snapshot 6ac087c1-dd1d-4c8d-9707-8f16fbd2c060 {{(pid=86000) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 31 15:31:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:26 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:31:26 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:31:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:26 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:31:26 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Acquiring lock "cinder-quobyte-cab274a1-d223-4c02-b127-2aa0eb2325ea" by "_copy_volume_from_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:26 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Lock "cinder-quobyte-cab274a1-d223-4c02-b127-2aa0eb2325ea" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:26 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] snapshot: 6ac087c1-dd1d-4c8d-9707-8f16fbd2c060, volume: cab274a1-d223-4c02-b127-2aa0eb2325ea, {{(pid=86000) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 31 15:31:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:26 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:31:26 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:31:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:26 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[477d8d52-29e4-4580-87bf-90e667bdd916]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:31:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1.6ac087c1-dd1d-4c8d-9707-8f16fbd2c060 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-d5f115b1-8118-45e5-a6ad-42784b83c2a3 tempest-CreateVolumesFromImageTest-1149543286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-d5f115b1-8118-45e5-a6ad-42784b83c2a3 tempest-CreateVolumesFromImageTest-1149543286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:26 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-d5f115b1-8118-45e5-a6ad-42784b83c2a3 tempest-CreateVolumesFromImageTest-1149543286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:31:26 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-d5f115b1-8118-45e5-a6ad-42784b83c2a3 tempest-CreateVolumesFromImageTest-1149543286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:31:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-d5f115b1-8118-45e5-a6ad-42784b83c2a3 tempest-CreateVolumesFromImageTest-1149543286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d5f115b1-8118-45e5-a6ad-42784b83c2a3 tempest-CreateVolumesFromImageTest-1149543286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:26 devstack sudo[105557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:31:26 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:26 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1.6ac087c1-dd1d-4c8d-9707-8f16fbd2c060 Aug 31 15:31:26 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:27 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d5f115b1-8118-45e5-a6ad-42784b83c2a3 tempest-CreateVolumesFromImageTest-1149543286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.333s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:27 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-d5f115b1-8118-45e5-a6ad-42784b83c2a3 tempest-CreateVolumesFromImageTest-1149543286 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:31:27 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-d5f115b1-8118-45e5-a6ad-42784b83c2a3 tempest-CreateVolumesFromImageTest-1149543286 None] Deleted volume successfully. Aug 31 15:31:27 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-d5f115b1-8118-45e5-a6ad-42784b83c2a3 tempest-CreateVolumesFromImageTest-1149543286 None] Lock "cinder-f23173a3-b755-4416-ae01-d06cb2bc9d06-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:27 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1.6ac087c1-dd1d-4c8d-9707-8f16fbd2c060" returned: 0 in 0.470s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:27 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8030fa77-ccec-4fb8-b962-a640a57f50f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:31:27 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfbec9f-659e-4225-b990-144c917a7ebb]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:31:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:27 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1 Aug 31 15:31:27 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:27 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1" returned: 0 in 0.451s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:27 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1 {{(pid=86000) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 31 15:31:27 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Creating direct copy from snapshot {{(pid=86000) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 31 15:31:27 devstack cinder-volume[86000]: DEBUG cinder.utils [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Path /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-cab274a1-d223-4c02-b127-2aa0eb2325ea not found in is_blk_device check {{(pid=86000) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 31 15:31:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-cab274a1-d223-4c02-b127-2aa0eb2325ea {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:27 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-3c1a7ad0-cea5-45cc-9705-8370ea7a3eb1 tempest-CreateVolumesFromImageTest-1149543286 None] Acquiring lock "cinder-596cf5f6-51a0-4369-b473-c661b89fb171-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:27 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-cab274a1-d223-4c02-b127-2aa0eb2325ea Aug 31 15:31:27 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:27 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-3c1a7ad0-cea5-45cc-9705-8370ea7a3eb1 tempest-CreateVolumesFromImageTest-1149543286 None] Lock "cinder-596cf5f6-51a0-4369-b473-c661b89fb171-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:27 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-3c1a7ad0-cea5-45cc-9705-8370ea7a3eb1 tempest-CreateVolumesFromImageTest-1149543286 None] Acquiring lock "cinder-quobyte-596cf5f6-51a0-4369-b473-c661b89fb171" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:27 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-3c1a7ad0-cea5-45cc-9705-8370ea7a3eb1 tempest-CreateVolumesFromImageTest-1149543286 None] Lock "cinder-quobyte-596cf5f6-51a0-4369-b473-c661b89fb171" acquired by "delete_volume" :: waited 0.027s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:27 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[40190e6b-c354-40c7-8228-244ff592b8cc]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:31:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-3c1a7ad0-cea5-45cc-9705-8370ea7a3eb1 tempest-CreateVolumesFromImageTest-1149543286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-596cf5f6-51a0-4369-b473-c661b89fb171 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:28 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-596cf5f6-51a0-4369-b473-c661b89fb171 Aug 31 15:31:28 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:28 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-3c1a7ad0-cea5-45cc-9705-8370ea7a3eb1 tempest-CreateVolumesFromImageTest-1149543286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-596cf5f6-51a0-4369-b473-c661b89fb171" returned: 0 in 0.680s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-3c1a7ad0-cea5-45cc-9705-8370ea7a3eb1 tempest-CreateVolumesFromImageTest-1149543286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-596cf5f6-51a0-4369-b473-c661b89fb171 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:28 devstack sudo[105616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-596cf5f6-51a0-4369-b473-c661b89fb171 Aug 31 15:31:28 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:29 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-3c1a7ad0-cea5-45cc-9705-8370ea7a3eb1 tempest-CreateVolumesFromImageTest-1149543286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-596cf5f6-51a0-4369-b473-c661b89fb171" returned: 0 in 0.583s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:29 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-3c1a7ad0-cea5-45cc-9705-8370ea7a3eb1 tempest-CreateVolumesFromImageTest-1149543286 None] Lock "cinder-quobyte-596cf5f6-51a0-4369-b473-c661b89fb171" released by "delete_volume" :: held 1.357s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:29 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-3c1a7ad0-cea5-45cc-9705-8370ea7a3eb1 tempest-CreateVolumesFromImageTest-1149543286 None] Created reservations ['008e9c2e-8acc-4fc2-8f8a-03309624ebcd', '6f2124d7-ebe4-4997-ac85-ddaca439f4b6', '5e198971-2968-4f03-8455-b39d8066fb38', '07992125-439f-4910-863b-f8f5105a912e'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:31:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-3c1a7ad0-cea5-45cc-9705-8370ea7a3eb1 tempest-CreateVolumesFromImageTest-1149543286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-3c1a7ad0-cea5-45cc-9705-8370ea7a3eb1 tempest-CreateVolumesFromImageTest-1149543286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:29 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-3c1a7ad0-cea5-45cc-9705-8370ea7a3eb1 tempest-CreateVolumesFromImageTest-1149543286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:31:29 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-3c1a7ad0-cea5-45cc-9705-8370ea7a3eb1 tempest-CreateVolumesFromImageTest-1149543286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:31:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-3c1a7ad0-cea5-45cc-9705-8370ea7a3eb1 tempest-CreateVolumesFromImageTest-1149543286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-3c1a7ad0-cea5-45cc-9705-8370ea7a3eb1 tempest-CreateVolumesFromImageTest-1149543286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:29 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:31:29 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:30 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-3c1a7ad0-cea5-45cc-9705-8370ea7a3eb1 tempest-CreateVolumesFromImageTest-1149543286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.767s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:30 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-3c1a7ad0-cea5-45cc-9705-8370ea7a3eb1 tempest-CreateVolumesFromImageTest-1149543286 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:31:30 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-3c1a7ad0-cea5-45cc-9705-8370ea7a3eb1 tempest-CreateVolumesFromImageTest-1149543286 None] Deleted volume successfully. Aug 31 15:31:30 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-cb81810a-9b2f-4d2a-9163-d594fc1ae082 tempest-CreateVolumesFromImageTest-1149543286 None] Acquiring lock "cinder-1734f9e2-0604-4cba-a78e-4e2bb8b9d332-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:30 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-3c1a7ad0-cea5-45cc-9705-8370ea7a3eb1 tempest-CreateVolumesFromImageTest-1149543286 None] Lock "cinder-596cf5f6-51a0-4369-b473-c661b89fb171-delete_volume" released by "delete_volume" :: held 2.614s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:30 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-cb81810a-9b2f-4d2a-9163-d594fc1ae082 tempest-CreateVolumesFromImageTest-1149543286 None] Lock "cinder-1734f9e2-0604-4cba-a78e-4e2bb8b9d332-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:30 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-cb81810a-9b2f-4d2a-9163-d594fc1ae082 tempest-CreateVolumesFromImageTest-1149543286 None] Acquiring lock "cinder-quobyte-1734f9e2-0604-4cba-a78e-4e2bb8b9d332" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:30 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-cb81810a-9b2f-4d2a-9163-d594fc1ae082 tempest-CreateVolumesFromImageTest-1149543286 None] Lock "cinder-quobyte-1734f9e2-0604-4cba-a78e-4e2bb8b9d332" acquired by "delete_volume" :: waited 0.051s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:30 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e04a359-6df6-4fc3-8352-b5a0af329b51]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:31:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cb81810a-9b2f-4d2a-9163-d594fc1ae082 tempest-CreateVolumesFromImageTest-1149543286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1734f9e2-0604-4cba-a78e-4e2bb8b9d332 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:30 devstack sudo[105629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1734f9e2-0604-4cba-a78e-4e2bb8b9d332 Aug 31 15:31:30 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:31 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cb81810a-9b2f-4d2a-9163-d594fc1ae082 tempest-CreateVolumesFromImageTest-1149543286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1734f9e2-0604-4cba-a78e-4e2bb8b9d332" returned: 0 in 1.016s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cb81810a-9b2f-4d2a-9163-d594fc1ae082 tempest-CreateVolumesFromImageTest-1149543286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1734f9e2-0604-4cba-a78e-4e2bb8b9d332 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:31 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1734f9e2-0604-4cba-a78e-4e2bb8b9d332 Aug 31 15:31:31 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:32 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cb81810a-9b2f-4d2a-9163-d594fc1ae082 tempest-CreateVolumesFromImageTest-1149543286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1734f9e2-0604-4cba-a78e-4e2bb8b9d332" returned: 0 in 0.589s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:32 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-cb81810a-9b2f-4d2a-9163-d594fc1ae082 tempest-CreateVolumesFromImageTest-1149543286 None] Lock "cinder-quobyte-1734f9e2-0604-4cba-a78e-4e2bb8b9d332" released by "delete_volume" :: held 1.744s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:32 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-cb81810a-9b2f-4d2a-9163-d594fc1ae082 tempest-CreateVolumesFromImageTest-1149543286 None] Created reservations ['b90f721f-ebb8-436c-bb86-709a60762dcc', 'a906dbdc-a47d-4322-ab0a-c150a3d086e0', '2405934d-42af-4a6c-b3fd-efb3b2233c17', '75735726-9c5b-4b7c-ae59-022d875163e6'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:31:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-cb81810a-9b2f-4d2a-9163-d594fc1ae082 tempest-CreateVolumesFromImageTest-1149543286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-cb81810a-9b2f-4d2a-9163-d594fc1ae082 tempest-CreateVolumesFromImageTest-1149543286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:32 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-cb81810a-9b2f-4d2a-9163-d594fc1ae082 tempest-CreateVolumesFromImageTest-1149543286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:31:32 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-cb81810a-9b2f-4d2a-9163-d594fc1ae082 tempest-CreateVolumesFromImageTest-1149543286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:31:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-cb81810a-9b2f-4d2a-9163-d594fc1ae082 tempest-CreateVolumesFromImageTest-1149543286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cb81810a-9b2f-4d2a-9163-d594fc1ae082 tempest-CreateVolumesFromImageTest-1149543286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:32 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:31:32 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:33 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-bc1cc3cc-104a-4353-8395-4d3b84ae5814 tempest-CreateVolumesFromImageTest-1149543286 None] Acquiring lock "cinder-8fe4bb19-86f9-405a-9714-f5903bc93720-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:33 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-bc1cc3cc-104a-4353-8395-4d3b84ae5814 tempest-CreateVolumesFromImageTest-1149543286 None] Lock "cinder-8fe4bb19-86f9-405a-9714-f5903bc93720-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:33 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-bc1cc3cc-104a-4353-8395-4d3b84ae5814 tempest-CreateVolumesFromImageTest-1149543286 None] Acquiring lock "cinder-quobyte-8fe4bb19-86f9-405a-9714-f5903bc93720" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:33 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-bc1cc3cc-104a-4353-8395-4d3b84ae5814 tempest-CreateVolumesFromImageTest-1149543286 None] Lock "cinder-quobyte-8fe4bb19-86f9-405a-9714-f5903bc93720" acquired by "delete_volume" :: waited 0.047s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:33 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc61e0e-67a9-453a-aadb-8c4ce149a082]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:31:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bc1cc3cc-104a-4353-8395-4d3b84ae5814 tempest-CreateVolumesFromImageTest-1149543286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8fe4bb19-86f9-405a-9714-f5903bc93720 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:33 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cb81810a-9b2f-4d2a-9163-d594fc1ae082 tempest-CreateVolumesFromImageTest-1149543286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.880s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:33 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-cb81810a-9b2f-4d2a-9163-d594fc1ae082 tempest-CreateVolumesFromImageTest-1149543286 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:31:33 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-cb81810a-9b2f-4d2a-9163-d594fc1ae082 tempest-CreateVolumesFromImageTest-1149543286 None] Deleted volume successfully. Aug 31 15:31:33 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8fe4bb19-86f9-405a-9714-f5903bc93720 Aug 31 15:31:33 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:33 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-cb81810a-9b2f-4d2a-9163-d594fc1ae082 tempest-CreateVolumesFromImageTest-1149543286 None] Lock "cinder-1734f9e2-0604-4cba-a78e-4e2bb8b9d332-delete_volume" released by "delete_volume" :: held 3.386s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:34 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bc1cc3cc-104a-4353-8395-4d3b84ae5814 tempest-CreateVolumesFromImageTest-1149543286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8fe4bb19-86f9-405a-9714-f5903bc93720" returned: 0 in 1.119s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bc1cc3cc-104a-4353-8395-4d3b84ae5814 tempest-CreateVolumesFromImageTest-1149543286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8fe4bb19-86f9-405a-9714-f5903bc93720 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:34 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8fe4bb19-86f9-405a-9714-f5903bc93720 Aug 31 15:31:34 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:34 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-cab274a1-d223-4c02-b127-2aa0eb2325ea" returned: 0 in 7.157s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:34 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1, size 1024.00 MB, duration 7.16 sec, destination /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-cab274a1-d223-4c02-b127-2aa0eb2325ea {{(pid=86000) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 31 15:31:34 devstack cinder-volume[86000]: INFO cinder.image.image_utils [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Converted 1024.00 MB image at 143.06 MB/s Aug 31 15:31:34 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-cab274a1-d223-4c02-b127-2aa0eb2325ea is being set with open permissions: ugo+rw Aug 31 15:31:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-cab274a1-d223-4c02-b127-2aa0eb2325ea {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:34 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-cab274a1-d223-4c02-b127-2aa0eb2325ea Aug 31 15:31:34 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:35 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bc1cc3cc-104a-4353-8395-4d3b84ae5814 tempest-CreateVolumesFromImageTest-1149543286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8fe4bb19-86f9-405a-9714-f5903bc93720" returned: 0 in 0.454s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:35 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-bc1cc3cc-104a-4353-8395-4d3b84ae5814 tempest-CreateVolumesFromImageTest-1149543286 None] Lock "cinder-quobyte-8fe4bb19-86f9-405a-9714-f5903bc93720" released by "delete_volume" :: held 1.692s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:35 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-bc1cc3cc-104a-4353-8395-4d3b84ae5814 tempest-CreateVolumesFromImageTest-1149543286 None] Created reservations ['d333ea7d-fca3-4607-a858-2c7eb1655a27', '35f90396-e878-479c-9955-fdfec3afe163', '8a5b96ff-a097-4c95-9d0a-556bdbf70e88', '54e247eb-5e8d-4e5c-9662-fb5f261a84ff'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:31:35 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-cab274a1-d223-4c02-b127-2aa0eb2325ea" returned: 0 in 0.372s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bc1cc3cc-104a-4353-8395-4d3b84ae5814 tempest-CreateVolumesFromImageTest-1149543286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bc1cc3cc-104a-4353-8395-4d3b84ae5814 tempest-CreateVolumesFromImageTest-1149543286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:35 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-bc1cc3cc-104a-4353-8395-4d3b84ae5814 tempest-CreateVolumesFromImageTest-1149543286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:31:35 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-bc1cc3cc-104a-4353-8395-4d3b84ae5814 tempest-CreateVolumesFromImageTest-1149543286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:31:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bc1cc3cc-104a-4353-8395-4d3b84ae5814 tempest-CreateVolumesFromImageTest-1149543286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bc1cc3cc-104a-4353-8395-4d3b84ae5814 tempest-CreateVolumesFromImageTest-1149543286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:35 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Lock "cinder-quobyte-cab274a1-d223-4c02-b127-2aa0eb2325ea" released by "_copy_volume_from_snapshot" :: held 8.578s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:35 devstack sudo[105653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:31:35 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:35 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Lock "cinder-quobyte-6ac087c1-dd1d-4c8d-9707-8f16fbd2c060-cab274a1-d223-4c02-b127-2aa0eb2325ea" released by "_create_volume_from_snapshot" :: held 8.684s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.711s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83fc0cf0-f577-4a64-80ba-6568f7ea3e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cab274a1-d223-4c02-b127-2aa0eb2325ea', 'volume_size': 1, 'snapshot_id': '6ac087c1-dd1d-4c8d-9707-8f16fbd2c060'}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95c3f137-80b3-45df-826c-1f8167fc3281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:35 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Volume volume-cab274a1-d223-4c02-b127-2aa0eb2325ea (cab274a1-d223-4c02-b127-2aa0eb2325ea): created successfully Aug 31 15:31:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95c3f137-80b3-45df-826c-1f8167fc3281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:35 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Flow 'volume_create_manager' (d0d00bd3-cfb1-4d13-987d-5c8e72fad0f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:31:35 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-035f6864-b63f-487f-8e42-be7dba68f750 tempest-VolumeDependencyTests-289667774 None] Created volume successfully. Aug 31 15:31:35 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-74cda47a-7606-4201-ac32-e60406dcda03 tempest-VolumeDependencyTests-289667774 None] Acquiring lock "cinder-6ac087c1-dd1d-4c8d-9707-8f16fbd2c060-delete_snapshot" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:35 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bc1cc3cc-104a-4353-8395-4d3b84ae5814 tempest-CreateVolumesFromImageTest-1149543286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.407s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:35 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-bc1cc3cc-104a-4353-8395-4d3b84ae5814 tempest-CreateVolumesFromImageTest-1149543286 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:31:35 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-bc1cc3cc-104a-4353-8395-4d3b84ae5814 tempest-CreateVolumesFromImageTest-1149543286 None] Deleted volume successfully. Aug 31 15:31:35 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-74cda47a-7606-4201-ac32-e60406dcda03 tempest-VolumeDependencyTests-289667774 None] Lock "cinder-6ac087c1-dd1d-4c8d-9707-8f16fbd2c060-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:35 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-74cda47a-7606-4201-ac32-e60406dcda03 tempest-VolumeDependencyTests-289667774 None] Acquiring lock "cinder-quobyte-8030fa77-ccec-4fb8-b962-a640a57f50f1" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:35 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-bc1cc3cc-104a-4353-8395-4d3b84ae5814 tempest-CreateVolumesFromImageTest-1149543286 None] Lock "cinder-8fe4bb19-86f9-405a-9714-f5903bc93720-delete_volume" released by "delete_volume" :: held 2.542s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:35 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-74cda47a-7606-4201-ac32-e60406dcda03 tempest-VolumeDependencyTests-289667774 None] Lock "cinder-quobyte-8030fa77-ccec-4fb8-b962-a640a57f50f1" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:35 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-74cda47a-7606-4201-ac32-e60406dcda03 tempest-VolumeDependencyTests-289667774 None] Acquiring lock "cinder-quobyte-6ac087c1-dd1d-4c8d-9707-8f16fbd2c060" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:35 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-74cda47a-7606-4201-ac32-e60406dcda03 tempest-VolumeDependencyTests-289667774 None] Lock "cinder-quobyte-6ac087c1-dd1d-4c8d-9707-8f16fbd2c060" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:35 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-74cda47a-7606-4201-ac32-e60406dcda03 tempest-VolumeDependencyTests-289667774 None] Deleting offline snapshot 6ac087c1-dd1d-4c8d-9707-8f16fbd2c060 of volume 8030fa77-ccec-4fb8-b962-a640a57f50f1 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:31:35 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-74cda47a-7606-4201-ac32-e60406dcda03 tempest-VolumeDependencyTests-289667774 None] snapshot_file for this snap is: volume-8030fa77-ccec-4fb8-b962-a640a57f50f1.6ac087c1-dd1d-4c8d-9707-8f16fbd2c060 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:31:35 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1bd7dd4-e7f0-4cfc-8603-10f042602db6]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:31:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-74cda47a-7606-4201-ac32-e60406dcda03 tempest-VolumeDependencyTests-289667774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1.6ac087c1-dd1d-4c8d-9707-8f16fbd2c060 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:35 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1.6ac087c1-dd1d-4c8d-9707-8f16fbd2c060 Aug 31 15:31:35 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:36 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-74cda47a-7606-4201-ac32-e60406dcda03 tempest-VolumeDependencyTests-289667774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1.6ac087c1-dd1d-4c8d-9707-8f16fbd2c060" returned: 0 in 0.524s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:36 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-74cda47a-7606-4201-ac32-e60406dcda03 tempest-VolumeDependencyTests-289667774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8030fa77-ccec-4fb8-b962-a640a57f50f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:31:36 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[90101929-2821-4535-be62-134413abf553]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:31:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-74cda47a-7606-4201-ac32-e60406dcda03 tempest-VolumeDependencyTests-289667774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:36 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1 Aug 31 15:31:36 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:37 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-74cda47a-7606-4201-ac32-e60406dcda03 tempest-VolumeDependencyTests-289667774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1" returned: 0 in 0.730s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-74cda47a-7606-4201-ac32-e60406dcda03 tempest-VolumeDependencyTests-289667774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1.6ac087c1-dd1d-4c8d-9707-8f16fbd2c060 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:37 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1.6ac087c1-dd1d-4c8d-9707-8f16fbd2c060 Aug 31 15:31:37 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:37 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-74cda47a-7606-4201-ac32-e60406dcda03 tempest-VolumeDependencyTests-289667774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1.6ac087c1-dd1d-4c8d-9707-8f16fbd2c060" returned: 0 in 0.474s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-74cda47a-7606-4201-ac32-e60406dcda03 tempest-VolumeDependencyTests-289667774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1.6ac087c1-dd1d-4c8d-9707-8f16fbd2c060 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:37 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1.6ac087c1-dd1d-4c8d-9707-8f16fbd2c060 Aug 31 15:31:37 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:37 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-74cda47a-7606-4201-ac32-e60406dcda03 tempest-VolumeDependencyTests-289667774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1.6ac087c1-dd1d-4c8d-9707-8f16fbd2c060" returned: 0 in 0.327s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:37 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-74cda47a-7606-4201-ac32-e60406dcda03 tempest-VolumeDependencyTests-289667774 None] Lock "cinder-quobyte-6ac087c1-dd1d-4c8d-9707-8f16fbd2c060" released by "_delete_snapshot" :: held 2.209s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:37 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-74cda47a-7606-4201-ac32-e60406dcda03 tempest-VolumeDependencyTests-289667774 None] Lock "cinder-quobyte-8030fa77-ccec-4fb8-b962-a640a57f50f1" released by "delete_snapshot" :: held 2.250s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:38 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-74cda47a-7606-4201-ac32-e60406dcda03 tempest-VolumeDependencyTests-289667774 None] Created reservations ['b52c31cf-3d34-4f97-9b6e-3344af874f47', '49a5528a-325b-4059-b74e-d2d2b89a383b', 'b4ffcc13-1887-4337-9d20-a50630b3bff8', '6538148f-2e22-416e-a528-a02088353bb6'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:31:38 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-74cda47a-7606-4201-ac32-e60406dcda03 tempest-VolumeDependencyTests-289667774 None] Delete snapshot completed successfully. Aug 31 15:31:38 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-74cda47a-7606-4201-ac32-e60406dcda03 tempest-VolumeDependencyTests-289667774 None] Lock "cinder-6ac087c1-dd1d-4c8d-9707-8f16fbd2c060-delete_snapshot" released by "delete_snapshot" :: held 2.479s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:38 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-2643e7e1-38fb-4551-9006-ad2f8074c6fd tempest-ProjectReaderTests-1343788438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:31:38 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-2643e7e1-38fb-4551-9006-ad2f8074c6fd tempest-ProjectReaderTests-1343788438 None] Flow 'volume_create_manager' (a93c6b3b-f36b-4989-b893-72a98925fdfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:31:38 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-2643e7e1-38fb-4551-9006-ad2f8074c6fd tempest-ProjectReaderTests-1343788438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36eb7011-db73-404b-b4de-845e0487644e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:38 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-2643e7e1-38fb-4551-9006-ad2f8074c6fd tempest-ProjectReaderTests-1343788438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36eb7011-db73-404b-b4de-845e0487644e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-899833291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4697d7f4-58b1-4bbe-b3ff-030c3e650f06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='727aea03969b48f99f2b76da7b059b11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:31:39Z,use_quota=True,user_id='67c71e8220614070ace8f23b446730f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:38 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-2643e7e1-38fb-4551-9006-ad2f8074c6fd tempest-ProjectReaderTests-1343788438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b9823bc-68ae-4f26-a77f-03fb4547de5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:38 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-2643e7e1-38fb-4551-9006-ad2f8074c6fd tempest-ProjectReaderTests-1343788438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b9823bc-68ae-4f26-a77f-03fb4547de5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:38 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-2643e7e1-38fb-4551-9006-ad2f8074c6fd tempest-ProjectReaderTests-1343788438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (774de0f6-374c-43f2-8b7f-7be60c5eea06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:38 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-2643e7e1-38fb-4551-9006-ad2f8074c6fd tempest-ProjectReaderTests-1343788438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (774de0f6-374c-43f2-8b7f-7be60c5eea06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4697d7f4-58b1-4bbe-b3ff-030c3e650f06', 'volume_name': 'volume-4697d7f4-58b1-4bbe-b3ff-030c3e650f06', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:38 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-2643e7e1-38fb-4551-9006-ad2f8074c6fd tempest-ProjectReaderTests-1343788438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa16b1a4-c542-4f5f-91df-a60dd9397689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:38 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-2643e7e1-38fb-4551-9006-ad2f8074c6fd tempest-ProjectReaderTests-1343788438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa16b1a4-c542-4f5f-91df-a60dd9397689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:38 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-2643e7e1-38fb-4551-9006-ad2f8074c6fd tempest-ProjectReaderTests-1343788438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f359f66e-612e-4729-927f-057ac8df7108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:38 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-2643e7e1-38fb-4551-9006-ad2f8074c6fd tempest-ProjectReaderTests-1343788438 None] Volume 4697d7f4-58b1-4bbe-b3ff-030c3e650f06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4697d7f4-58b1-4bbe-b3ff-030c3e650f06', 'volume_size': 1} Aug 31 15:31:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-2643e7e1-38fb-4551-9006-ad2f8074c6fd tempest-ProjectReaderTests-1343788438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-2643e7e1-38fb-4551-9006-ad2f8074c6fd tempest-ProjectReaderTests-1343788438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:38 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-2643e7e1-38fb-4551-9006-ad2f8074c6fd tempest-ProjectReaderTests-1343788438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-899833291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4697d7f4-58b1-4bbe-b3ff-030c3e650f06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='727aea03969b48f99f2b76da7b059b11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:31:39Z,use_quota=True,user_id='67c71e8220614070ace8f23b446730f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:31:38 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-2643e7e1-38fb-4551-9006-ad2f8074c6fd tempest-ProjectReaderTests-1343788438 None] Creating volume 4697d7f4-58b1-4bbe-b3ff-030c3e650f06 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:31:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-2643e7e1-38fb-4551-9006-ad2f8074c6fd tempest-ProjectReaderTests-1343788438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-2643e7e1-38fb-4551-9006-ad2f8074c6fd tempest-ProjectReaderTests-1343788438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:38 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-2643e7e1-38fb-4551-9006-ad2f8074c6fd tempest-ProjectReaderTests-1343788438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:31:38 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-2643e7e1-38fb-4551-9006-ad2f8074c6fd tempest-ProjectReaderTests-1343788438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:31:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-2643e7e1-38fb-4551-9006-ad2f8074c6fd tempest-ProjectReaderTests-1343788438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:38 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-2643e7e1-38fb-4551-9006-ad2f8074c6fd tempest-ProjectReaderTests-1343788438 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:31:38 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-2643e7e1-38fb-4551-9006-ad2f8074c6fd tempest-ProjectReaderTests-1343788438 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:31:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2643e7e1-38fb-4551-9006-ad2f8074c6fd tempest-ProjectReaderTests-1343788438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4697d7f4-58b1-4bbe-b3ff-030c3e650f06 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:38 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4697d7f4-58b1-4bbe-b3ff-030c3e650f06 1073741824 Aug 31 15:31:38 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:38 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6ffdbeac-2024-479b-9402-c0174bef9979 tempest-VolumeDependencyTests-289667774 None] Acquiring lock "cinder-8030fa77-ccec-4fb8-b962-a640a57f50f1-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:39 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6ffdbeac-2024-479b-9402-c0174bef9979 tempest-VolumeDependencyTests-289667774 None] Lock "cinder-8030fa77-ccec-4fb8-b962-a640a57f50f1-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:39 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6ffdbeac-2024-479b-9402-c0174bef9979 tempest-VolumeDependencyTests-289667774 None] Acquiring lock "cinder-quobyte-8030fa77-ccec-4fb8-b962-a640a57f50f1" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:39 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6ffdbeac-2024-479b-9402-c0174bef9979 tempest-VolumeDependencyTests-289667774 None] Lock "cinder-quobyte-8030fa77-ccec-4fb8-b962-a640a57f50f1" acquired by "delete_volume" :: waited 0.019s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:39 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbab5c5-d6c8-4982-bbad-4dd6081e4e4d]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:31:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6ffdbeac-2024-479b-9402-c0174bef9979 tempest-VolumeDependencyTests-289667774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:39 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1 Aug 31 15:31:39 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:39 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2643e7e1-38fb-4551-9006-ad2f8074c6fd tempest-ProjectReaderTests-1343788438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4697d7f4-58b1-4bbe-b3ff-030c3e650f06 1073741824" returned: 0 in 0.631s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2643e7e1-38fb-4551-9006-ad2f8074c6fd tempest-ProjectReaderTests-1343788438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4697d7f4-58b1-4bbe-b3ff-030c3e650f06 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:39 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4697d7f4-58b1-4bbe-b3ff-030c3e650f06 Aug 31 15:31:39 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:39 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bff7cc7-a8fa-4a0c-8d06-27eaba0b9384 tempest-CreateVolumesFromSnapshotTest-342642120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:31:39 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:39 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6bff7cc7-a8fa-4a0c-8d06-27eaba0b9384 tempest-CreateVolumesFromSnapshotTest-342642120 None] Flow 'volume_create_manager' (7bef761f-10bb-4d82-b845-f4ec0b442a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:31:39 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6bff7cc7-a8fa-4a0c-8d06-27eaba0b9384 tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4d15eb7-5b8d-4d91-ad60-c41f1154aa28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6ffdbeac-2024-479b-9402-c0174bef9979 tempest-VolumeDependencyTests-289667774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1" returned: 0 in 0.600s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6ffdbeac-2024-479b-9402-c0174bef9979 tempest-VolumeDependencyTests-289667774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:39 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6bff7cc7-a8fa-4a0c-8d06-27eaba0b9384 tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4d15eb7-5b8d-4d91-ad60-c41f1154aa28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-8503203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afaddc4c-9e8b-4a84-a90e-766c4d6d6986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='681181ea10bc42a4a8ecd9bc15855ed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:31:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:31:40Z,use_quota=True,user_id='ff77725e71c0423a937998d14b23f737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:39 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1 Aug 31 15:31:39 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:39 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6bff7cc7-a8fa-4a0c-8d06-27eaba0b9384 tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6473ddc3-36c4-46dc-8bda-b787e453a345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:39 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6bff7cc7-a8fa-4a0c-8d06-27eaba0b9384 tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6473ddc3-36c4-46dc-8bda-b787e453a345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:39 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6bff7cc7-a8fa-4a0c-8d06-27eaba0b9384 tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf7298e2-c6ae-4451-bbbb-fbd6aa996f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:39 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6bff7cc7-a8fa-4a0c-8d06-27eaba0b9384 tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf7298e2-c6ae-4451-bbbb-fbd6aa996f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afaddc4c-9e8b-4a84-a90e-766c4d6d6986', 'volume_name': 'volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:39 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6bff7cc7-a8fa-4a0c-8d06-27eaba0b9384 tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f4691ae-9368-41b6-b65c-0e65dfb96b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:39 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6bff7cc7-a8fa-4a0c-8d06-27eaba0b9384 tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f4691ae-9368-41b6-b65c-0e65dfb96b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:39 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6bff7cc7-a8fa-4a0c-8d06-27eaba0b9384 tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97badee9-a140-4939-aa10-72ed09ee2ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:39 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-6bff7cc7-a8fa-4a0c-8d06-27eaba0b9384 tempest-CreateVolumesFromSnapshotTest-342642120 None] Volume afaddc4c-9e8b-4a84-a90e-766c4d6d6986: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986', 'volume_size': 1} Aug 31 15:31:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6bff7cc7-a8fa-4a0c-8d06-27eaba0b9384 tempest-CreateVolumesFromSnapshotTest-342642120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:39 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2643e7e1-38fb-4551-9006-ad2f8074c6fd tempest-ProjectReaderTests-1343788438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4697d7f4-58b1-4bbe-b3ff-030c3e650f06" returned: 0 in 0.303s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:39 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-2643e7e1-38fb-4551-9006-ad2f8074c6fd tempest-ProjectReaderTests-1343788438 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:31:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-2643e7e1-38fb-4551-9006-ad2f8074c6fd tempest-ProjectReaderTests-1343788438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6bff7cc7-a8fa-4a0c-8d06-27eaba0b9384 tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.088s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:39 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6bff7cc7-a8fa-4a0c-8d06-27eaba0b9384 tempest-CreateVolumesFromSnapshotTest-342642120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-8503203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afaddc4c-9e8b-4a84-a90e-766c4d6d6986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='681181ea10bc42a4a8ecd9bc15855ed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:31:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:31:40Z,use_quota=True,user_id='ff77725e71c0423a937998d14b23f737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:31:39 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-6bff7cc7-a8fa-4a0c-8d06-27eaba0b9384 tempest-CreateVolumesFromSnapshotTest-342642120 None] Creating volume afaddc4c-9e8b-4a84-a90e-766c4d6d6986 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:31:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6bff7cc7-a8fa-4a0c-8d06-27eaba0b9384 tempest-CreateVolumesFromSnapshotTest-342642120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6bff7cc7-a8fa-4a0c-8d06-27eaba0b9384 tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:39 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6bff7cc7-a8fa-4a0c-8d06-27eaba0b9384 tempest-CreateVolumesFromSnapshotTest-342642120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:31:39 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6bff7cc7-a8fa-4a0c-8d06-27eaba0b9384 tempest-CreateVolumesFromSnapshotTest-342642120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:31:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6bff7cc7-a8fa-4a0c-8d06-27eaba0b9384 tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:39 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6bff7cc7-a8fa-4a0c-8d06-27eaba0b9384 tempest-CreateVolumesFromSnapshotTest-342642120 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:31:39 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-6bff7cc7-a8fa-4a0c-8d06-27eaba0b9384 tempest-CreateVolumesFromSnapshotTest-342642120 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:31:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6bff7cc7-a8fa-4a0c-8d06-27eaba0b9384 tempest-CreateVolumesFromSnapshotTest-342642120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:39 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-2643e7e1-38fb-4551-9006-ad2f8074c6fd tempest-ProjectReaderTests-1343788438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f359f66e-612e-4729-927f-057ac8df7108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4697d7f4-58b1-4bbe-b3ff-030c3e650f06', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:39 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-2643e7e1-38fb-4551-9006-ad2f8074c6fd tempest-ProjectReaderTests-1343788438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1313edbd-daa0-4bb3-b8d4-83a19519e9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:39 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986 1073741824 Aug 31 15:31:39 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:39 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-2643e7e1-38fb-4551-9006-ad2f8074c6fd tempest-ProjectReaderTests-1343788438 None] Volume volume-4697d7f4-58b1-4bbe-b3ff-030c3e650f06 (4697d7f4-58b1-4bbe-b3ff-030c3e650f06): created successfully Aug 31 15:31:39 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-2643e7e1-38fb-4551-9006-ad2f8074c6fd tempest-ProjectReaderTests-1343788438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1313edbd-daa0-4bb3-b8d4-83a19519e9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:39 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-2643e7e1-38fb-4551-9006-ad2f8074c6fd tempest-ProjectReaderTests-1343788438 None] Flow 'volume_create_manager' (a93c6b3b-f36b-4989-b893-72a98925fdfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:31:40 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-2643e7e1-38fb-4551-9006-ad2f8074c6fd tempest-ProjectReaderTests-1343788438 None] Created volume successfully. Aug 31 15:31:40 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6ffdbeac-2024-479b-9402-c0174bef9979 tempest-VolumeDependencyTests-289667774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8030fa77-ccec-4fb8-b962-a640a57f50f1" returned: 0 in 0.321s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:40 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6ffdbeac-2024-479b-9402-c0174bef9979 tempest-VolumeDependencyTests-289667774 None] Lock "cinder-quobyte-8030fa77-ccec-4fb8-b962-a640a57f50f1" released by "delete_volume" :: held 1.016s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:40 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-6ffdbeac-2024-479b-9402-c0174bef9979 tempest-VolumeDependencyTests-289667774 None] Created reservations ['44016bfa-05a3-4004-9e8c-aaa1768153fb', 'a9495b1b-d68d-4e56-bc0e-88fca06708d3', '4a4b40b5-220e-47d3-8fec-746dfbe1d751', '5169b630-12bd-4cd1-8c7f-8f0e78966516'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:31:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6ffdbeac-2024-479b-9402-c0174bef9979 tempest-VolumeDependencyTests-289667774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6ffdbeac-2024-479b-9402-c0174bef9979 tempest-VolumeDependencyTests-289667774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:40 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6ffdbeac-2024-479b-9402-c0174bef9979 tempest-VolumeDependencyTests-289667774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:31:40 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6ffdbeac-2024-479b-9402-c0174bef9979 tempest-VolumeDependencyTests-289667774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:31:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6ffdbeac-2024-479b-9402-c0174bef9979 tempest-VolumeDependencyTests-289667774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6ffdbeac-2024-479b-9402-c0174bef9979 tempest-VolumeDependencyTests-289667774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:40 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:31:40 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:40 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6bff7cc7-a8fa-4a0c-8d06-27eaba0b9384 tempest-CreateVolumesFromSnapshotTest-342642120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986 1073741824" returned: 0 in 0.535s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6bff7cc7-a8fa-4a0c-8d06-27eaba0b9384 tempest-CreateVolumesFromSnapshotTest-342642120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:40 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:40 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986 Aug 31 15:31:40 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6ffdbeac-2024-479b-9402-c0174bef9979 tempest-VolumeDependencyTests-289667774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.312s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:40 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-6ffdbeac-2024-479b-9402-c0174bef9979 tempest-VolumeDependencyTests-289667774 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:31:40 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-6ffdbeac-2024-479b-9402-c0174bef9979 tempest-VolumeDependencyTests-289667774 None] Deleted volume successfully. Aug 31 15:31:40 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6ffdbeac-2024-479b-9402-c0174bef9979 tempest-VolumeDependencyTests-289667774 None] Lock "cinder-8030fa77-ccec-4fb8-b962-a640a57f50f1-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:40 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6bff7cc7-a8fa-4a0c-8d06-27eaba0b9384 tempest-CreateVolumesFromSnapshotTest-342642120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986" returned: 0 in 0.279s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:40 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6bff7cc7-a8fa-4a0c-8d06-27eaba0b9384 tempest-CreateVolumesFromSnapshotTest-342642120 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:31:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6bff7cc7-a8fa-4a0c-8d06-27eaba0b9384 tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:40 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6bff7cc7-a8fa-4a0c-8d06-27eaba0b9384 tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97badee9-a140-4939-aa10-72ed09ee2ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:40 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6bff7cc7-a8fa-4a0c-8d06-27eaba0b9384 tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e4db867-927c-4e09-80dd-db213552d964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:40 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-6bff7cc7-a8fa-4a0c-8d06-27eaba0b9384 tempest-CreateVolumesFromSnapshotTest-342642120 None] Volume volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986 (afaddc4c-9e8b-4a84-a90e-766c4d6d6986): created successfully Aug 31 15:31:40 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6bff7cc7-a8fa-4a0c-8d06-27eaba0b9384 tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e4db867-927c-4e09-80dd-db213552d964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:40 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-6bff7cc7-a8fa-4a0c-8d06-27eaba0b9384 tempest-CreateVolumesFromSnapshotTest-342642120 None] Flow 'volume_create_manager' (7bef761f-10bb-4d82-b845-f4ec0b442a5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:31:40 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-6bff7cc7-a8fa-4a0c-8d06-27eaba0b9384 tempest-CreateVolumesFromSnapshotTest-342642120 None] Created volume successfully. Aug 31 15:31:41 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-3a2f0817-d037-4b73-aefb-eda4143b5fff tempest-ProjectReaderTests-1343788438 None] Acquiring lock "cinder-4697d7f4-58b1-4bbe-b3ff-030c3e650f06-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:41 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-2564696d-418e-4b5b-82b5-7b95e81d9546 tempest-VolumeDependencyTests-289667774 None] Acquiring lock "cinder-cab274a1-d223-4c02-b127-2aa0eb2325ea-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:41 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-3a2f0817-d037-4b73-aefb-eda4143b5fff tempest-ProjectReaderTests-1343788438 None] Lock "cinder-4697d7f4-58b1-4bbe-b3ff-030c3e650f06-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:41 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-2564696d-418e-4b5b-82b5-7b95e81d9546 tempest-VolumeDependencyTests-289667774 None] Lock "cinder-cab274a1-d223-4c02-b127-2aa0eb2325ea-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:41 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-3a2f0817-d037-4b73-aefb-eda4143b5fff tempest-ProjectReaderTests-1343788438 None] Acquiring lock "cinder-quobyte-4697d7f4-58b1-4bbe-b3ff-030c3e650f06" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:41 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-2564696d-418e-4b5b-82b5-7b95e81d9546 tempest-VolumeDependencyTests-289667774 None] Acquiring lock "cinder-quobyte-cab274a1-d223-4c02-b127-2aa0eb2325ea" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:41 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-3a2f0817-d037-4b73-aefb-eda4143b5fff tempest-ProjectReaderTests-1343788438 None] Lock "cinder-quobyte-4697d7f4-58b1-4bbe-b3ff-030c3e650f06" acquired by "delete_volume" :: waited 0.021s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:41 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-2564696d-418e-4b5b-82b5-7b95e81d9546 tempest-VolumeDependencyTests-289667774 None] Lock "cinder-quobyte-cab274a1-d223-4c02-b127-2aa0eb2325ea" acquired by "delete_volume" :: waited 0.028s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:41 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e67637-8c35-4ea7-a178-8aab51cbb3d0]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:31:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-3a2f0817-d037-4b73-aefb-eda4143b5fff tempest-ProjectReaderTests-1343788438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4697d7f4-58b1-4bbe-b3ff-030c3e650f06 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:41 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c2172f-6e22-40cd-b1bd-5ee45ae494fc]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:31:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2564696d-418e-4b5b-82b5-7b95e81d9546 tempest-VolumeDependencyTests-289667774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-cab274a1-d223-4c02-b127-2aa0eb2325ea {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:41 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-cab274a1-d223-4c02-b127-2aa0eb2325ea Aug 31 15:31:41 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:41 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4697d7f4-58b1-4bbe-b3ff-030c3e650f06 Aug 31 15:31:41 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:41 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-3a2f0817-d037-4b73-aefb-eda4143b5fff tempest-ProjectReaderTests-1343788438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4697d7f4-58b1-4bbe-b3ff-030c3e650f06" returned: 0 in 0.442s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-3a2f0817-d037-4b73-aefb-eda4143b5fff tempest-ProjectReaderTests-1343788438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4697d7f4-58b1-4bbe-b3ff-030c3e650f06 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:41 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4697d7f4-58b1-4bbe-b3ff-030c3e650f06 Aug 31 15:31:41 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:41 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2564696d-418e-4b5b-82b5-7b95e81d9546 tempest-VolumeDependencyTests-289667774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-cab274a1-d223-4c02-b127-2aa0eb2325ea" returned: 0 in 0.471s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2564696d-418e-4b5b-82b5-7b95e81d9546 tempest-VolumeDependencyTests-289667774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-cab274a1-d223-4c02-b127-2aa0eb2325ea {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:41 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-cab274a1-d223-4c02-b127-2aa0eb2325ea Aug 31 15:31:41 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c2726979-806c-45c2-bf56-39f47a889cd1 tempest-CreateVolumesFromSnapshotTest-342642120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c2726979-806c-45c2-bf56-39f47a889cd1 tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:42 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-c2726979-806c-45c2-bf56-39f47a889cd1 tempest-CreateVolumesFromSnapshotTest-342642120 None] Creating offline snapshot 79b063be-dfd9-4322-a2cb-a4be5c21945d of volume afaddc4c-9e8b-4a84-a90e-766c4d6d6986 {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:31:42 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[61840f52-71fa-4f4f-9d89-38d53120ed55]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:31:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c2726979-806c-45c2-bf56-39f47a889cd1 tempest-CreateVolumesFromSnapshotTest-342642120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:42 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-3a2f0817-d037-4b73-aefb-eda4143b5fff tempest-ProjectReaderTests-1343788438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-4697d7f4-58b1-4bbe-b3ff-030c3e650f06" returned: 0 in 0.318s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:42 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-3a2f0817-d037-4b73-aefb-eda4143b5fff tempest-ProjectReaderTests-1343788438 None] Lock "cinder-quobyte-4697d7f4-58b1-4bbe-b3ff-030c3e650f06" released by "delete_volume" :: held 0.811s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:42 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986 Aug 31 15:31:42 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:42 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2564696d-418e-4b5b-82b5-7b95e81d9546 tempest-VolumeDependencyTests-289667774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-cab274a1-d223-4c02-b127-2aa0eb2325ea" returned: 0 in 0.331s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:42 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-2564696d-418e-4b5b-82b5-7b95e81d9546 tempest-VolumeDependencyTests-289667774 None] Lock "cinder-quobyte-cab274a1-d223-4c02-b127-2aa0eb2325ea" released by "delete_volume" :: held 0.861s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:42 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-3a2f0817-d037-4b73-aefb-eda4143b5fff tempest-ProjectReaderTests-1343788438 None] Created reservations ['3a0ec39d-81ef-4c02-a4db-3d0a00e9c819', '9fba8e10-70b5-40c3-897f-a215f87284b1', 'a1a2b02c-b2a9-4616-9236-66064ef03356', '26c82144-7f1e-477f-9b14-d0d5c5589e2f'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:31:42 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-2564696d-418e-4b5b-82b5-7b95e81d9546 tempest-VolumeDependencyTests-289667774 None] Created reservations ['e1bd84fe-95f9-4f79-81e0-6fd0b003e300', 'b438d979-f71e-4e0c-b57d-b05e589feab3', 'b31d35df-6706-4a18-9a5a-1bc4cf0d07cd', '571da1af-8e5b-4d05-bbec-8363b3ca3e93'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:31:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-3a2f0817-d037-4b73-aefb-eda4143b5fff tempest-ProjectReaderTests-1343788438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-3a2f0817-d037-4b73-aefb-eda4143b5fff tempest-ProjectReaderTests-1343788438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:42 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-3a2f0817-d037-4b73-aefb-eda4143b5fff tempest-ProjectReaderTests-1343788438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:31:42 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-3a2f0817-d037-4b73-aefb-eda4143b5fff tempest-ProjectReaderTests-1343788438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:31:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-3a2f0817-d037-4b73-aefb-eda4143b5fff tempest-ProjectReaderTests-1343788438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-3a2f0817-d037-4b73-aefb-eda4143b5fff tempest-ProjectReaderTests-1343788438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:42 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:31:42 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-2564696d-418e-4b5b-82b5-7b95e81d9546 tempest-VolumeDependencyTests-289667774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-2564696d-418e-4b5b-82b5-7b95e81d9546 tempest-VolumeDependencyTests-289667774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:42 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-2564696d-418e-4b5b-82b5-7b95e81d9546 tempest-VolumeDependencyTests-289667774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:31:42 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-2564696d-418e-4b5b-82b5-7b95e81d9546 tempest-VolumeDependencyTests-289667774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:31:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-2564696d-418e-4b5b-82b5-7b95e81d9546 tempest-VolumeDependencyTests-289667774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2564696d-418e-4b5b-82b5-7b95e81d9546 tempest-VolumeDependencyTests-289667774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:42 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:31:42 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:42 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c2726979-806c-45c2-bf56-39f47a889cd1 tempest-CreateVolumesFromSnapshotTest-342642120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986" returned: 0 in 0.542s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c2726979-806c-45c2-bf56-39f47a889cd1 tempest-CreateVolumesFromSnapshotTest-342642120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986.79b063be-dfd9-4322-a2cb-a4be5c21945d 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:42 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986.79b063be-dfd9-4322-a2cb-a4be5c21945d 1G Aug 31 15:31:42 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:42 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-3a2f0817-d037-4b73-aefb-eda4143b5fff tempest-ProjectReaderTests-1343788438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.446s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:42 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-3a2f0817-d037-4b73-aefb-eda4143b5fff tempest-ProjectReaderTests-1343788438 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:31:42 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-3a2f0817-d037-4b73-aefb-eda4143b5fff tempest-ProjectReaderTests-1343788438 None] Deleted volume successfully. Aug 31 15:31:42 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-3a2f0817-d037-4b73-aefb-eda4143b5fff tempest-ProjectReaderTests-1343788438 None] Lock "cinder-4697d7f4-58b1-4bbe-b3ff-030c3e650f06-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:42 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2564696d-418e-4b5b-82b5-7b95e81d9546 tempest-VolumeDependencyTests-289667774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.441s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:42 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-2564696d-418e-4b5b-82b5-7b95e81d9546 tempest-VolumeDependencyTests-289667774 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:31:43 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-2564696d-418e-4b5b-82b5-7b95e81d9546 tempest-VolumeDependencyTests-289667774 None] Deleted volume successfully. Aug 31 15:31:43 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-2564696d-418e-4b5b-82b5-7b95e81d9546 tempest-VolumeDependencyTests-289667774 None] Lock "cinder-cab274a1-d223-4c02-b127-2aa0eb2325ea-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:43 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c2726979-806c-45c2-bf56-39f47a889cd1 tempest-CreateVolumesFromSnapshotTest-342642120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986.79b063be-dfd9-4322-a2cb-a4be5c21945d 1G" returned: 0 in 0.630s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c2726979-806c-45c2-bf56-39f47a889cd1 tempest-CreateVolumesFromSnapshotTest-342642120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986.79b063be-dfd9-4322-a2cb-a4be5c21945d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:43 devstack sudo[105750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986.79b063be-dfd9-4322-a2cb-a4be5c21945d Aug 31 15:31:43 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:43 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-01be439d-ce49-4d4c-bda4-af0f989ac1c8 tempest-ProjectReaderTests-1343788438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:31:43 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-01be439d-ce49-4d4c-bda4-af0f989ac1c8 tempest-ProjectReaderTests-1343788438 None] Flow 'volume_create_manager' (d1fc7ef5-eb61-4561-a5a4-3429248e1582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:31:43 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-01be439d-ce49-4d4c-bda4-af0f989ac1c8 tempest-ProjectReaderTests-1343788438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (032d69b9-6acc-4595-8fc6-9fba3645022e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:43 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-01be439d-ce49-4d4c-bda4-af0f989ac1c8 tempest-ProjectReaderTests-1343788438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (032d69b9-6acc-4595-8fc6-9fba3645022e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1780111936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=284e3d8c-068b-45a1-a574-df3c4373652d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='727aea03969b48f99f2b76da7b059b11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:31:43Z,use_quota=True,user_id='67c71e8220614070ace8f23b446730f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:43 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-01be439d-ce49-4d4c-bda4-af0f989ac1c8 tempest-ProjectReaderTests-1343788438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99efcc0b-d519-4e6c-99a7-2c3314013589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:43 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-01be439d-ce49-4d4c-bda4-af0f989ac1c8 tempest-ProjectReaderTests-1343788438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99efcc0b-d519-4e6c-99a7-2c3314013589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:43 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-01be439d-ce49-4d4c-bda4-af0f989ac1c8 tempest-ProjectReaderTests-1343788438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42222424-8988-4367-bf09-ed3896f592e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:43 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-01be439d-ce49-4d4c-bda4-af0f989ac1c8 tempest-ProjectReaderTests-1343788438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42222424-8988-4367-bf09-ed3896f592e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '284e3d8c-068b-45a1-a574-df3c4373652d', 'volume_name': 'volume-284e3d8c-068b-45a1-a574-df3c4373652d', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:43 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-01be439d-ce49-4d4c-bda4-af0f989ac1c8 tempest-ProjectReaderTests-1343788438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c6af554-2f20-4ff2-b6db-dfc8370c47ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:43 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-01be439d-ce49-4d4c-bda4-af0f989ac1c8 tempest-ProjectReaderTests-1343788438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c6af554-2f20-4ff2-b6db-dfc8370c47ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:43 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-01be439d-ce49-4d4c-bda4-af0f989ac1c8 tempest-ProjectReaderTests-1343788438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b836755-2cae-4596-84fe-0c87b38252ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:43 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-01be439d-ce49-4d4c-bda4-af0f989ac1c8 tempest-ProjectReaderTests-1343788438 None] Volume 284e3d8c-068b-45a1-a574-df3c4373652d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-284e3d8c-068b-45a1-a574-df3c4373652d', 'volume_size': 1} Aug 31 15:31:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-01be439d-ce49-4d4c-bda4-af0f989ac1c8 tempest-ProjectReaderTests-1343788438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:43 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c2726979-806c-45c2-bf56-39f47a889cd1 tempest-CreateVolumesFromSnapshotTest-342642120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986.79b063be-dfd9-4322-a2cb-a4be5c21945d" returned: 0 in 0.389s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:43 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-c2726979-806c-45c2-bf56-39f47a889cd1 tempest-CreateVolumesFromSnapshotTest-342642120 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986.79b063be-dfd9-4322-a2cb-a4be5c21945d is being set with open permissions: ugo+rw Aug 31 15:31:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c2726979-806c-45c2-bf56-39f47a889cd1 tempest-CreateVolumesFromSnapshotTest-342642120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986.79b063be-dfd9-4322-a2cb-a4be5c21945d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:43 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986.79b063be-dfd9-4322-a2cb-a4be5c21945d Aug 31 15:31:43 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:43 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c2726979-806c-45c2-bf56-39f47a889cd1 tempest-CreateVolumesFromSnapshotTest-342642120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986.79b063be-dfd9-4322-a2cb-a4be5c21945d" returned: 0 in 0.271s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:43 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:UPDATE=213,cinder:SELECT=166,cinder:DELETE=18,cinder:INSERT=62 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:31:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c2726979-806c-45c2-bf56-39f47a889cd1 tempest-CreateVolumesFromSnapshotTest-342642120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:43 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986.info Aug 31 15:31:43 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:44 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c2726979-806c-45c2-bf56-39f47a889cd1 tempest-CreateVolumesFromSnapshotTest-342642120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986.info" returned: 0 in 0.335s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:44 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-c2726979-806c-45c2-bf56-39f47a889cd1 tempest-CreateVolumesFromSnapshotTest-342642120 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986.info is being set with open permissions: ugo+rw Aug 31 15:31:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c2726979-806c-45c2-bf56-39f47a889cd1 tempest-CreateVolumesFromSnapshotTest-342642120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:44 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986.info Aug 31 15:31:44 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:44 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c2726979-806c-45c2-bf56-39f47a889cd1 tempest-CreateVolumesFromSnapshotTest-342642120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986.info" returned: 0 in 0.290s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c2726979-806c-45c2-bf56-39f47a889cd1 tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.575s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-01be439d-ce49-4d4c-bda4-af0f989ac1c8 tempest-ProjectReaderTests-1343788438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.041s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:44 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-01be439d-ce49-4d4c-bda4-af0f989ac1c8 tempest-ProjectReaderTests-1343788438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1780111936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=284e3d8c-068b-45a1-a574-df3c4373652d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='727aea03969b48f99f2b76da7b059b11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:31:43Z,use_quota=True,user_id='67c71e8220614070ace8f23b446730f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:31:44 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-01be439d-ce49-4d4c-bda4-af0f989ac1c8 tempest-ProjectReaderTests-1343788438 None] Creating volume 284e3d8c-068b-45a1-a574-df3c4373652d {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:31:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-01be439d-ce49-4d4c-bda4-af0f989ac1c8 tempest-ProjectReaderTests-1343788438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-01be439d-ce49-4d4c-bda4-af0f989ac1c8 tempest-ProjectReaderTests-1343788438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:44 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-01be439d-ce49-4d4c-bda4-af0f989ac1c8 tempest-ProjectReaderTests-1343788438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:31:44 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-01be439d-ce49-4d4c-bda4-af0f989ac1c8 tempest-ProjectReaderTests-1343788438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:31:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-01be439d-ce49-4d4c-bda4-af0f989ac1c8 tempest-ProjectReaderTests-1343788438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:44 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-01be439d-ce49-4d4c-bda4-af0f989ac1c8 tempest-ProjectReaderTests-1343788438 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:31:44 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-01be439d-ce49-4d4c-bda4-af0f989ac1c8 tempest-ProjectReaderTests-1343788438 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:31:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-01be439d-ce49-4d4c-bda4-af0f989ac1c8 tempest-ProjectReaderTests-1343788438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-284e3d8c-068b-45a1-a574-df3c4373652d 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:44 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:SELECT=162,cinder:UPDATE=227,cinder:INSERT=59,cinder:DELETE=21 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:31:44 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-284e3d8c-068b-45a1-a574-df3c4373652d 1073741824 Aug 31 15:31:44 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:44 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-c2726979-806c-45c2-bf56-39f47a889cd1 tempest-CreateVolumesFromSnapshotTest-342642120 None] Create snapshot completed successfully Aug 31 15:31:45 devstack cinder-volume[86000]: DEBUG oslo_service.periodic_task [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86000) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:31:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:31:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:31:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:45 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-01be439d-ce49-4d4c-bda4-af0f989ac1c8 tempest-ProjectReaderTests-1343788438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-284e3d8c-068b-45a1-a574-df3c4373652d 1073741824" returned: 0 in 0.522s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:45 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:31:45 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-01be439d-ce49-4d4c-bda4-af0f989ac1c8 tempest-ProjectReaderTests-1343788438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-284e3d8c-068b-45a1-a574-df3c4373652d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:45 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-284e3d8c-068b-45a1-a574-df3c4373652d Aug 31 15:31:45 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:45 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.303s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:45 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:31:45 devstack cinder-volume[86000]: DEBUG oslo_service.periodic_task [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running periodic task VolumeManager._thread_info {{(pid=86000) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:31:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] thread count: 28 {{(pid=86000) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 31 15:31:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] thread info: [<_MainThread(MainThread, started 137631281086592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86000) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 31 15:31:45 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-01be439d-ce49-4d4c-bda4-af0f989ac1c8 tempest-ProjectReaderTests-1343788438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-284e3d8c-068b-45a1-a574-df3c4373652d" returned: 0 in 0.381s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-01be439d-ce49-4d4c-bda4-af0f989ac1c8 tempest-ProjectReaderTests-1343788438 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:31:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-01be439d-ce49-4d4c-bda4-af0f989ac1c8 tempest-ProjectReaderTests-1343788438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-01be439d-ce49-4d4c-bda4-af0f989ac1c8 tempest-ProjectReaderTests-1343788438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b836755-2cae-4596-84fe-0c87b38252ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-284e3d8c-068b-45a1-a574-df3c4373652d', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-01be439d-ce49-4d4c-bda4-af0f989ac1c8 tempest-ProjectReaderTests-1343788438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d04084c1-3256-478d-a0bd-f38b761ec5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:45 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-01be439d-ce49-4d4c-bda4-af0f989ac1c8 tempest-ProjectReaderTests-1343788438 None] Volume volume-284e3d8c-068b-45a1-a574-df3c4373652d (284e3d8c-068b-45a1-a574-df3c4373652d): created successfully Aug 31 15:31:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-01be439d-ce49-4d4c-bda4-af0f989ac1c8 tempest-ProjectReaderTests-1343788438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d04084c1-3256-478d-a0bd-f38b761ec5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-01be439d-ce49-4d4c-bda4-af0f989ac1c8 tempest-ProjectReaderTests-1343788438 None] Flow 'volume_create_manager' (d1fc7ef5-eb61-4561-a5a4-3429248e1582) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:31:45 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-01be439d-ce49-4d4c-bda4-af0f989ac1c8 tempest-ProjectReaderTests-1343788438 None] Created volume successfully. Aug 31 15:31:45 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-acbd5eec-1b96-4181-9362-7f034894217e tempest-CreateVolumesFromSnapshotTest-342642120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:31:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-acbd5eec-1b96-4181-9362-7f034894217e tempest-CreateVolumesFromSnapshotTest-342642120 None] Flow 'volume_create_manager' (7072e67b-2591-4d9d-8af0-1b6a39c54de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:31:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-acbd5eec-1b96-4181-9362-7f034894217e tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77ef7111-a6d0-405e-800e-aeedda71db89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-acbd5eec-1b96-4181-9362-7f034894217e tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77ef7111-a6d0-405e-800e-aeedda71db89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-972517837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3444cc66-7922-4cfe-9796-ed429537022c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='681181ea10bc42a4a8ecd9bc15855ed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:31:46Z,use_quota=True,user_id='ff77725e71c0423a937998d14b23f737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-acbd5eec-1b96-4181-9362-7f034894217e tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d93df1d-52c0-4c34-b2a8-2632e269773f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-acbd5eec-1b96-4181-9362-7f034894217e tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d93df1d-52c0-4c34-b2a8-2632e269773f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-acbd5eec-1b96-4181-9362-7f034894217e tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc4f9188-5523-46bd-bd35-20e0bfd84105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-acbd5eec-1b96-4181-9362-7f034894217e tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc4f9188-5523-46bd-bd35-20e0bfd84105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3444cc66-7922-4cfe-9796-ed429537022c', 'volume_name': 'volume-3444cc66-7922-4cfe-9796-ed429537022c', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-acbd5eec-1b96-4181-9362-7f034894217e tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd050e07-a408-49a2-bbb2-1ee9a3e9d34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-acbd5eec-1b96-4181-9362-7f034894217e tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd050e07-a408-49a2-bbb2-1ee9a3e9d34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-acbd5eec-1b96-4181-9362-7f034894217e tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcdf88bc-b864-41af-b2ca-f78e47f2da35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:45 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-acbd5eec-1b96-4181-9362-7f034894217e tempest-CreateVolumesFromSnapshotTest-342642120 None] Volume 3444cc66-7922-4cfe-9796-ed429537022c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3444cc66-7922-4cfe-9796-ed429537022c', 'volume_size': 1} Aug 31 15:31:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-acbd5eec-1b96-4181-9362-7f034894217e tempest-CreateVolumesFromSnapshotTest-342642120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-acbd5eec-1b96-4181-9362-7f034894217e tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-acbd5eec-1b96-4181-9362-7f034894217e tempest-CreateVolumesFromSnapshotTest-342642120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-972517837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3444cc66-7922-4cfe-9796-ed429537022c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='681181ea10bc42a4a8ecd9bc15855ed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:31:46Z,use_quota=True,user_id='ff77725e71c0423a937998d14b23f737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:31:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-acbd5eec-1b96-4181-9362-7f034894217e tempest-CreateVolumesFromSnapshotTest-342642120 None] Creating volume 3444cc66-7922-4cfe-9796-ed429537022c {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:31:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-acbd5eec-1b96-4181-9362-7f034894217e tempest-CreateVolumesFromSnapshotTest-342642120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-acbd5eec-1b96-4181-9362-7f034894217e tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-acbd5eec-1b96-4181-9362-7f034894217e tempest-CreateVolumesFromSnapshotTest-342642120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:31:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-acbd5eec-1b96-4181-9362-7f034894217e tempest-CreateVolumesFromSnapshotTest-342642120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:31:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-acbd5eec-1b96-4181-9362-7f034894217e tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-acbd5eec-1b96-4181-9362-7f034894217e tempest-CreateVolumesFromSnapshotTest-342642120 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:31:45 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-acbd5eec-1b96-4181-9362-7f034894217e tempest-CreateVolumesFromSnapshotTest-342642120 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:31:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-acbd5eec-1b96-4181-9362-7f034894217e tempest-CreateVolumesFromSnapshotTest-342642120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3444cc66-7922-4cfe-9796-ed429537022c 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:46 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3444cc66-7922-4cfe-9796-ed429537022c 1073741824 Aug 31 15:31:46 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:46 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-834c4ebe-876f-439d-891b-900165705870 tempest-CreateVolumesFromSnapshotTest-342642120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:31:46 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-834c4ebe-876f-439d-891b-900165705870 tempest-CreateVolumesFromSnapshotTest-342642120 None] Flow 'volume_create_manager' (76cb3f24-b104-4107-b586-3b035accdfbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:31:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-834c4ebe-876f-439d-891b-900165705870 tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e5d1047-d53c-4b6e-9870-348a64dfd8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-acbd5eec-1b96-4181-9362-7f034894217e tempest-CreateVolumesFromSnapshotTest-342642120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3444cc66-7922-4cfe-9796-ed429537022c 1073741824" returned: 0 in 0.895s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-834c4ebe-876f-439d-891b-900165705870 tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e5d1047-d53c-4b6e-9870-348a64dfd8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-34381214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93b415db-b11e-433a-9dc2-70ce2694b053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='681181ea10bc42a4a8ecd9bc15855ed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:31:47Z,use_quota=True,user_id='ff77725e71c0423a937998d14b23f737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-834c4ebe-876f-439d-891b-900165705870 tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8a52b42-7278-4e2f-bfe7-f317e340233a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-834c4ebe-876f-439d-891b-900165705870 tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8a52b42-7278-4e2f-bfe7-f317e340233a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-834c4ebe-876f-439d-891b-900165705870 tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9278853a-a7d1-4d06-a4e1-491e08adbf81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-834c4ebe-876f-439d-891b-900165705870 tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9278853a-a7d1-4d06-a4e1-491e08adbf81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93b415db-b11e-433a-9dc2-70ce2694b053', 'volume_name': 'volume-93b415db-b11e-433a-9dc2-70ce2694b053', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-834c4ebe-876f-439d-891b-900165705870 tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e48cc10-3e65-4d7c-a720-e29c900f7152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-834c4ebe-876f-439d-891b-900165705870 tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e48cc10-3e65-4d7c-a720-e29c900f7152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:46 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-834c4ebe-876f-439d-891b-900165705870 tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e685d60c-87f2-4db2-a40c-d2b62fcb14cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:46 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-834c4ebe-876f-439d-891b-900165705870 tempest-CreateVolumesFromSnapshotTest-342642120 None] Volume 93b415db-b11e-433a-9dc2-70ce2694b053: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93b415db-b11e-433a-9dc2-70ce2694b053', 'volume_size': 1} Aug 31 15:31:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-834c4ebe-876f-439d-891b-900165705870 tempest-CreateVolumesFromSnapshotTest-342642120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-acbd5eec-1b96-4181-9362-7f034894217e tempest-CreateVolumesFromSnapshotTest-342642120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3444cc66-7922-4cfe-9796-ed429537022c {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:46 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3444cc66-7922-4cfe-9796-ed429537022c Aug 31 15:31:46 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:47 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8d9f244-4457-4890-a834-d04e4648c39c tempest-CreateVolumesFromSnapshotTest-342642120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:31:47 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c8d9f244-4457-4890-a834-d04e4648c39c tempest-CreateVolumesFromSnapshotTest-342642120 None] Flow 'volume_create_manager' (9eaa9925-d383-41fb-8a71-6b95c78c845e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:31:47 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c8d9f244-4457-4890-a834-d04e4648c39c tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1218d655-c0e1-4298-805c-f91b7a3bfaf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:47 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c8d9f244-4457-4890-a834-d04e4648c39c tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1218d655-c0e1-4298-805c-f91b7a3bfaf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1034588710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b78ae6c-5e59-4338-a3b1-419239b79332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='681181ea10bc42a4a8ecd9bc15855ed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:31:47Z,use_quota=True,user_id='ff77725e71c0423a937998d14b23f737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:47 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c8d9f244-4457-4890-a834-d04e4648c39c tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5af3c2ad-47f0-49a5-8096-556842c00111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:47 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c8d9f244-4457-4890-a834-d04e4648c39c tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5af3c2ad-47f0-49a5-8096-556842c00111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:47 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c8d9f244-4457-4890-a834-d04e4648c39c tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b9797e4-8f0a-4fa7-b9ef-1df8cc254b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:47 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c8d9f244-4457-4890-a834-d04e4648c39c tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b9797e4-8f0a-4fa7-b9ef-1df8cc254b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b78ae6c-5e59-4338-a3b1-419239b79332', 'volume_name': 'volume-6b78ae6c-5e59-4338-a3b1-419239b79332', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:47 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:47 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c8d9f244-4457-4890-a834-d04e4648c39c tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (440c1450-a1ef-4c39-b20b-730b90559eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:47 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c8d9f244-4457-4890-a834-d04e4648c39c tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (440c1450-a1ef-4c39-b20b-730b90559eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:47 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c8d9f244-4457-4890-a834-d04e4648c39c tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0d872ac-3629-4ea6-a5d9-aef32cce2fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:47 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-c8d9f244-4457-4890-a834-d04e4648c39c tempest-CreateVolumesFromSnapshotTest-342642120 None] Volume 6b78ae6c-5e59-4338-a3b1-419239b79332: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b78ae6c-5e59-4338-a3b1-419239b79332', 'volume_size': 1} Aug 31 15:31:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c8d9f244-4457-4890-a834-d04e4648c39c tempest-CreateVolumesFromSnapshotTest-342642120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:47 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-791766e0-83ae-404f-9594-2e93b570c2ab tempest-ProjectReaderTests-1343788438 None] Acquiring lock "cinder-284e3d8c-068b-45a1-a574-df3c4373652d-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-acbd5eec-1b96-4181-9362-7f034894217e tempest-CreateVolumesFromSnapshotTest-342642120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3444cc66-7922-4cfe-9796-ed429537022c" returned: 0 in 0.482s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:47 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-acbd5eec-1b96-4181-9362-7f034894217e tempest-CreateVolumesFromSnapshotTest-342642120 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:31:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-acbd5eec-1b96-4181-9362-7f034894217e tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-834c4ebe-876f-439d-891b-900165705870 tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.530s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:47 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-834c4ebe-876f-439d-891b-900165705870 tempest-CreateVolumesFromSnapshotTest-342642120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-34381214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93b415db-b11e-433a-9dc2-70ce2694b053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='681181ea10bc42a4a8ecd9bc15855ed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:31:47Z,use_quota=True,user_id='ff77725e71c0423a937998d14b23f737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:31:47 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-834c4ebe-876f-439d-891b-900165705870 tempest-CreateVolumesFromSnapshotTest-342642120 None] Creating volume 93b415db-b11e-433a-9dc2-70ce2694b053 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:31:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-834c4ebe-876f-439d-891b-900165705870 tempest-CreateVolumesFromSnapshotTest-342642120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-834c4ebe-876f-439d-891b-900165705870 tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:47 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-834c4ebe-876f-439d-891b-900165705870 tempest-CreateVolumesFromSnapshotTest-342642120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:31:47 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-834c4ebe-876f-439d-891b-900165705870 tempest-CreateVolumesFromSnapshotTest-342642120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:31:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-834c4ebe-876f-439d-891b-900165705870 tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:47 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-834c4ebe-876f-439d-891b-900165705870 tempest-CreateVolumesFromSnapshotTest-342642120 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:31:47 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-834c4ebe-876f-439d-891b-900165705870 tempest-CreateVolumesFromSnapshotTest-342642120 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:31:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-834c4ebe-876f-439d-891b-900165705870 tempest-CreateVolumesFromSnapshotTest-342642120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-93b415db-b11e-433a-9dc2-70ce2694b053 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:47 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-93b415db-b11e-433a-9dc2-70ce2694b053 1073741824 Aug 31 15:31:47 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:47 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-acbd5eec-1b96-4181-9362-7f034894217e tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcdf88bc-b864-41af-b2ca-f78e47f2da35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3444cc66-7922-4cfe-9796-ed429537022c', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:47 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-acbd5eec-1b96-4181-9362-7f034894217e tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c4bffec-afeb-4cff-9d06-1f59bbf53ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:47 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-791766e0-83ae-404f-9594-2e93b570c2ab tempest-ProjectReaderTests-1343788438 None] Lock "cinder-284e3d8c-068b-45a1-a574-df3c4373652d-delete_volume" acquired by "delete_volume" :: waited 0.150s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:47 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-acbd5eec-1b96-4181-9362-7f034894217e tempest-CreateVolumesFromSnapshotTest-342642120 None] Volume volume-3444cc66-7922-4cfe-9796-ed429537022c (3444cc66-7922-4cfe-9796-ed429537022c): created successfully Aug 31 15:31:47 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-acbd5eec-1b96-4181-9362-7f034894217e tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c4bffec-afeb-4cff-9d06-1f59bbf53ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:47 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-acbd5eec-1b96-4181-9362-7f034894217e tempest-CreateVolumesFromSnapshotTest-342642120 None] Flow 'volume_create_manager' (7072e67b-2591-4d9d-8af0-1b6a39c54de6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:31:47 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-acbd5eec-1b96-4181-9362-7f034894217e tempest-CreateVolumesFromSnapshotTest-342642120 None] Created volume successfully. Aug 31 15:31:47 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-791766e0-83ae-404f-9594-2e93b570c2ab tempest-ProjectReaderTests-1343788438 None] Acquiring lock "cinder-quobyte-284e3d8c-068b-45a1-a574-df3c4373652d" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:47 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-791766e0-83ae-404f-9594-2e93b570c2ab tempest-ProjectReaderTests-1343788438 None] Lock "cinder-quobyte-284e3d8c-068b-45a1-a574-df3c4373652d" acquired by "delete_volume" :: waited 0.042s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:47 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1f99fb-ac95-49d2-96ac-695abda05984]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:31:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-791766e0-83ae-404f-9594-2e93b570c2ab tempest-ProjectReaderTests-1343788438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-284e3d8c-068b-45a1-a574-df3c4373652d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:47 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-284e3d8c-068b-45a1-a574-df3c4373652d Aug 31 15:31:47 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:48 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-834c4ebe-876f-439d-891b-900165705870 tempest-CreateVolumesFromSnapshotTest-342642120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-93b415db-b11e-433a-9dc2-70ce2694b053 1073741824" returned: 0 in 0.669s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-834c4ebe-876f-439d-891b-900165705870 tempest-CreateVolumesFromSnapshotTest-342642120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-93b415db-b11e-433a-9dc2-70ce2694b053 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:48 devstack sudo[105800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-93b415db-b11e-433a-9dc2-70ce2694b053 Aug 31 15:31:48 devstack sudo[105800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a10d70d-1b8b-40a0-9a1c-166e123369e7 tempest-CreateVolumesFromSnapshotTest-342642120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1a10d70d-1b8b-40a0-9a1c-166e123369e7 tempest-CreateVolumesFromSnapshotTest-342642120 None] Flow 'volume_create_manager' (eb325381-e30f-445c-861e-59a36cb9f53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1a10d70d-1b8b-40a0-9a1c-166e123369e7 tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (928c6466-2004-47d9-87f9-6f78761af2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:48 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-791766e0-83ae-404f-9594-2e93b570c2ab tempest-ProjectReaderTests-1343788438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-284e3d8c-068b-45a1-a574-df3c4373652d" returned: 0 in 0.580s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-791766e0-83ae-404f-9594-2e93b570c2ab tempest-ProjectReaderTests-1343788438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-284e3d8c-068b-45a1-a574-df3c4373652d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1a10d70d-1b8b-40a0-9a1c-166e123369e7 tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (928c6466-2004-47d9-87f9-6f78761af2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1558395635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27d9d079-2d86-4098-8fbe-b0ed56047210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='681181ea10bc42a4a8ecd9bc15855ed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:31:48Z,use_quota=True,user_id='ff77725e71c0423a937998d14b23f737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1a10d70d-1b8b-40a0-9a1c-166e123369e7 tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1ce6560-0f66-4252-b6fe-0c205f7ff970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1a10d70d-1b8b-40a0-9a1c-166e123369e7 tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1ce6560-0f66-4252-b6fe-0c205f7ff970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:48 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-284e3d8c-068b-45a1-a574-df3c4373652d Aug 31 15:31:48 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1a10d70d-1b8b-40a0-9a1c-166e123369e7 tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0e63ca9-0eaa-4942-97cc-5f6e2294d74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1a10d70d-1b8b-40a0-9a1c-166e123369e7 tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0e63ca9-0eaa-4942-97cc-5f6e2294d74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27d9d079-2d86-4098-8fbe-b0ed56047210', 'volume_name': 'volume-27d9d079-2d86-4098-8fbe-b0ed56047210', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1a10d70d-1b8b-40a0-9a1c-166e123369e7 tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35fd4fd8-9e5b-4db0-8280-9f75dce63431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1a10d70d-1b8b-40a0-9a1c-166e123369e7 tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35fd4fd8-9e5b-4db0-8280-9f75dce63431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1a10d70d-1b8b-40a0-9a1c-166e123369e7 tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (676f859f-1d85-45e3-9e7b-9d537fe32dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:48 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-1a10d70d-1b8b-40a0-9a1c-166e123369e7 tempest-CreateVolumesFromSnapshotTest-342642120 None] Volume 27d9d079-2d86-4098-8fbe-b0ed56047210: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27d9d079-2d86-4098-8fbe-b0ed56047210', 'volume_size': 1} Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1a10d70d-1b8b-40a0-9a1c-166e123369e7 tempest-CreateVolumesFromSnapshotTest-342642120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e5bfc8b-8041-4254-8a52-a4c26bd8df8d tempest-CreateVolumesFromSnapshotTest-342642120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7e5bfc8b-8041-4254-8a52-a4c26bd8df8d tempest-CreateVolumesFromSnapshotTest-342642120 None] Flow 'volume_create_manager' (15932056-82f3-419b-b184-77976e30d14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7e5bfc8b-8041-4254-8a52-a4c26bd8df8d tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dd2460b-dc62-41fd-bf77-77c5ed7906e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7e5bfc8b-8041-4254-8a52-a4c26bd8df8d tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dd2460b-dc62-41fd-bf77-77c5ed7906e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1548768537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=167e24ea-b17a-48b2-b5f3-7783673d83bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='681181ea10bc42a4a8ecd9bc15855ed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:31:48Z,use_quota=True,user_id='ff77725e71c0423a937998d14b23f737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7e5bfc8b-8041-4254-8a52-a4c26bd8df8d tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a168b8f4-91d8-4ea1-ab84-2e6af77c5468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7e5bfc8b-8041-4254-8a52-a4c26bd8df8d tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a168b8f4-91d8-4ea1-ab84-2e6af77c5468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:48 devstack sudo[105800]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7e5bfc8b-8041-4254-8a52-a4c26bd8df8d tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e83d9a5c-73c2-4eb6-91ac-e171e16d8011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7e5bfc8b-8041-4254-8a52-a4c26bd8df8d tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e83d9a5c-73c2-4eb6-91ac-e171e16d8011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '167e24ea-b17a-48b2-b5f3-7783673d83bc', 'volume_name': 'volume-167e24ea-b17a-48b2-b5f3-7783673d83bc', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7e5bfc8b-8041-4254-8a52-a4c26bd8df8d tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (458b7147-bd0a-450a-ab4d-a26ba67d5e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7e5bfc8b-8041-4254-8a52-a4c26bd8df8d tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (458b7147-bd0a-450a-ab4d-a26ba67d5e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7e5bfc8b-8041-4254-8a52-a4c26bd8df8d tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62099fe1-c4ec-4541-866b-ab3c0963d640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:48 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-7e5bfc8b-8041-4254-8a52-a4c26bd8df8d tempest-CreateVolumesFromSnapshotTest-342642120 None] Volume 167e24ea-b17a-48b2-b5f3-7783673d83bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-167e24ea-b17a-48b2-b5f3-7783673d83bc', 'volume_size': 1} Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7e5bfc8b-8041-4254-8a52-a4c26bd8df8d tempest-CreateVolumesFromSnapshotTest-342642120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-834c4ebe-876f-439d-891b-900165705870 tempest-CreateVolumesFromSnapshotTest-342642120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-93b415db-b11e-433a-9dc2-70ce2694b053" returned: 0 in 0.420s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-834c4ebe-876f-439d-891b-900165705870 tempest-CreateVolumesFromSnapshotTest-342642120 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-834c4ebe-876f-439d-891b-900165705870 tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c8d9f244-4457-4890-a834-d04e4648c39c tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.226s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c8d9f244-4457-4890-a834-d04e4648c39c tempest-CreateVolumesFromSnapshotTest-342642120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1034588710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b78ae6c-5e59-4338-a3b1-419239b79332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='681181ea10bc42a4a8ecd9bc15855ed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:31:47Z,use_quota=True,user_id='ff77725e71c0423a937998d14b23f737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-c8d9f244-4457-4890-a834-d04e4648c39c tempest-CreateVolumesFromSnapshotTest-342642120 None] Creating volume 6b78ae6c-5e59-4338-a3b1-419239b79332 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c8d9f244-4457-4890-a834-d04e4648c39c tempest-CreateVolumesFromSnapshotTest-342642120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c8d9f244-4457-4890-a834-d04e4648c39c tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c8d9f244-4457-4890-a834-d04e4648c39c tempest-CreateVolumesFromSnapshotTest-342642120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c8d9f244-4457-4890-a834-d04e4648c39c tempest-CreateVolumesFromSnapshotTest-342642120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c8d9f244-4457-4890-a834-d04e4648c39c tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c8d9f244-4457-4890-a834-d04e4648c39c tempest-CreateVolumesFromSnapshotTest-342642120 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:31:48 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-c8d9f244-4457-4890-a834-d04e4648c39c tempest-CreateVolumesFromSnapshotTest-342642120 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c8d9f244-4457-4890-a834-d04e4648c39c tempest-CreateVolumesFromSnapshotTest-342642120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6b78ae6c-5e59-4338-a3b1-419239b79332 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-834c4ebe-876f-439d-891b-900165705870 tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e685d60c-87f2-4db2-a40c-d2b62fcb14cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93b415db-b11e-433a-9dc2-70ce2694b053', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-834c4ebe-876f-439d-891b-900165705870 tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de7ddf6a-9ff3-4c48-b377-28fa1d6df60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:48 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6b78ae6c-5e59-4338-a3b1-419239b79332 1073741824 Aug 31 15:31:48 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:48 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-834c4ebe-876f-439d-891b-900165705870 tempest-CreateVolumesFromSnapshotTest-342642120 None] Volume volume-93b415db-b11e-433a-9dc2-70ce2694b053 (93b415db-b11e-433a-9dc2-70ce2694b053): created successfully Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-834c4ebe-876f-439d-891b-900165705870 tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de7ddf6a-9ff3-4c48-b377-28fa1d6df60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:48 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-834c4ebe-876f-439d-891b-900165705870 tempest-CreateVolumesFromSnapshotTest-342642120 None] Flow 'volume_create_manager' (76cb3f24-b104-4107-b586-3b035accdfbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-791766e0-83ae-404f-9594-2e93b570c2ab tempest-ProjectReaderTests-1343788438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-284e3d8c-068b-45a1-a574-df3c4373652d" returned: 0 in 0.348s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-791766e0-83ae-404f-9594-2e93b570c2ab tempest-ProjectReaderTests-1343788438 None] Lock "cinder-quobyte-284e3d8c-068b-45a1-a574-df3c4373652d" released by "delete_volume" :: held 1.015s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:48 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-834c4ebe-876f-439d-891b-900165705870 tempest-CreateVolumesFromSnapshotTest-342642120 None] Created volume successfully. Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-791766e0-83ae-404f-9594-2e93b570c2ab tempest-ProjectReaderTests-1343788438 None] Created reservations ['0d774afd-4ecc-4b3c-bb66-9ceff9f1d423', '2c0de098-17ac-4422-a561-b9383c202ce5', 'cfd56237-6406-4f7a-8ec9-ac58e19ea4ba', '57a68ccb-9299-4a97-b1fa-7d7860ef5e91'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-791766e0-83ae-404f-9594-2e93b570c2ab tempest-ProjectReaderTests-1343788438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-791766e0-83ae-404f-9594-2e93b570c2ab tempest-ProjectReaderTests-1343788438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-791766e0-83ae-404f-9594-2e93b570c2ab tempest-ProjectReaderTests-1343788438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-791766e0-83ae-404f-9594-2e93b570c2ab tempest-ProjectReaderTests-1343788438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-791766e0-83ae-404f-9594-2e93b570c2ab tempest-ProjectReaderTests-1343788438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-791766e0-83ae-404f-9594-2e93b570c2ab tempest-ProjectReaderTests-1343788438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:48 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:31:48 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:49 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c8d9f244-4457-4890-a834-d04e4648c39c tempest-CreateVolumesFromSnapshotTest-342642120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6b78ae6c-5e59-4338-a3b1-419239b79332 1073741824" returned: 0 in 0.635s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:49 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-791766e0-83ae-404f-9594-2e93b570c2ab tempest-ProjectReaderTests-1343788438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.395s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:49 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-791766e0-83ae-404f-9594-2e93b570c2ab tempest-ProjectReaderTests-1343788438 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:31:49 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-791766e0-83ae-404f-9594-2e93b570c2ab tempest-ProjectReaderTests-1343788438 None] Deleted volume successfully. Aug 31 15:31:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c8d9f244-4457-4890-a834-d04e4648c39c tempest-CreateVolumesFromSnapshotTest-342642120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6b78ae6c-5e59-4338-a3b1-419239b79332 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:49 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6b78ae6c-5e59-4338-a3b1-419239b79332 Aug 31 15:31:49 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:49 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-791766e0-83ae-404f-9594-2e93b570c2ab tempest-ProjectReaderTests-1343788438 None] Lock "cinder-284e3d8c-068b-45a1-a574-df3c4373652d-delete_volume" released by "delete_volume" :: held 1.817s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:49 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c8d9f244-4457-4890-a834-d04e4648c39c tempest-CreateVolumesFromSnapshotTest-342642120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6b78ae6c-5e59-4338-a3b1-419239b79332" returned: 0 in 0.309s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:49 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c8d9f244-4457-4890-a834-d04e4648c39c tempest-CreateVolumesFromSnapshotTest-342642120 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:31:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c8d9f244-4457-4890-a834-d04e4648c39c tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1a10d70d-1b8b-40a0-9a1c-166e123369e7 tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.203s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:49 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1a10d70d-1b8b-40a0-9a1c-166e123369e7 tempest-CreateVolumesFromSnapshotTest-342642120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1558395635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27d9d079-2d86-4098-8fbe-b0ed56047210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='681181ea10bc42a4a8ecd9bc15855ed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:31:48Z,use_quota=True,user_id='ff77725e71c0423a937998d14b23f737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:31:49 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-1a10d70d-1b8b-40a0-9a1c-166e123369e7 tempest-CreateVolumesFromSnapshotTest-342642120 None] Creating volume 27d9d079-2d86-4098-8fbe-b0ed56047210 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:31:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1a10d70d-1b8b-40a0-9a1c-166e123369e7 tempest-CreateVolumesFromSnapshotTest-342642120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1a10d70d-1b8b-40a0-9a1c-166e123369e7 tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:49 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1a10d70d-1b8b-40a0-9a1c-166e123369e7 tempest-CreateVolumesFromSnapshotTest-342642120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:31:49 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1a10d70d-1b8b-40a0-9a1c-166e123369e7 tempest-CreateVolumesFromSnapshotTest-342642120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:31:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1a10d70d-1b8b-40a0-9a1c-166e123369e7 tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:49 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1a10d70d-1b8b-40a0-9a1c-166e123369e7 tempest-CreateVolumesFromSnapshotTest-342642120 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:31:49 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-1a10d70d-1b8b-40a0-9a1c-166e123369e7 tempest-CreateVolumesFromSnapshotTest-342642120 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:31:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1a10d70d-1b8b-40a0-9a1c-166e123369e7 tempest-CreateVolumesFromSnapshotTest-342642120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-27d9d079-2d86-4098-8fbe-b0ed56047210 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:49 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c8d9f244-4457-4890-a834-d04e4648c39c tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0d872ac-3629-4ea6-a5d9-aef32cce2fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b78ae6c-5e59-4338-a3b1-419239b79332', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:49 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c8d9f244-4457-4890-a834-d04e4648c39c tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79c2bcfd-9ade-4c13-86f1-1f941760d3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:49 devstack sudo[105820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-27d9d079-2d86-4098-8fbe-b0ed56047210 1073741824 Aug 31 15:31:49 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:49 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-c8d9f244-4457-4890-a834-d04e4648c39c tempest-CreateVolumesFromSnapshotTest-342642120 None] Volume volume-6b78ae6c-5e59-4338-a3b1-419239b79332 (6b78ae6c-5e59-4338-a3b1-419239b79332): created successfully Aug 31 15:31:49 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c8d9f244-4457-4890-a834-d04e4648c39c tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79c2bcfd-9ade-4c13-86f1-1f941760d3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:49 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c8d9f244-4457-4890-a834-d04e4648c39c tempest-CreateVolumesFromSnapshotTest-342642120 None] Flow 'volume_create_manager' (9eaa9925-d383-41fb-8a71-6b95c78c845e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:31:49 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-c8d9f244-4457-4890-a834-d04e4648c39c tempest-CreateVolumesFromSnapshotTest-342642120 None] Created volume successfully. Aug 31 15:31:50 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1a10d70d-1b8b-40a0-9a1c-166e123369e7 tempest-CreateVolumesFromSnapshotTest-342642120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-27d9d079-2d86-4098-8fbe-b0ed56047210 1073741824" returned: 0 in 0.624s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1a10d70d-1b8b-40a0-9a1c-166e123369e7 tempest-CreateVolumesFromSnapshotTest-342642120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-27d9d079-2d86-4098-8fbe-b0ed56047210 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:50 devstack sudo[105828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-27d9d079-2d86-4098-8fbe-b0ed56047210 Aug 31 15:31:50 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:50 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1a10d70d-1b8b-40a0-9a1c-166e123369e7 tempest-CreateVolumesFromSnapshotTest-342642120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-27d9d079-2d86-4098-8fbe-b0ed56047210" returned: 0 in 0.314s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:50 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1a10d70d-1b8b-40a0-9a1c-166e123369e7 tempest-CreateVolumesFromSnapshotTest-342642120 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:31:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1a10d70d-1b8b-40a0-9a1c-166e123369e7 tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7e5bfc8b-8041-4254-8a52-a4c26bd8df8d tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.045s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:50 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-7e5bfc8b-8041-4254-8a52-a4c26bd8df8d tempest-CreateVolumesFromSnapshotTest-342642120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1548768537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=167e24ea-b17a-48b2-b5f3-7783673d83bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='681181ea10bc42a4a8ecd9bc15855ed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:31:48Z,use_quota=True,user_id='ff77725e71c0423a937998d14b23f737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:31:50 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-7e5bfc8b-8041-4254-8a52-a4c26bd8df8d tempest-CreateVolumesFromSnapshotTest-342642120 None] Creating volume 167e24ea-b17a-48b2-b5f3-7783673d83bc {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:31:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7e5bfc8b-8041-4254-8a52-a4c26bd8df8d tempest-CreateVolumesFromSnapshotTest-342642120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7e5bfc8b-8041-4254-8a52-a4c26bd8df8d tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:50 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-7e5bfc8b-8041-4254-8a52-a4c26bd8df8d tempest-CreateVolumesFromSnapshotTest-342642120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:31:50 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-7e5bfc8b-8041-4254-8a52-a4c26bd8df8d tempest-CreateVolumesFromSnapshotTest-342642120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:31:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7e5bfc8b-8041-4254-8a52-a4c26bd8df8d tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:50 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-7e5bfc8b-8041-4254-8a52-a4c26bd8df8d tempest-CreateVolumesFromSnapshotTest-342642120 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:31:50 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-7e5bfc8b-8041-4254-8a52-a4c26bd8df8d tempest-CreateVolumesFromSnapshotTest-342642120 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:31:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7e5bfc8b-8041-4254-8a52-a4c26bd8df8d tempest-CreateVolumesFromSnapshotTest-342642120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-167e24ea-b17a-48b2-b5f3-7783673d83bc 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:50 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-167e24ea-b17a-48b2-b5f3-7783673d83bc 1073741824 Aug 31 15:31:50 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1a10d70d-1b8b-40a0-9a1c-166e123369e7 tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (676f859f-1d85-45e3-9e7b-9d537fe32dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27d9d079-2d86-4098-8fbe-b0ed56047210', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1a10d70d-1b8b-40a0-9a1c-166e123369e7 tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a909ba7f-04c9-4529-a9be-8dc1c96966a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:50 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-1a10d70d-1b8b-40a0-9a1c-166e123369e7 tempest-CreateVolumesFromSnapshotTest-342642120 None] Volume volume-27d9d079-2d86-4098-8fbe-b0ed56047210 (27d9d079-2d86-4098-8fbe-b0ed56047210): created successfully Aug 31 15:31:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1a10d70d-1b8b-40a0-9a1c-166e123369e7 tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a909ba7f-04c9-4529-a9be-8dc1c96966a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:50 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1a10d70d-1b8b-40a0-9a1c-166e123369e7 tempest-CreateVolumesFromSnapshotTest-342642120 None] Flow 'volume_create_manager' (eb325381-e30f-445c-861e-59a36cb9f53f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:31:50 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-1a10d70d-1b8b-40a0-9a1c-166e123369e7 tempest-CreateVolumesFromSnapshotTest-342642120 None] Created volume successfully. Aug 31 15:31:51 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7e5bfc8b-8041-4254-8a52-a4c26bd8df8d tempest-CreateVolumesFromSnapshotTest-342642120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-167e24ea-b17a-48b2-b5f3-7783673d83bc 1073741824" returned: 0 in 0.585s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7e5bfc8b-8041-4254-8a52-a4c26bd8df8d tempest-CreateVolumesFromSnapshotTest-342642120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-167e24ea-b17a-48b2-b5f3-7783673d83bc {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:51 devstack sudo[105837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-167e24ea-b17a-48b2-b5f3-7783673d83bc Aug 31 15:31:51 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:51 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-7e5bfc8b-8041-4254-8a52-a4c26bd8df8d tempest-CreateVolumesFromSnapshotTest-342642120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-167e24ea-b17a-48b2-b5f3-7783673d83bc" returned: 0 in 0.426s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:51 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-7e5bfc8b-8041-4254-8a52-a4c26bd8df8d tempest-CreateVolumesFromSnapshotTest-342642120 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:31:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7e5bfc8b-8041-4254-8a52-a4c26bd8df8d tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:51 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7e5bfc8b-8041-4254-8a52-a4c26bd8df8d tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62099fe1-c4ec-4541-866b-ab3c0963d640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-167e24ea-b17a-48b2-b5f3-7783673d83bc', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:51 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7e5bfc8b-8041-4254-8a52-a4c26bd8df8d tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6ea58e4-68e8-4827-a507-4974508ad984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:51 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-7e5bfc8b-8041-4254-8a52-a4c26bd8df8d tempest-CreateVolumesFromSnapshotTest-342642120 None] Volume volume-167e24ea-b17a-48b2-b5f3-7783673d83bc (167e24ea-b17a-48b2-b5f3-7783673d83bc): created successfully Aug 31 15:31:51 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7e5bfc8b-8041-4254-8a52-a4c26bd8df8d tempest-CreateVolumesFromSnapshotTest-342642120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6ea58e4-68e8-4827-a507-4974508ad984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:51 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7e5bfc8b-8041-4254-8a52-a4c26bd8df8d tempest-CreateVolumesFromSnapshotTest-342642120 None] Flow 'volume_create_manager' (15932056-82f3-419b-b184-77976e30d14f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:31:51 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-7e5bfc8b-8041-4254-8a52-a4c26bd8df8d tempest-CreateVolumesFromSnapshotTest-342642120 None] Created volume successfully. Aug 31 15:31:52 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4b18c308-a212-47df-8a5a-5ca9b1211537 tempest-CreateVolumesFromSnapshotTest-342642120 None] Acquiring lock "cinder-167e24ea-b17a-48b2-b5f3-7783673d83bc-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:52 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4b18c308-a212-47df-8a5a-5ca9b1211537 tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "cinder-167e24ea-b17a-48b2-b5f3-7783673d83bc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:52 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4b18c308-a212-47df-8a5a-5ca9b1211537 tempest-CreateVolumesFromSnapshotTest-342642120 None] Acquiring lock "cinder-quobyte-167e24ea-b17a-48b2-b5f3-7783673d83bc" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:52 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4b18c308-a212-47df-8a5a-5ca9b1211537 tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "cinder-quobyte-167e24ea-b17a-48b2-b5f3-7783673d83bc" acquired by "delete_volume" :: waited 0.028s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:52 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e826be-6ac3-4e87-b9fc-ef259ab5fe5b]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:31:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4b18c308-a212-47df-8a5a-5ca9b1211537 tempest-CreateVolumesFromSnapshotTest-342642120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-167e24ea-b17a-48b2-b5f3-7783673d83bc {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:52 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-167e24ea-b17a-48b2-b5f3-7783673d83bc Aug 31 15:31:52 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:53 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4b18c308-a212-47df-8a5a-5ca9b1211537 tempest-CreateVolumesFromSnapshotTest-342642120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-167e24ea-b17a-48b2-b5f3-7783673d83bc" returned: 0 in 0.542s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4b18c308-a212-47df-8a5a-5ca9b1211537 tempest-CreateVolumesFromSnapshotTest-342642120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-167e24ea-b17a-48b2-b5f3-7783673d83bc {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:53 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-167e24ea-b17a-48b2-b5f3-7783673d83bc Aug 31 15:31:53 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:53 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4b18c308-a212-47df-8a5a-5ca9b1211537 tempest-CreateVolumesFromSnapshotTest-342642120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-167e24ea-b17a-48b2-b5f3-7783673d83bc" returned: 0 in 0.311s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:53 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4b18c308-a212-47df-8a5a-5ca9b1211537 tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "cinder-quobyte-167e24ea-b17a-48b2-b5f3-7783673d83bc" released by "delete_volume" :: held 0.905s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:53 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-4b18c308-a212-47df-8a5a-5ca9b1211537 tempest-CreateVolumesFromSnapshotTest-342642120 None] Created reservations ['2f5267d4-5ebd-4052-808e-9ed5f1e47c3c', '295a5587-3c36-461a-9298-55de702784b4', '145b22a8-6802-421c-8d3d-18c433138d4c', '64c02f21-7791-4963-b17f-e162269d5199'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:31:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4b18c308-a212-47df-8a5a-5ca9b1211537 tempest-CreateVolumesFromSnapshotTest-342642120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4b18c308-a212-47df-8a5a-5ca9b1211537 tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:53 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4b18c308-a212-47df-8a5a-5ca9b1211537 tempest-CreateVolumesFromSnapshotTest-342642120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:31:53 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4b18c308-a212-47df-8a5a-5ca9b1211537 tempest-CreateVolumesFromSnapshotTest-342642120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:31:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4b18c308-a212-47df-8a5a-5ca9b1211537 tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4b18c308-a212-47df-8a5a-5ca9b1211537 tempest-CreateVolumesFromSnapshotTest-342642120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:54 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:31:54 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:54 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5e005701-6729-4495-9527-74c14969f698 tempest-CreateVolumesFromSnapshotTest-342642120 None] Acquiring lock "cinder-27d9d079-2d86-4098-8fbe-b0ed56047210-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:54 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5e005701-6729-4495-9527-74c14969f698 tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "cinder-27d9d079-2d86-4098-8fbe-b0ed56047210-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:54 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5e005701-6729-4495-9527-74c14969f698 tempest-CreateVolumesFromSnapshotTest-342642120 None] Acquiring lock "cinder-quobyte-27d9d079-2d86-4098-8fbe-b0ed56047210" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:54 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5e005701-6729-4495-9527-74c14969f698 tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "cinder-quobyte-27d9d079-2d86-4098-8fbe-b0ed56047210" acquired by "delete_volume" :: waited 0.030s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:54 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f61fb6-5e17-40c2-a7e6-817ccfd048e6]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:31:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5e005701-6729-4495-9527-74c14969f698 tempest-CreateVolumesFromSnapshotTest-342642120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-27d9d079-2d86-4098-8fbe-b0ed56047210 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:54 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4b18c308-a212-47df-8a5a-5ca9b1211537 tempest-CreateVolumesFromSnapshotTest-342642120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.380s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:54 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-4b18c308-a212-47df-8a5a-5ca9b1211537 tempest-CreateVolumesFromSnapshotTest-342642120 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:31:54 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-4b18c308-a212-47df-8a5a-5ca9b1211537 tempest-CreateVolumesFromSnapshotTest-342642120 None] Deleted volume successfully. Aug 31 15:31:54 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4b18c308-a212-47df-8a5a-5ca9b1211537 tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "cinder-167e24ea-b17a-48b2-b5f3-7783673d83bc-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:54 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-27d9d079-2d86-4098-8fbe-b0ed56047210 Aug 31 15:31:54 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:54 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5e005701-6729-4495-9527-74c14969f698 tempest-CreateVolumesFromSnapshotTest-342642120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-27d9d079-2d86-4098-8fbe-b0ed56047210" returned: 0 in 0.545s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5e005701-6729-4495-9527-74c14969f698 tempest-CreateVolumesFromSnapshotTest-342642120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-27d9d079-2d86-4098-8fbe-b0ed56047210 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:54 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-27d9d079-2d86-4098-8fbe-b0ed56047210 Aug 31 15:31:54 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:55 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5e005701-6729-4495-9527-74c14969f698 tempest-CreateVolumesFromSnapshotTest-342642120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-27d9d079-2d86-4098-8fbe-b0ed56047210" returned: 0 in 0.447s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:55 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5e005701-6729-4495-9527-74c14969f698 tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "cinder-quobyte-27d9d079-2d86-4098-8fbe-b0ed56047210" released by "delete_volume" :: held 1.083s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:55 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-5e005701-6729-4495-9527-74c14969f698 tempest-CreateVolumesFromSnapshotTest-342642120 None] Created reservations ['2ed28633-0d0f-4203-967b-205acbcde428', '9a1eec7c-6b88-4178-8fe9-fac8459e2263', 'e7feb1df-5a81-4dde-9ac2-208faa06b120', 'f983257c-3d4b-4835-887e-8a1d57d900ea'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:31:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5e005701-6729-4495-9527-74c14969f698 tempest-CreateVolumesFromSnapshotTest-342642120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5e005701-6729-4495-9527-74c14969f698 tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:55 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5e005701-6729-4495-9527-74c14969f698 tempest-CreateVolumesFromSnapshotTest-342642120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:31:55 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-5e005701-6729-4495-9527-74c14969f698 tempest-CreateVolumesFromSnapshotTest-342642120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:31:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-5e005701-6729-4495-9527-74c14969f698 tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5e005701-6729-4495-9527-74c14969f698 tempest-CreateVolumesFromSnapshotTest-342642120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:55 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:31:55 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:55 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5e005701-6729-4495-9527-74c14969f698 tempest-CreateVolumesFromSnapshotTest-342642120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.322s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:55 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-5e005701-6729-4495-9527-74c14969f698 tempest-CreateVolumesFromSnapshotTest-342642120 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:31:55 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-5e005701-6729-4495-9527-74c14969f698 tempest-CreateVolumesFromSnapshotTest-342642120 None] Deleted volume successfully. Aug 31 15:31:55 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-b00a1e67-0e3f-4d8a-a3da-85771105100e tempest-SnapshotDependencyTests-154934529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:31:55 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b00a1e67-0e3f-4d8a-a3da-85771105100e tempest-SnapshotDependencyTests-154934529 None] Flow 'volume_create_manager' (2f6c2c31-bd66-4e67-a3bb-8385d556fb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:31:55 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b00a1e67-0e3f-4d8a-a3da-85771105100e tempest-SnapshotDependencyTests-154934529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94948589-6c8c-4daa-8cf5-ecc97b28ccb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:55 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5e005701-6729-4495-9527-74c14969f698 tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "cinder-27d9d079-2d86-4098-8fbe-b0ed56047210-delete_volume" released by "delete_volume" :: held 1.855s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b00a1e67-0e3f-4d8a-a3da-85771105100e tempest-SnapshotDependencyTests-154934529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94948589-6c8c-4daa-8cf5-ecc97b28ccb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1538445169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=255cab24-84cc-4bba-b94b-afd866a44ba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1a481312de544eba0845236b9686df7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:31:56Z,use_quota=True,user_id='5d5aafdaebd345149267eb81fb78ad5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b00a1e67-0e3f-4d8a-a3da-85771105100e tempest-SnapshotDependencyTests-154934529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79f980ae-f3f2-4110-a63a-5ed2e23eb3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b00a1e67-0e3f-4d8a-a3da-85771105100e tempest-SnapshotDependencyTests-154934529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79f980ae-f3f2-4110-a63a-5ed2e23eb3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b00a1e67-0e3f-4d8a-a3da-85771105100e tempest-SnapshotDependencyTests-154934529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1c11462-6c14-4338-9f5a-ff27e9e5f5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b00a1e67-0e3f-4d8a-a3da-85771105100e tempest-SnapshotDependencyTests-154934529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1c11462-6c14-4338-9f5a-ff27e9e5f5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '255cab24-84cc-4bba-b94b-afd866a44ba9', 'volume_name': 'volume-255cab24-84cc-4bba-b94b-afd866a44ba9', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b00a1e67-0e3f-4d8a-a3da-85771105100e tempest-SnapshotDependencyTests-154934529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d93c1ba5-3e74-4969-aeb3-2d204735c07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b00a1e67-0e3f-4d8a-a3da-85771105100e tempest-SnapshotDependencyTests-154934529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d93c1ba5-3e74-4969-aeb3-2d204735c07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b00a1e67-0e3f-4d8a-a3da-85771105100e tempest-SnapshotDependencyTests-154934529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edf4e151-c29e-4745-a581-ce24da8cfd36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:56 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-b00a1e67-0e3f-4d8a-a3da-85771105100e tempest-SnapshotDependencyTests-154934529 None] Volume 255cab24-84cc-4bba-b94b-afd866a44ba9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-255cab24-84cc-4bba-b94b-afd866a44ba9', 'volume_size': 1} Aug 31 15:31:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b00a1e67-0e3f-4d8a-a3da-85771105100e tempest-SnapshotDependencyTests-154934529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b00a1e67-0e3f-4d8a-a3da-85771105100e tempest-SnapshotDependencyTests-154934529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-b00a1e67-0e3f-4d8a-a3da-85771105100e tempest-SnapshotDependencyTests-154934529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1538445169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=255cab24-84cc-4bba-b94b-afd866a44ba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1a481312de544eba0845236b9686df7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:31:56Z,use_quota=True,user_id='5d5aafdaebd345149267eb81fb78ad5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:31:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-b00a1e67-0e3f-4d8a-a3da-85771105100e tempest-SnapshotDependencyTests-154934529 None] Creating volume 255cab24-84cc-4bba-b94b-afd866a44ba9 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:31:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b00a1e67-0e3f-4d8a-a3da-85771105100e tempest-SnapshotDependencyTests-154934529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b00a1e67-0e3f-4d8a-a3da-85771105100e tempest-SnapshotDependencyTests-154934529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-b00a1e67-0e3f-4d8a-a3da-85771105100e tempest-SnapshotDependencyTests-154934529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:31:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-b00a1e67-0e3f-4d8a-a3da-85771105100e tempest-SnapshotDependencyTests-154934529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:31:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b00a1e67-0e3f-4d8a-a3da-85771105100e tempest-SnapshotDependencyTests-154934529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-b00a1e67-0e3f-4d8a-a3da-85771105100e tempest-SnapshotDependencyTests-154934529 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:31:56 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-b00a1e67-0e3f-4d8a-a3da-85771105100e tempest-SnapshotDependencyTests-154934529 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:31:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b00a1e67-0e3f-4d8a-a3da-85771105100e tempest-SnapshotDependencyTests-154934529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:56 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9 1073741824 Aug 31 15:31:56 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:56 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-edb4b33f-1524-4363-a616-129f5061bb8f tempest-CreateVolumesFromSnapshotTest-342642120 None] Acquiring lock "cinder-6b78ae6c-5e59-4338-a3b1-419239b79332-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:56 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-edb4b33f-1524-4363-a616-129f5061bb8f tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "cinder-6b78ae6c-5e59-4338-a3b1-419239b79332-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:56 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-edb4b33f-1524-4363-a616-129f5061bb8f tempest-CreateVolumesFromSnapshotTest-342642120 None] Acquiring lock "cinder-quobyte-6b78ae6c-5e59-4338-a3b1-419239b79332" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:56 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-edb4b33f-1524-4363-a616-129f5061bb8f tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "cinder-quobyte-6b78ae6c-5e59-4338-a3b1-419239b79332" acquired by "delete_volume" :: waited 0.019s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:56 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[701f547c-a84c-4bd3-bac1-9d81845bff0c]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:31:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-edb4b33f-1524-4363-a616-129f5061bb8f tempest-CreateVolumesFromSnapshotTest-342642120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6b78ae6c-5e59-4338-a3b1-419239b79332 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:56 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b00a1e67-0e3f-4d8a-a3da-85771105100e tempest-SnapshotDependencyTests-154934529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9 1073741824" returned: 0 in 0.570s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b00a1e67-0e3f-4d8a-a3da-85771105100e tempest-SnapshotDependencyTests-154934529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:56 devstack sudo[105869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9 Aug 31 15:31:56 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:56 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6b78ae6c-5e59-4338-a3b1-419239b79332 Aug 31 15:31:56 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:56 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b00a1e67-0e3f-4d8a-a3da-85771105100e tempest-SnapshotDependencyTests-154934529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9" returned: 0 in 0.295s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:56 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-b00a1e67-0e3f-4d8a-a3da-85771105100e tempest-SnapshotDependencyTests-154934529 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:31:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b00a1e67-0e3f-4d8a-a3da-85771105100e tempest-SnapshotDependencyTests-154934529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:56 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b00a1e67-0e3f-4d8a-a3da-85771105100e tempest-SnapshotDependencyTests-154934529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edf4e151-c29e-4745-a581-ce24da8cfd36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-255cab24-84cc-4bba-b94b-afd866a44ba9', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b00a1e67-0e3f-4d8a-a3da-85771105100e tempest-SnapshotDependencyTests-154934529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47073082-73ef-4190-a102-6f5f4422f3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:31:57 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-b00a1e67-0e3f-4d8a-a3da-85771105100e tempest-SnapshotDependencyTests-154934529 None] Volume volume-255cab24-84cc-4bba-b94b-afd866a44ba9 (255cab24-84cc-4bba-b94b-afd866a44ba9): created successfully Aug 31 15:31:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b00a1e67-0e3f-4d8a-a3da-85771105100e tempest-SnapshotDependencyTests-154934529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47073082-73ef-4190-a102-6f5f4422f3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:31:57 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b00a1e67-0e3f-4d8a-a3da-85771105100e tempest-SnapshotDependencyTests-154934529 None] Flow 'volume_create_manager' (2f6c2c31-bd66-4e67-a3bb-8385d556fb95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:31:57 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-b00a1e67-0e3f-4d8a-a3da-85771105100e tempest-SnapshotDependencyTests-154934529 None] Created volume successfully. Aug 31 15:31:57 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-edb4b33f-1524-4363-a616-129f5061bb8f tempest-CreateVolumesFromSnapshotTest-342642120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6b78ae6c-5e59-4338-a3b1-419239b79332" returned: 0 in 0.582s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-edb4b33f-1524-4363-a616-129f5061bb8f tempest-CreateVolumesFromSnapshotTest-342642120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6b78ae6c-5e59-4338-a3b1-419239b79332 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:57 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6b78ae6c-5e59-4338-a3b1-419239b79332 Aug 31 15:31:57 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:57 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-edb4b33f-1524-4363-a616-129f5061bb8f tempest-CreateVolumesFromSnapshotTest-342642120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-6b78ae6c-5e59-4338-a3b1-419239b79332" returned: 0 in 0.293s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:57 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-edb4b33f-1524-4363-a616-129f5061bb8f tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "cinder-quobyte-6b78ae6c-5e59-4338-a3b1-419239b79332" released by "delete_volume" :: held 0.931s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:57 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-edb4b33f-1524-4363-a616-129f5061bb8f tempest-CreateVolumesFromSnapshotTest-342642120 None] Created reservations ['b372b709-2f95-4c35-95eb-5ff3b64c4470', 'bd303814-247b-4f30-bb84-6eb2dca04181', 'd6a866c9-fbc2-4840-ad02-306e63506998', '5a664a61-8b40-43c3-9992-8f617085424b'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:31:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-edb4b33f-1524-4363-a616-129f5061bb8f tempest-CreateVolumesFromSnapshotTest-342642120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-edb4b33f-1524-4363-a616-129f5061bb8f tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:57 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-edb4b33f-1524-4363-a616-129f5061bb8f tempest-CreateVolumesFromSnapshotTest-342642120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:31:57 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-edb4b33f-1524-4363-a616-129f5061bb8f tempest-CreateVolumesFromSnapshotTest-342642120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:31:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-edb4b33f-1524-4363-a616-129f5061bb8f tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-edb4b33f-1524-4363-a616-129f5061bb8f tempest-CreateVolumesFromSnapshotTest-342642120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:57 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:31:57 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:57 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-edb4b33f-1524-4363-a616-129f5061bb8f tempest-CreateVolumesFromSnapshotTest-342642120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.308s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:57 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-edb4b33f-1524-4363-a616-129f5061bb8f tempest-CreateVolumesFromSnapshotTest-342642120 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:31:57 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-edb4b33f-1524-4363-a616-129f5061bb8f tempest-CreateVolumesFromSnapshotTest-342642120 None] Deleted volume successfully. Aug 31 15:31:57 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-edb4b33f-1524-4363-a616-129f5061bb8f tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "cinder-6b78ae6c-5e59-4338-a3b1-419239b79332-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-76f4cbb0-5850-4fc3-840e-146b57d8f482 tempest-SnapshotDependencyTests-154934529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-76f4cbb0-5850-4fc3-840e-146b57d8f482 tempest-SnapshotDependencyTests-154934529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:58 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-76f4cbb0-5850-4fc3-840e-146b57d8f482 tempest-SnapshotDependencyTests-154934529 None] Creating offline snapshot f5dbe9c9-c77e-4c8b-a5f1-a23ad515ee47 of volume 255cab24-84cc-4bba-b94b-afd866a44ba9 {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:31:58 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c33f60-028a-48b3-ab25-ebd809f1b22a]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:31:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-76f4cbb0-5850-4fc3-840e-146b57d8f482 tempest-SnapshotDependencyTests-154934529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:58 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9 Aug 31 15:31:58 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:58 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-01c4b65a-b168-49f9-b735-08687471a8b2 tempest-CreateVolumesFromSnapshotTest-342642120 None] Acquiring lock "cinder-93b415db-b11e-433a-9dc2-70ce2694b053-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:58 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-76f4cbb0-5850-4fc3-840e-146b57d8f482 tempest-SnapshotDependencyTests-154934529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9" returned: 0 in 0.453s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-76f4cbb0-5850-4fc3-840e-146b57d8f482 tempest-SnapshotDependencyTests-154934529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9.f5dbe9c9-c77e-4c8b-a5f1-a23ad515ee47 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:58 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-01c4b65a-b168-49f9-b735-08687471a8b2 tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "cinder-93b415db-b11e-433a-9dc2-70ce2694b053-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:58 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9.f5dbe9c9-c77e-4c8b-a5f1-a23ad515ee47 1G Aug 31 15:31:58 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:58 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-01c4b65a-b168-49f9-b735-08687471a8b2 tempest-CreateVolumesFromSnapshotTest-342642120 None] Acquiring lock "cinder-quobyte-93b415db-b11e-433a-9dc2-70ce2694b053" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:58 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-01c4b65a-b168-49f9-b735-08687471a8b2 tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "cinder-quobyte-93b415db-b11e-433a-9dc2-70ce2694b053" acquired by "delete_volume" :: waited 0.025s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:31:58 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c709a8-1c10-4902-a8c2-c5c147f99d4b]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:31:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-01c4b65a-b168-49f9-b735-08687471a8b2 tempest-CreateVolumesFromSnapshotTest-342642120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-93b415db-b11e-433a-9dc2-70ce2694b053 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:58 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-93b415db-b11e-433a-9dc2-70ce2694b053 Aug 31 15:31:58 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:59 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-01c4b65a-b168-49f9-b735-08687471a8b2 tempest-CreateVolumesFromSnapshotTest-342642120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-93b415db-b11e-433a-9dc2-70ce2694b053" returned: 0 in 0.401s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-01c4b65a-b168-49f9-b735-08687471a8b2 tempest-CreateVolumesFromSnapshotTest-342642120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-93b415db-b11e-433a-9dc2-70ce2694b053 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:59 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-93b415db-b11e-433a-9dc2-70ce2694b053 Aug 31 15:31:59 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:59 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-76f4cbb0-5850-4fc3-840e-146b57d8f482 tempest-SnapshotDependencyTests-154934529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9.f5dbe9c9-c77e-4c8b-a5f1-a23ad515ee47 1G" returned: 0 in 0.604s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-76f4cbb0-5850-4fc3-840e-146b57d8f482 tempest-SnapshotDependencyTests-154934529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-255cab24-84cc-4bba-b94b-afd866a44ba9 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9.f5dbe9c9-c77e-4c8b-a5f1-a23ad515ee47 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:59 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-255cab24-84cc-4bba-b94b-afd866a44ba9 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9.f5dbe9c9-c77e-4c8b-a5f1-a23ad515ee47 Aug 31 15:31:59 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:59 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-01c4b65a-b168-49f9-b735-08687471a8b2 tempest-CreateVolumesFromSnapshotTest-342642120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-93b415db-b11e-433a-9dc2-70ce2694b053" returned: 0 in 0.262s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:59 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-01c4b65a-b168-49f9-b735-08687471a8b2 tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "cinder-quobyte-93b415db-b11e-433a-9dc2-70ce2694b053" released by "delete_volume" :: held 0.722s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:31:59 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-01c4b65a-b168-49f9-b735-08687471a8b2 tempest-CreateVolumesFromSnapshotTest-342642120 None] Created reservations ['98e85002-9c67-43fe-b3f1-0cc8be37bf06', 'df3d3f53-2a25-461e-a474-29503f0c456c', 'a1273ee8-27ac-4cd0-a778-08a4d548ed51', 'd4f18b2d-00de-45a0-954d-048208dee87b'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:31:59 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-76f4cbb0-5850-4fc3-840e-146b57d8f482 tempest-SnapshotDependencyTests-154934529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-255cab24-84cc-4bba-b94b-afd866a44ba9 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9.f5dbe9c9-c77e-4c8b-a5f1-a23ad515ee47" returned: 0 in 0.325s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:59 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-76f4cbb0-5850-4fc3-840e-146b57d8f482 tempest-SnapshotDependencyTests-154934529 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9.f5dbe9c9-c77e-4c8b-a5f1-a23ad515ee47 is being set with open permissions: ugo+rw Aug 31 15:31:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-76f4cbb0-5850-4fc3-840e-146b57d8f482 tempest-SnapshotDependencyTests-154934529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9.f5dbe9c9-c77e-4c8b-a5f1-a23ad515ee47 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:59 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9.f5dbe9c9-c77e-4c8b-a5f1-a23ad515ee47 Aug 31 15:31:59 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-01c4b65a-b168-49f9-b735-08687471a8b2 tempest-CreateVolumesFromSnapshotTest-342642120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:31:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-01c4b65a-b168-49f9-b735-08687471a8b2 tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:31:59 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-01c4b65a-b168-49f9-b735-08687471a8b2 tempest-CreateVolumesFromSnapshotTest-342642120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:31:59 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-01c4b65a-b168-49f9-b735-08687471a8b2 tempest-CreateVolumesFromSnapshotTest-342642120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:31:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-01c4b65a-b168-49f9-b735-08687471a8b2 tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:31:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-01c4b65a-b168-49f9-b735-08687471a8b2 tempest-CreateVolumesFromSnapshotTest-342642120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:31:59 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:31:59 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:31:59 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Aug 31 15:31:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-76f4cbb0-5850-4fc3-840e-146b57d8f482 tempest-SnapshotDependencyTests-154934529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9.f5dbe9c9-c77e-4c8b-a5f1-a23ad515ee47" returned: 0 in 0.303s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:31:59 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-66031bf0-7828-44d7-bbb0-98ecd7af42eb tempest-CreateVolumesFromSnapshotTest-342642120 None] Acquiring lock "cinder-3444cc66-7922-4cfe-9796-ed429537022c-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:31:59 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-66031bf0-7828-44d7-bbb0-98ecd7af42eb tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "cinder-3444cc66-7922-4cfe-9796-ed429537022c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-76f4cbb0-5850-4fc3-840e-146b57d8f482 tempest-SnapshotDependencyTests-154934529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:00 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-01c4b65a-b168-49f9-b735-08687471a8b2 tempest-CreateVolumesFromSnapshotTest-342642120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.322s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:00 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-01c4b65a-b168-49f9-b735-08687471a8b2 tempest-CreateVolumesFromSnapshotTest-342642120 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:32:00 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9.info Aug 31 15:32:00 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-66031bf0-7828-44d7-bbb0-98ecd7af42eb tempest-CreateVolumesFromSnapshotTest-342642120 None] Acquiring lock "cinder-quobyte-3444cc66-7922-4cfe-9796-ed429537022c" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:00 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-01c4b65a-b168-49f9-b735-08687471a8b2 tempest-CreateVolumesFromSnapshotTest-342642120 None] Deleted volume successfully. Aug 31 15:32:00 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:00 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-01c4b65a-b168-49f9-b735-08687471a8b2 tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "cinder-93b415db-b11e-433a-9dc2-70ce2694b053-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:00 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-66031bf0-7828-44d7-bbb0-98ecd7af42eb tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "cinder-quobyte-3444cc66-7922-4cfe-9796-ed429537022c" acquired by "delete_volume" :: waited 0.046s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:00 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a322fb51-471c-44e4-bb40-ecf36d2de44d]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:32:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-66031bf0-7828-44d7-bbb0-98ecd7af42eb tempest-CreateVolumesFromSnapshotTest-342642120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3444cc66-7922-4cfe-9796-ed429537022c {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:00 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3444cc66-7922-4cfe-9796-ed429537022c Aug 31 15:32:00 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:00 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-76f4cbb0-5850-4fc3-840e-146b57d8f482 tempest-SnapshotDependencyTests-154934529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9.info" returned: 0 in 0.367s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:00 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-76f4cbb0-5850-4fc3-840e-146b57d8f482 tempest-SnapshotDependencyTests-154934529 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9.info is being set with open permissions: ugo+rw Aug 31 15:32:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-76f4cbb0-5850-4fc3-840e-146b57d8f482 tempest-SnapshotDependencyTests-154934529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:00 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9.info Aug 31 15:32:00 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:00 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-66031bf0-7828-44d7-bbb0-98ecd7af42eb tempest-CreateVolumesFromSnapshotTest-342642120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3444cc66-7922-4cfe-9796-ed429537022c" returned: 0 in 0.449s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-66031bf0-7828-44d7-bbb0-98ecd7af42eb tempest-CreateVolumesFromSnapshotTest-342642120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3444cc66-7922-4cfe-9796-ed429537022c {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:00 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3444cc66-7922-4cfe-9796-ed429537022c Aug 31 15:32:00 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:00 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-76f4cbb0-5850-4fc3-840e-146b57d8f482 tempest-SnapshotDependencyTests-154934529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9.info" returned: 0 in 0.311s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-76f4cbb0-5850-4fc3-840e-146b57d8f482 tempest-SnapshotDependencyTests-154934529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.503s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:00 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-76f4cbb0-5850-4fc3-840e-146b57d8f482 tempest-SnapshotDependencyTests-154934529 None] Create snapshot completed successfully Aug 31 15:32:00 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-66031bf0-7828-44d7-bbb0-98ecd7af42eb tempest-CreateVolumesFromSnapshotTest-342642120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-3444cc66-7922-4cfe-9796-ed429537022c" returned: 0 in 0.301s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:00 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-66031bf0-7828-44d7-bbb0-98ecd7af42eb tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "cinder-quobyte-3444cc66-7922-4cfe-9796-ed429537022c" released by "delete_volume" :: held 0.797s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:00 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-66031bf0-7828-44d7-bbb0-98ecd7af42eb tempest-CreateVolumesFromSnapshotTest-342642120 None] Created reservations ['ca1a30da-5e70-4e1d-8ee2-c8edcb7b08d1', 'cfe2b0e1-cdee-4da5-86a7-aaac04b8a772', '5d359573-d352-4e8c-b3bc-cf89b34e37b0', '789ff316-9435-4298-bd1e-2d70c2124150'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:32:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-66031bf0-7828-44d7-bbb0-98ecd7af42eb tempest-CreateVolumesFromSnapshotTest-342642120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-66031bf0-7828-44d7-bbb0-98ecd7af42eb tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:01 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-66031bf0-7828-44d7-bbb0-98ecd7af42eb tempest-CreateVolumesFromSnapshotTest-342642120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:32:01 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-66031bf0-7828-44d7-bbb0-98ecd7af42eb tempest-CreateVolumesFromSnapshotTest-342642120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:32:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-66031bf0-7828-44d7-bbb0-98ecd7af42eb tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-66031bf0-7828-44d7-bbb0-98ecd7af42eb tempest-CreateVolumesFromSnapshotTest-342642120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:01 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:32:01 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:01 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a0f90cd5-f207-4fa8-8847-063189563088 tempest-CreateVolumesFromSnapshotTest-342642120 None] Acquiring lock "cinder-79b063be-dfd9-4322-a2cb-a4be5c21945d-delete_snapshot" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:01 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a0f90cd5-f207-4fa8-8847-063189563088 tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "cinder-79b063be-dfd9-4322-a2cb-a4be5c21945d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:01 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a0f90cd5-f207-4fa8-8847-063189563088 tempest-CreateVolumesFromSnapshotTest-342642120 None] Acquiring lock "cinder-quobyte-afaddc4c-9e8b-4a84-a90e-766c4d6d6986" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:01 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a0f90cd5-f207-4fa8-8847-063189563088 tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "cinder-quobyte-afaddc4c-9e8b-4a84-a90e-766c4d6d6986" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:01 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a0f90cd5-f207-4fa8-8847-063189563088 tempest-CreateVolumesFromSnapshotTest-342642120 None] Acquiring lock "cinder-quobyte-79b063be-dfd9-4322-a2cb-a4be5c21945d" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:01 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a0f90cd5-f207-4fa8-8847-063189563088 tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "cinder-quobyte-79b063be-dfd9-4322-a2cb-a4be5c21945d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:01 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-a0f90cd5-f207-4fa8-8847-063189563088 tempest-CreateVolumesFromSnapshotTest-342642120 None] Deleting offline snapshot 79b063be-dfd9-4322-a2cb-a4be5c21945d of volume afaddc4c-9e8b-4a84-a90e-766c4d6d6986 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:32:01 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-a0f90cd5-f207-4fa8-8847-063189563088 tempest-CreateVolumesFromSnapshotTest-342642120 None] snapshot_file for this snap is: volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986.79b063be-dfd9-4322-a2cb-a4be5c21945d {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:32:01 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[30aef40b-721a-4ec5-986f-875432ab709f]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:32:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a0f90cd5-f207-4fa8-8847-063189563088 tempest-CreateVolumesFromSnapshotTest-342642120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986.79b063be-dfd9-4322-a2cb-a4be5c21945d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:01 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-66031bf0-7828-44d7-bbb0-98ecd7af42eb tempest-CreateVolumesFromSnapshotTest-342642120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.388s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:01 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-66031bf0-7828-44d7-bbb0-98ecd7af42eb tempest-CreateVolumesFromSnapshotTest-342642120 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:32:01 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-66031bf0-7828-44d7-bbb0-98ecd7af42eb tempest-CreateVolumesFromSnapshotTest-342642120 None] Deleted volume successfully. Aug 31 15:32:01 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-66031bf0-7828-44d7-bbb0-98ecd7af42eb tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "cinder-3444cc66-7922-4cfe-9796-ed429537022c-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:01 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986.79b063be-dfd9-4322-a2cb-a4be5c21945d Aug 31 15:32:01 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:01 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a0f90cd5-f207-4fa8-8847-063189563088 tempest-CreateVolumesFromSnapshotTest-342642120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986.79b063be-dfd9-4322-a2cb-a4be5c21945d" returned: 0 in 0.439s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:01 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-a0f90cd5-f207-4fa8-8847-063189563088 tempest-CreateVolumesFromSnapshotTest-342642120 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:32:01 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d76458a-c846-475f-b1c3-c269253fa524]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:32:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a0f90cd5-f207-4fa8-8847-063189563088 tempest-CreateVolumesFromSnapshotTest-342642120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:01 devstack sudo[105935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986 Aug 31 15:32:01 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:02 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:32:02 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Flow 'volume_create_manager' (e8ceb239-bfcf-4ecd-a560-800a0ef7fd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:32:02 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cd0f86d-4287-4938-a56e-eecfaa2f33d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:02 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cd0f86d-4287-4938-a56e-eecfaa2f33d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33747dee-54f0-4cd8-ab9d-49ade4dddcd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1a481312de544eba0845236b9686df7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f5dbe9c9-c77e-4c8b-a5f1-a23ad515ee47,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:32:02Z,use_quota=True,user_id='5d5aafdaebd345149267eb81fb78ad5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:02 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92689e2c-8536-4761-b215-f6d6eb7e2034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:02 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92689e2c-8536-4761-b215-f6d6eb7e2034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:02 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d2dddc4-3745-480c-bbc6-198050350eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:02 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d2dddc4-3745-480c-bbc6-198050350eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '33747dee-54f0-4cd8-ab9d-49ade4dddcd6', 'volume_name': 'volume-33747dee-54f0-4cd8-ab9d-49ade4dddcd6', 'volume_size': 1, 'snapshot_id': 'f5dbe9c9-c77e-4c8b-a5f1-a23ad515ee47'}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:02 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5595cc70-78fe-48f8-a826-1fab88cddaaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:02 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5595cc70-78fe-48f8-a826-1fab88cddaaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:02 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:02 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dd79101-871c-493e-ad5e-04545173213a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:02 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Volume 33747dee-54f0-4cd8-ab9d-49ade4dddcd6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-33747dee-54f0-4cd8-ab9d-49ade4dddcd6', 'volume_size': 1, 'snapshot_id': 'f5dbe9c9-c77e-4c8b-a5f1-a23ad515ee47'} Aug 31 15:32:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a0f90cd5-f207-4fa8-8847-063189563088 tempest-CreateVolumesFromSnapshotTest-342642120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986" returned: 0 in 0.431s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a0f90cd5-f207-4fa8-8847-063189563088 tempest-CreateVolumesFromSnapshotTest-342642120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986.79b063be-dfd9-4322-a2cb-a4be5c21945d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:02 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Acquiring lock "cinder-quobyte-f5dbe9c9-c77e-4c8b-a5f1-a23ad515ee47-33747dee-54f0-4cd8-ab9d-49ade4dddcd6" by "_create_volume_from_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:02 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986.79b063be-dfd9-4322-a2cb-a4be5c21945d Aug 31 15:32:02 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:02 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Lock "cinder-quobyte-f5dbe9c9-c77e-4c8b-a5f1-a23ad515ee47-33747dee-54f0-4cd8-ab9d-49ade4dddcd6" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:02 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Creating volume 33747dee-54f0-4cd8-ab9d-49ade4dddcd6 from snapshot f5dbe9c9-c77e-4c8b-a5f1-a23ad515ee47 {{(pid=86000) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 31 15:32:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:02 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:32:02 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:32:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:02 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:32:02 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Acquiring lock "cinder-quobyte-33747dee-54f0-4cd8-ab9d-49ade4dddcd6" by "_copy_volume_from_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:02 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Lock "cinder-quobyte-33747dee-54f0-4cd8-ab9d-49ade4dddcd6" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:02 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] snapshot: f5dbe9c9-c77e-4c8b-a5f1-a23ad515ee47, volume: 33747dee-54f0-4cd8-ab9d-49ade4dddcd6, {{(pid=86000) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 31 15:32:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:02 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:32:02 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:32:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:02 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9994a301-b335-4677-94b5-834b411f500e]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:32:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9.f5dbe9c9-c77e-4c8b-a5f1-a23ad515ee47 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:02 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9.f5dbe9c9-c77e-4c8b-a5f1-a23ad515ee47 Aug 31 15:32:02 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:02 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a0f90cd5-f207-4fa8-8847-063189563088 tempest-CreateVolumesFromSnapshotTest-342642120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986.79b063be-dfd9-4322-a2cb-a4be5c21945d" returned: 0 in 0.435s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a0f90cd5-f207-4fa8-8847-063189563088 tempest-CreateVolumesFromSnapshotTest-342642120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986.79b063be-dfd9-4322-a2cb-a4be5c21945d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:02 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986.79b063be-dfd9-4322-a2cb-a4be5c21945d Aug 31 15:32:02 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:02 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9.f5dbe9c9-c77e-4c8b-a5f1-a23ad515ee47" returned: 0 in 0.464s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:02 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-255cab24-84cc-4bba-b94b-afd866a44ba9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:32:02 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec1aeb5-3cb2-4842-b92e-47e5da1530e5]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:32:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:03 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9 Aug 31 15:32:03 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:03 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a0f90cd5-f207-4fa8-8847-063189563088 tempest-CreateVolumesFromSnapshotTest-342642120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986.79b063be-dfd9-4322-a2cb-a4be5c21945d" returned: 0 in 0.359s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:03 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a0f90cd5-f207-4fa8-8847-063189563088 tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "cinder-quobyte-79b063be-dfd9-4322-a2cb-a4be5c21945d" released by "_delete_snapshot" :: held 1.815s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:03 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a0f90cd5-f207-4fa8-8847-063189563088 tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "cinder-quobyte-afaddc4c-9e8b-4a84-a90e-766c4d6d6986" released by "delete_snapshot" :: held 1.849s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:03 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-a0f90cd5-f207-4fa8-8847-063189563088 tempest-CreateVolumesFromSnapshotTest-342642120 None] Created reservations ['f9854fa9-777d-4267-9759-c7b686e295dc', '60bbdb01-d3c1-4e79-bd76-194045350ac7', 'b508e1c1-0d9b-4a16-a713-1b9fc483be8e', '692af7df-5fac-4276-a435-8b5ac6eabcc5'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:32:03 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-a0f90cd5-f207-4fa8-8847-063189563088 tempest-CreateVolumesFromSnapshotTest-342642120 None] Delete snapshot completed successfully. Aug 31 15:32:03 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a0f90cd5-f207-4fa8-8847-063189563088 tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "cinder-79b063be-dfd9-4322-a2cb-a4be5c21945d-delete_snapshot" released by "delete_snapshot" :: held 2.049s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:03 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:03 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b2868284-024b-4974-b94e-7b236de6382c tempest-CreateVolumesFromSnapshotTest-342642120 None] Acquiring lock "cinder-afaddc4c-9e8b-4a84-a90e-766c4d6d6986-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9" returned: 0 in 0.551s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:03 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9 {{(pid=86000) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 31 15:32:03 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Creating direct copy from snapshot {{(pid=86000) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 31 15:32:03 devstack cinder-volume[86000]: DEBUG cinder.utils [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Path /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-33747dee-54f0-4cd8-ab9d-49ade4dddcd6 not found in is_blk_device check {{(pid=86000) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 31 15:32:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-33747dee-54f0-4cd8-ab9d-49ade4dddcd6 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:03 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b2868284-024b-4974-b94e-7b236de6382c tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "cinder-afaddc4c-9e8b-4a84-a90e-766c4d6d6986-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:03 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-33747dee-54f0-4cd8-ab9d-49ade4dddcd6 Aug 31 15:32:03 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:03 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b2868284-024b-4974-b94e-7b236de6382c tempest-CreateVolumesFromSnapshotTest-342642120 None] Acquiring lock "cinder-quobyte-afaddc4c-9e8b-4a84-a90e-766c4d6d6986" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:03 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b2868284-024b-4974-b94e-7b236de6382c tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "cinder-quobyte-afaddc4c-9e8b-4a84-a90e-766c4d6d6986" acquired by "delete_volume" :: waited 0.020s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:03 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db25297-c9b3-4c66-91fe-cf8a9c0a6964]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:32:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b2868284-024b-4974-b94e-7b236de6382c tempest-CreateVolumesFromSnapshotTest-342642120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:03 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986 Aug 31 15:32:03 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:04 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b2868284-024b-4974-b94e-7b236de6382c tempest-CreateVolumesFromSnapshotTest-342642120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986" returned: 0 in 0.464s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b2868284-024b-4974-b94e-7b236de6382c tempest-CreateVolumesFromSnapshotTest-342642120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:04 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986 Aug 31 15:32:04 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:04 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b2868284-024b-4974-b94e-7b236de6382c tempest-CreateVolumesFromSnapshotTest-342642120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-afaddc4c-9e8b-4a84-a90e-766c4d6d6986" returned: 0 in 0.531s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:04 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b2868284-024b-4974-b94e-7b236de6382c tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "cinder-quobyte-afaddc4c-9e8b-4a84-a90e-766c4d6d6986" released by "delete_volume" :: held 1.095s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:04 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-b2868284-024b-4974-b94e-7b236de6382c tempest-CreateVolumesFromSnapshotTest-342642120 None] Created reservations ['dc131ed5-70b9-43b5-ac9f-fed72a816e9f', 'acb67ccf-6574-4155-b945-eb997d331bb5', 'd3fefa1f-abc2-4fb5-9e75-24df833c6547', 'f97597b3-f2f3-4dd8-8443-4db9560f3685'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:32:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b2868284-024b-4974-b94e-7b236de6382c tempest-CreateVolumesFromSnapshotTest-342642120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b2868284-024b-4974-b94e-7b236de6382c tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:05 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-b2868284-024b-4974-b94e-7b236de6382c tempest-CreateVolumesFromSnapshotTest-342642120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:32:05 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-b2868284-024b-4974-b94e-7b236de6382c tempest-CreateVolumesFromSnapshotTest-342642120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:32:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b2868284-024b-4974-b94e-7b236de6382c tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b2868284-024b-4974-b94e-7b236de6382c tempest-CreateVolumesFromSnapshotTest-342642120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:05 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:32:05 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:05 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b2868284-024b-4974-b94e-7b236de6382c tempest-CreateVolumesFromSnapshotTest-342642120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.616s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:05 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-b2868284-024b-4974-b94e-7b236de6382c tempest-CreateVolumesFromSnapshotTest-342642120 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:32:05 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-b2868284-024b-4974-b94e-7b236de6382c tempest-CreateVolumesFromSnapshotTest-342642120 None] Deleted volume successfully. Aug 31 15:32:05 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b2868284-024b-4974-b94e-7b236de6382c tempest-CreateVolumesFromSnapshotTest-342642120 None] Lock "cinder-afaddc4c-9e8b-4a84-a90e-766c4d6d6986-delete_volume" released by "delete_volume" :: held 2.381s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:09 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-33747dee-54f0-4cd8-ab9d-49ade4dddcd6" returned: 0 in 5.965s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:09 devstack cinder-volume[86000]: DEBUG cinder.image.image_utils [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9, size 1024.00 MB, duration 5.97 sec, destination /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-33747dee-54f0-4cd8-ab9d-49ade4dddcd6 {{(pid=86000) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 31 15:32:09 devstack cinder-volume[86000]: INFO cinder.image.image_utils [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Converted 1024.00 MB image at 171.62 MB/s Aug 31 15:32:09 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-33747dee-54f0-4cd8-ab9d-49ade4dddcd6 is being set with open permissions: ugo+rw Aug 31 15:32:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-33747dee-54f0-4cd8-ab9d-49ade4dddcd6 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:09 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-33747dee-54f0-4cd8-ab9d-49ade4dddcd6 Aug 31 15:32:09 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:09 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-33747dee-54f0-4cd8-ab9d-49ade4dddcd6" returned: 0 in 0.288s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:09 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Lock "cinder-quobyte-33747dee-54f0-4cd8-ab9d-49ade4dddcd6" released by "_copy_volume_from_snapshot" :: held 7.389s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:09 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-a33c19a5-682f-48ba-8854-81f945ae0b07 tempest-ProjectReaderTests-1610880033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:32:09 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-a33c19a5-682f-48ba-8854-81f945ae0b07 tempest-ProjectReaderTests-1610880033 None] Flow 'volume_create_manager' (d8bbc639-f5b1-4183-aef6-3abe4be01f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:32:09 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-a33c19a5-682f-48ba-8854-81f945ae0b07 tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16c6bcb4-917a-4a70-8123-d8e4f56e6dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:09 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-a33c19a5-682f-48ba-8854-81f945ae0b07 tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16c6bcb4-917a-4a70-8123-d8e4f56e6dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1520416116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee05a99c-7518-4078-b23f-43d264c994c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b79b15895b454e8da3933af1bc11e4f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:32:10Z,use_quota=True,user_id='bc7ede8772e44e959581ef3ee880baf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:09 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-a33c19a5-682f-48ba-8854-81f945ae0b07 tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dc29814-2124-4ea5-a47f-1de6d160f263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:09 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-a33c19a5-682f-48ba-8854-81f945ae0b07 tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dc29814-2124-4ea5-a47f-1de6d160f263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:09 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-a33c19a5-682f-48ba-8854-81f945ae0b07 tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4778c55f-b7af-4369-9bf5-c424299e41c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:09 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-a33c19a5-682f-48ba-8854-81f945ae0b07 tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4778c55f-b7af-4369-9bf5-c424299e41c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee05a99c-7518-4078-b23f-43d264c994c4', 'volume_name': 'volume-ee05a99c-7518-4078-b23f-43d264c994c4', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:09 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-a33c19a5-682f-48ba-8854-81f945ae0b07 tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (774ec287-eb74-43b6-839d-7b01b3431171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:09 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-a33c19a5-682f-48ba-8854-81f945ae0b07 tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (774ec287-eb74-43b6-839d-7b01b3431171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:09 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-a33c19a5-682f-48ba-8854-81f945ae0b07 tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba41d53f-ef9e-4a38-9411-af30572b319f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:09 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-a33c19a5-682f-48ba-8854-81f945ae0b07 tempest-ProjectReaderTests-1610880033 None] Volume ee05a99c-7518-4078-b23f-43d264c994c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee05a99c-7518-4078-b23f-43d264c994c4', 'volume_size': 1} Aug 31 15:32:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-a33c19a5-682f-48ba-8854-81f945ae0b07 tempest-ProjectReaderTests-1610880033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:09 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Lock "cinder-quobyte-f5dbe9c9-c77e-4c8b-a5f1-a23ad515ee47-33747dee-54f0-4cd8-ab9d-49ade4dddcd6" released by "_create_volume_from_snapshot" :: held 7.549s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.576s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-a33c19a5-682f-48ba-8854-81f945ae0b07 tempest-ProjectReaderTests-1610880033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.034s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:09 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-a33c19a5-682f-48ba-8854-81f945ae0b07 tempest-ProjectReaderTests-1610880033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1520416116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee05a99c-7518-4078-b23f-43d264c994c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b79b15895b454e8da3933af1bc11e4f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:32:10Z,use_quota=True,user_id='bc7ede8772e44e959581ef3ee880baf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:32:09 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-a33c19a5-682f-48ba-8854-81f945ae0b07 tempest-ProjectReaderTests-1610880033 None] Creating volume ee05a99c-7518-4078-b23f-43d264c994c4 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:32:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-a33c19a5-682f-48ba-8854-81f945ae0b07 tempest-ProjectReaderTests-1610880033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-a33c19a5-682f-48ba-8854-81f945ae0b07 tempest-ProjectReaderTests-1610880033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:09 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-a33c19a5-682f-48ba-8854-81f945ae0b07 tempest-ProjectReaderTests-1610880033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:32:09 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-a33c19a5-682f-48ba-8854-81f945ae0b07 tempest-ProjectReaderTests-1610880033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:32:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-a33c19a5-682f-48ba-8854-81f945ae0b07 tempest-ProjectReaderTests-1610880033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:09 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-a33c19a5-682f-48ba-8854-81f945ae0b07 tempest-ProjectReaderTests-1610880033 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:32:09 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-a33c19a5-682f-48ba-8854-81f945ae0b07 tempest-ProjectReaderTests-1610880033 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:32:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a33c19a5-682f-48ba-8854-81f945ae0b07 tempest-ProjectReaderTests-1610880033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ee05a99c-7518-4078-b23f-43d264c994c4 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:09 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ee05a99c-7518-4078-b23f-43d264c994c4 1073741824 Aug 31 15:32:09 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:09 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dd79101-871c-493e-ad5e-04545173213a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33747dee-54f0-4cd8-ab9d-49ade4dddcd6', 'volume_size': 1, 'snapshot_id': 'f5dbe9c9-c77e-4c8b-a5f1-a23ad515ee47'}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:09 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3d5c0a5-086a-474e-97fe-fb0f6d03005c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:09 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Volume volume-33747dee-54f0-4cd8-ab9d-49ade4dddcd6 (33747dee-54f0-4cd8-ab9d-49ade4dddcd6): created successfully Aug 31 15:32:09 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3d5c0a5-086a-474e-97fe-fb0f6d03005c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:09 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Flow 'volume_create_manager' (e8ceb239-bfcf-4ecd-a560-800a0ef7fd11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:32:09 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-db4b3888-e9f8-47db-9b82-759d2d199c3e tempest-SnapshotDependencyTests-154934529 None] Created volume successfully. Aug 31 15:32:10 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a33c19a5-682f-48ba-8854-81f945ae0b07 tempest-ProjectReaderTests-1610880033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ee05a99c-7518-4078-b23f-43d264c994c4 1073741824" returned: 0 in 0.461s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a33c19a5-682f-48ba-8854-81f945ae0b07 tempest-ProjectReaderTests-1610880033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ee05a99c-7518-4078-b23f-43d264c994c4 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:10 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ee05a99c-7518-4078-b23f-43d264c994c4 Aug 31 15:32:10 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:10 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a33c19a5-682f-48ba-8854-81f945ae0b07 tempest-ProjectReaderTests-1610880033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ee05a99c-7518-4078-b23f-43d264c994c4" returned: 0 in 0.239s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:10 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-a33c19a5-682f-48ba-8854-81f945ae0b07 tempest-ProjectReaderTests-1610880033 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:32:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-a33c19a5-682f-48ba-8854-81f945ae0b07 tempest-ProjectReaderTests-1610880033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:10 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-a33c19a5-682f-48ba-8854-81f945ae0b07 tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba41d53f-ef9e-4a38-9411-af30572b319f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee05a99c-7518-4078-b23f-43d264c994c4', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:10 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-a33c19a5-682f-48ba-8854-81f945ae0b07 tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88a362dc-448d-46fa-8a44-76ef43c3e32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:10 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-a33c19a5-682f-48ba-8854-81f945ae0b07 tempest-ProjectReaderTests-1610880033 None] Volume volume-ee05a99c-7518-4078-b23f-43d264c994c4 (ee05a99c-7518-4078-b23f-43d264c994c4): created successfully Aug 31 15:32:10 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-a33c19a5-682f-48ba-8854-81f945ae0b07 tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88a362dc-448d-46fa-8a44-76ef43c3e32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:10 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-a33c19a5-682f-48ba-8854-81f945ae0b07 tempest-ProjectReaderTests-1610880033 None] Flow 'volume_create_manager' (d8bbc639-f5b1-4183-aef6-3abe4be01f71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:32:10 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-a33c19a5-682f-48ba-8854-81f945ae0b07 tempest-ProjectReaderTests-1610880033 None] Created volume successfully. Aug 31 15:32:11 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a38fe3f0-cb32-474c-a6f1-252bd50c0f55 tempest-SnapshotDependencyTests-154934529 None] Acquiring lock "cinder-f5dbe9c9-c77e-4c8b-a5f1-a23ad515ee47-delete_snapshot" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:11 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a38fe3f0-cb32-474c-a6f1-252bd50c0f55 tempest-SnapshotDependencyTests-154934529 None] Lock "cinder-f5dbe9c9-c77e-4c8b-a5f1-a23ad515ee47-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:11 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a38fe3f0-cb32-474c-a6f1-252bd50c0f55 tempest-SnapshotDependencyTests-154934529 None] Acquiring lock "cinder-quobyte-255cab24-84cc-4bba-b94b-afd866a44ba9" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:11 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a38fe3f0-cb32-474c-a6f1-252bd50c0f55 tempest-SnapshotDependencyTests-154934529 None] Lock "cinder-quobyte-255cab24-84cc-4bba-b94b-afd866a44ba9" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:11 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a38fe3f0-cb32-474c-a6f1-252bd50c0f55 tempest-SnapshotDependencyTests-154934529 None] Acquiring lock "cinder-quobyte-f5dbe9c9-c77e-4c8b-a5f1-a23ad515ee47" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:11 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a38fe3f0-cb32-474c-a6f1-252bd50c0f55 tempest-SnapshotDependencyTests-154934529 None] Lock "cinder-quobyte-f5dbe9c9-c77e-4c8b-a5f1-a23ad515ee47" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:11 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-a38fe3f0-cb32-474c-a6f1-252bd50c0f55 tempest-SnapshotDependencyTests-154934529 None] Deleting offline snapshot f5dbe9c9-c77e-4c8b-a5f1-a23ad515ee47 of volume 255cab24-84cc-4bba-b94b-afd866a44ba9 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:32:11 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-a38fe3f0-cb32-474c-a6f1-252bd50c0f55 tempest-SnapshotDependencyTests-154934529 None] snapshot_file for this snap is: volume-255cab24-84cc-4bba-b94b-afd866a44ba9.f5dbe9c9-c77e-4c8b-a5f1-a23ad515ee47 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:32:11 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d2037d-de6e-4619-b1aa-e42189dd1708]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:32:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a38fe3f0-cb32-474c-a6f1-252bd50c0f55 tempest-SnapshotDependencyTests-154934529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9.f5dbe9c9-c77e-4c8b-a5f1-a23ad515ee47 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:11 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9.f5dbe9c9-c77e-4c8b-a5f1-a23ad515ee47 Aug 31 15:32:11 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:11 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a38fe3f0-cb32-474c-a6f1-252bd50c0f55 tempest-SnapshotDependencyTests-154934529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9.f5dbe9c9-c77e-4c8b-a5f1-a23ad515ee47" returned: 0 in 0.367s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:11 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-a38fe3f0-cb32-474c-a6f1-252bd50c0f55 tempest-SnapshotDependencyTests-154934529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-255cab24-84cc-4bba-b94b-afd866a44ba9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:32:11 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c88ecfb-bc32-4384-a039-e3bc8b06f697]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:32:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a38fe3f0-cb32-474c-a6f1-252bd50c0f55 tempest-SnapshotDependencyTests-154934529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:11 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9 Aug 31 15:32:11 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:11 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-55804477-22a7-472f-acd4-65dd48209476 tempest-ProjectMemberTests-359761515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:32:11 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-55804477-22a7-472f-acd4-65dd48209476 tempest-ProjectMemberTests-359761515 None] Flow 'volume_create_manager' (5150e614-5b9c-4762-b68a-d9816ee5ca21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:32:11 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-55804477-22a7-472f-acd4-65dd48209476 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7260385a-f278-4295-b878-220d304cf960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:11 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-55804477-22a7-472f-acd4-65dd48209476 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7260385a-f278-4295-b878-220d304cf960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-591375469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e58dc11-0e53-4ea4-b297-6e1899196480,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1295f7809aa42af91604752ca7d0e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:32:12Z,use_quota=True,user_id='34bfe6cbc4544a40ad4b64e91c8b0d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:11 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-55804477-22a7-472f-acd4-65dd48209476 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7b56ebe-84a7-4f67-b677-f95d3a6a5b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:11 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-55804477-22a7-472f-acd4-65dd48209476 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7b56ebe-84a7-4f67-b677-f95d3a6a5b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:11 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-55804477-22a7-472f-acd4-65dd48209476 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1137ec22-09d2-4e4a-a28f-5053154892a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:11 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-55804477-22a7-472f-acd4-65dd48209476 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1137ec22-09d2-4e4a-a28f-5053154892a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e58dc11-0e53-4ea4-b297-6e1899196480', 'volume_name': 'volume-7e58dc11-0e53-4ea4-b297-6e1899196480', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:11 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-55804477-22a7-472f-acd4-65dd48209476 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d9ad25e-95cc-4ae3-8d75-3cb04d77fe26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:11 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-55804477-22a7-472f-acd4-65dd48209476 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d9ad25e-95cc-4ae3-8d75-3cb04d77fe26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:11 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-55804477-22a7-472f-acd4-65dd48209476 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9fe5777-103b-492f-b507-b83427f03910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:11 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-55804477-22a7-472f-acd4-65dd48209476 tempest-ProjectMemberTests-359761515 None] Volume 7e58dc11-0e53-4ea4-b297-6e1899196480: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e58dc11-0e53-4ea4-b297-6e1899196480', 'volume_size': 1} Aug 31 15:32:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-55804477-22a7-472f-acd4-65dd48209476 tempest-ProjectMemberTests-359761515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-55804477-22a7-472f-acd4-65dd48209476 tempest-ProjectMemberTests-359761515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:11 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-55804477-22a7-472f-acd4-65dd48209476 tempest-ProjectMemberTests-359761515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-591375469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e58dc11-0e53-4ea4-b297-6e1899196480,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1295f7809aa42af91604752ca7d0e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:32:12Z,use_quota=True,user_id='34bfe6cbc4544a40ad4b64e91c8b0d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:32:11 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-55804477-22a7-472f-acd4-65dd48209476 tempest-ProjectMemberTests-359761515 None] Creating volume 7e58dc11-0e53-4ea4-b297-6e1899196480 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:32:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-55804477-22a7-472f-acd4-65dd48209476 tempest-ProjectMemberTests-359761515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-55804477-22a7-472f-acd4-65dd48209476 tempest-ProjectMemberTests-359761515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:11 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-55804477-22a7-472f-acd4-65dd48209476 tempest-ProjectMemberTests-359761515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:32:11 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-55804477-22a7-472f-acd4-65dd48209476 tempest-ProjectMemberTests-359761515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:32:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-55804477-22a7-472f-acd4-65dd48209476 tempest-ProjectMemberTests-359761515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:11 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-55804477-22a7-472f-acd4-65dd48209476 tempest-ProjectMemberTests-359761515 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:32:11 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-55804477-22a7-472f-acd4-65dd48209476 tempest-ProjectMemberTests-359761515 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:32:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-55804477-22a7-472f-acd4-65dd48209476 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:12 devstack sudo[106007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480 1073741824 Aug 31 15:32:12 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:12 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4a68535d-8005-4d4b-8982-05bd8710b3cd tempest-ProjectReaderTests-1610880033 None] Acquiring lock "cinder-ee05a99c-7518-4078-b23f-43d264c994c4-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:12 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4a68535d-8005-4d4b-8982-05bd8710b3cd tempest-ProjectReaderTests-1610880033 None] Lock "cinder-ee05a99c-7518-4078-b23f-43d264c994c4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:12 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4a68535d-8005-4d4b-8982-05bd8710b3cd tempest-ProjectReaderTests-1610880033 None] Acquiring lock "cinder-quobyte-ee05a99c-7518-4078-b23f-43d264c994c4" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:12 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4a68535d-8005-4d4b-8982-05bd8710b3cd tempest-ProjectReaderTests-1610880033 None] Lock "cinder-quobyte-ee05a99c-7518-4078-b23f-43d264c994c4" acquired by "delete_volume" :: waited 0.014s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:12 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1458b9-c487-4ee9-b7f8-f9477933056c]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:32:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4a68535d-8005-4d4b-8982-05bd8710b3cd tempest-ProjectReaderTests-1610880033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ee05a99c-7518-4078-b23f-43d264c994c4 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:12 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a38fe3f0-cb32-474c-a6f1-252bd50c0f55 tempest-SnapshotDependencyTests-154934529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9" returned: 0 in 0.626s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a38fe3f0-cb32-474c-a6f1-252bd50c0f55 tempest-SnapshotDependencyTests-154934529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9.f5dbe9c9-c77e-4c8b-a5f1-a23ad515ee47 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:12 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9.f5dbe9c9-c77e-4c8b-a5f1-a23ad515ee47 Aug 31 15:32:12 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:12 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ee05a99c-7518-4078-b23f-43d264c994c4 Aug 31 15:32:12 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:12 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-55804477-22a7-472f-acd4-65dd48209476 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480 1073741824" returned: 0 in 0.482s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-55804477-22a7-472f-acd4-65dd48209476 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:12 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480 Aug 31 15:32:12 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:12 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:12 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a38fe3f0-cb32-474c-a6f1-252bd50c0f55 tempest-SnapshotDependencyTests-154934529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9.f5dbe9c9-c77e-4c8b-a5f1-a23ad515ee47" returned: 0 in 0.352s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a38fe3f0-cb32-474c-a6f1-252bd50c0f55 tempest-SnapshotDependencyTests-154934529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9.f5dbe9c9-c77e-4c8b-a5f1-a23ad515ee47 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4a68535d-8005-4d4b-8982-05bd8710b3cd tempest-ProjectReaderTests-1610880033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ee05a99c-7518-4078-b23f-43d264c994c4" returned: 0 in 0.423s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4a68535d-8005-4d4b-8982-05bd8710b3cd tempest-ProjectReaderTests-1610880033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ee05a99c-7518-4078-b23f-43d264c994c4 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:12 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9.f5dbe9c9-c77e-4c8b-a5f1-a23ad515ee47 Aug 31 15:32:12 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:12 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ee05a99c-7518-4078-b23f-43d264c994c4 Aug 31 15:32:12 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:12 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-55804477-22a7-472f-acd4-65dd48209476 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480" returned: 0 in 0.253s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:12 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-55804477-22a7-472f-acd4-65dd48209476 tempest-ProjectMemberTests-359761515 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:32:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-55804477-22a7-472f-acd4-65dd48209476 tempest-ProjectMemberTests-359761515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:12 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-55804477-22a7-472f-acd4-65dd48209476 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9fe5777-103b-492f-b507-b83427f03910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e58dc11-0e53-4ea4-b297-6e1899196480', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:12 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-55804477-22a7-472f-acd4-65dd48209476 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (471da612-baaf-41b1-8e8f-ca67f67ef848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:12 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-55804477-22a7-472f-acd4-65dd48209476 tempest-ProjectMemberTests-359761515 None] Volume volume-7e58dc11-0e53-4ea4-b297-6e1899196480 (7e58dc11-0e53-4ea4-b297-6e1899196480): created successfully Aug 31 15:32:12 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-55804477-22a7-472f-acd4-65dd48209476 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (471da612-baaf-41b1-8e8f-ca67f67ef848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:12 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-55804477-22a7-472f-acd4-65dd48209476 tempest-ProjectMemberTests-359761515 None] Flow 'volume_create_manager' (5150e614-5b9c-4762-b68a-d9816ee5ca21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:32:12 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-55804477-22a7-472f-acd4-65dd48209476 tempest-ProjectMemberTests-359761515 None] Created volume successfully. Aug 31 15:32:12 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-a38fe3f0-cb32-474c-a6f1-252bd50c0f55 tempest-SnapshotDependencyTests-154934529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9.f5dbe9c9-c77e-4c8b-a5f1-a23ad515ee47" returned: 0 in 0.274s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:12 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4a68535d-8005-4d4b-8982-05bd8710b3cd tempest-ProjectReaderTests-1610880033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-ee05a99c-7518-4078-b23f-43d264c994c4" returned: 0 in 0.272s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:12 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a38fe3f0-cb32-474c-a6f1-252bd50c0f55 tempest-SnapshotDependencyTests-154934529 None] Lock "cinder-quobyte-f5dbe9c9-c77e-4c8b-a5f1-a23ad515ee47" released by "_delete_snapshot" :: held 1.723s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:12 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4a68535d-8005-4d4b-8982-05bd8710b3cd tempest-ProjectReaderTests-1610880033 None] Lock "cinder-quobyte-ee05a99c-7518-4078-b23f-43d264c994c4" released by "delete_volume" :: held 0.756s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:12 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a38fe3f0-cb32-474c-a6f1-252bd50c0f55 tempest-SnapshotDependencyTests-154934529 None] Lock "cinder-quobyte-255cab24-84cc-4bba-b94b-afd866a44ba9" released by "delete_snapshot" :: held 1.747s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:12 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-4a68535d-8005-4d4b-8982-05bd8710b3cd tempest-ProjectReaderTests-1610880033 None] Created reservations ['96f5a735-85be-4d6e-b5ad-cd5dfb1337a6', 'f8fbf5d3-7758-4231-a16b-7bc879e67a77', 'bd90d8d6-3f4e-4096-aad5-123125af0162', '029a9ad6-d054-4a7f-add5-d1683cec9894'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:32:12 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-a38fe3f0-cb32-474c-a6f1-252bd50c0f55 tempest-SnapshotDependencyTests-154934529 None] Created reservations ['d674c27f-1b91-48f9-9b65-2524150cd45a', 'e4054be6-0c77-4701-bd16-2ebeadda214e', '8d5fb635-aa22-4e00-9659-e4bdc1f62a46', '262a4eed-f8e6-4f71-ac70-160ff892bb48'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:32:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4a68535d-8005-4d4b-8982-05bd8710b3cd tempest-ProjectReaderTests-1610880033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4a68535d-8005-4d4b-8982-05bd8710b3cd tempest-ProjectReaderTests-1610880033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:13 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4a68535d-8005-4d4b-8982-05bd8710b3cd tempest-ProjectReaderTests-1610880033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:32:13 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4a68535d-8005-4d4b-8982-05bd8710b3cd tempest-ProjectReaderTests-1610880033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:32:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4a68535d-8005-4d4b-8982-05bd8710b3cd tempest-ProjectReaderTests-1610880033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4a68535d-8005-4d4b-8982-05bd8710b3cd tempest-ProjectReaderTests-1610880033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:13 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:32:13 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:13 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-a38fe3f0-cb32-474c-a6f1-252bd50c0f55 tempest-SnapshotDependencyTests-154934529 None] Delete snapshot completed successfully. Aug 31 15:32:13 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-a38fe3f0-cb32-474c-a6f1-252bd50c0f55 tempest-SnapshotDependencyTests-154934529 None] Lock "cinder-f5dbe9c9-c77e-4c8b-a5f1-a23ad515ee47-delete_snapshot" released by "delete_snapshot" :: held 1.940s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:13 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-902e2d1c-c10d-4f82-9538-73928c353b6d tempest-SnapshotDependencyTests-154934529 None] Acquiring lock "cinder-255cab24-84cc-4bba-b94b-afd866a44ba9-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:13 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4a68535d-8005-4d4b-8982-05bd8710b3cd tempest-ProjectReaderTests-1610880033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.273s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:13 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-4a68535d-8005-4d4b-8982-05bd8710b3cd tempest-ProjectReaderTests-1610880033 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:32:13 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-902e2d1c-c10d-4f82-9538-73928c353b6d tempest-SnapshotDependencyTests-154934529 None] Lock "cinder-255cab24-84cc-4bba-b94b-afd866a44ba9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:13 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-4a68535d-8005-4d4b-8982-05bd8710b3cd tempest-ProjectReaderTests-1610880033 None] Deleted volume successfully. Aug 31 15:32:13 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4a68535d-8005-4d4b-8982-05bd8710b3cd tempest-ProjectReaderTests-1610880033 None] Lock "cinder-ee05a99c-7518-4078-b23f-43d264c994c4-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:13 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-902e2d1c-c10d-4f82-9538-73928c353b6d tempest-SnapshotDependencyTests-154934529 None] Acquiring lock "cinder-quobyte-255cab24-84cc-4bba-b94b-afd866a44ba9" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:13 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-902e2d1c-c10d-4f82-9538-73928c353b6d tempest-SnapshotDependencyTests-154934529 None] Lock "cinder-quobyte-255cab24-84cc-4bba-b94b-afd866a44ba9" acquired by "delete_volume" :: waited 0.017s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:13 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ab2d7e-a6ac-45c6-af5b-ff37d817ffba]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:32:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-902e2d1c-c10d-4f82-9538-73928c353b6d tempest-SnapshotDependencyTests-154934529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:13 devstack sudo[106035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9 Aug 31 15:32:13 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:13 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-c68bdf1c-de2f-4f15-ab45-958721fa70a1 tempest-ProjectReaderTests-1610880033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:32:13 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c68bdf1c-de2f-4f15-ab45-958721fa70a1 tempest-ProjectReaderTests-1610880033 None] Flow 'volume_create_manager' (f2ac2f3c-db11-4705-92b7-5ce78a46da2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:32:13 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c68bdf1c-de2f-4f15-ab45-958721fa70a1 tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (999ec96a-9310-449f-b024-33c199bc39d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:13 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c68bdf1c-de2f-4f15-ab45-958721fa70a1 tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (999ec96a-9310-449f-b024-33c199bc39d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-376806821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82cbb9dc-dc5c-4e52-9714-a975832346ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b79b15895b454e8da3933af1bc11e4f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:32:14Z,use_quota=True,user_id='bc7ede8772e44e959581ef3ee880baf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:13 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:13 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c68bdf1c-de2f-4f15-ab45-958721fa70a1 tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0348a0df-d9a0-4bec-b904-2847ef84cc53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:13 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c68bdf1c-de2f-4f15-ab45-958721fa70a1 tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0348a0df-d9a0-4bec-b904-2847ef84cc53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:13 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c68bdf1c-de2f-4f15-ab45-958721fa70a1 tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4fad215-b9f3-4fdb-8fec-b11cfe3b353b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:13 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c68bdf1c-de2f-4f15-ab45-958721fa70a1 tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4fad215-b9f3-4fdb-8fec-b11cfe3b353b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82cbb9dc-dc5c-4e52-9714-a975832346ec', 'volume_name': 'volume-82cbb9dc-dc5c-4e52-9714-a975832346ec', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:13 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c68bdf1c-de2f-4f15-ab45-958721fa70a1 tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (204baf24-c593-4d05-87b5-95aa6b8ea5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:13 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c68bdf1c-de2f-4f15-ab45-958721fa70a1 tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (204baf24-c593-4d05-87b5-95aa6b8ea5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:13 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c68bdf1c-de2f-4f15-ab45-958721fa70a1 tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f08247da-bc47-406e-ac88-23865b5491ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:13 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-c68bdf1c-de2f-4f15-ab45-958721fa70a1 tempest-ProjectReaderTests-1610880033 None] Volume 82cbb9dc-dc5c-4e52-9714-a975832346ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82cbb9dc-dc5c-4e52-9714-a975832346ec', 'volume_size': 1} Aug 31 15:32:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c68bdf1c-de2f-4f15-ab45-958721fa70a1 tempest-ProjectReaderTests-1610880033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c68bdf1c-de2f-4f15-ab45-958721fa70a1 tempest-ProjectReaderTests-1610880033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:13 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c68bdf1c-de2f-4f15-ab45-958721fa70a1 tempest-ProjectReaderTests-1610880033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-376806821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82cbb9dc-dc5c-4e52-9714-a975832346ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b79b15895b454e8da3933af1bc11e4f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:32:14Z,use_quota=True,user_id='bc7ede8772e44e959581ef3ee880baf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:32:13 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-c68bdf1c-de2f-4f15-ab45-958721fa70a1 tempest-ProjectReaderTests-1610880033 None] Creating volume 82cbb9dc-dc5c-4e52-9714-a975832346ec {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:32:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c68bdf1c-de2f-4f15-ab45-958721fa70a1 tempest-ProjectReaderTests-1610880033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c68bdf1c-de2f-4f15-ab45-958721fa70a1 tempest-ProjectReaderTests-1610880033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:13 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c68bdf1c-de2f-4f15-ab45-958721fa70a1 tempest-ProjectReaderTests-1610880033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:32:13 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c68bdf1c-de2f-4f15-ab45-958721fa70a1 tempest-ProjectReaderTests-1610880033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:32:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c68bdf1c-de2f-4f15-ab45-958721fa70a1 tempest-ProjectReaderTests-1610880033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:13 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c68bdf1c-de2f-4f15-ab45-958721fa70a1 tempest-ProjectReaderTests-1610880033 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:32:13 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-c68bdf1c-de2f-4f15-ab45-958721fa70a1 tempest-ProjectReaderTests-1610880033 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:32:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c68bdf1c-de2f-4f15-ab45-958721fa70a1 tempest-ProjectReaderTests-1610880033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82cbb9dc-dc5c-4e52-9714-a975832346ec 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-902e2d1c-c10d-4f82-9538-73928c353b6d tempest-SnapshotDependencyTests-154934529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9" returned: 0 in 0.425s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-902e2d1c-c10d-4f82-9538-73928c353b6d tempest-SnapshotDependencyTests-154934529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:13 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82cbb9dc-dc5c-4e52-9714-a975832346ec 1073741824 Aug 31 15:32:13 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:13 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9 Aug 31 15:32:13 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:14 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-902e2d1c-c10d-4f82-9538-73928c353b6d tempest-SnapshotDependencyTests-154934529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-255cab24-84cc-4bba-b94b-afd866a44ba9" returned: 0 in 0.281s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:14 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-902e2d1c-c10d-4f82-9538-73928c353b6d tempest-SnapshotDependencyTests-154934529 None] Lock "cinder-quobyte-255cab24-84cc-4bba-b94b-afd866a44ba9" released by "delete_volume" :: held 0.780s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:14 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-902e2d1c-c10d-4f82-9538-73928c353b6d tempest-SnapshotDependencyTests-154934529 None] Created reservations ['5ce7e6a5-2d25-4c7c-9737-ab209b7bb8b9', 'c01744dc-fc79-4e38-9e68-debd864ebb31', '01630b61-42a3-44a6-91d4-1d4a46ad8f18', '688a88da-4285-4a2c-8b27-aaccb6994a4b'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:32:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-902e2d1c-c10d-4f82-9538-73928c353b6d tempest-SnapshotDependencyTests-154934529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-902e2d1c-c10d-4f82-9538-73928c353b6d tempest-SnapshotDependencyTests-154934529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:14 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-902e2d1c-c10d-4f82-9538-73928c353b6d tempest-SnapshotDependencyTests-154934529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:32:14 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-902e2d1c-c10d-4f82-9538-73928c353b6d tempest-SnapshotDependencyTests-154934529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:32:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-902e2d1c-c10d-4f82-9538-73928c353b6d tempest-SnapshotDependencyTests-154934529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-902e2d1c-c10d-4f82-9538-73928c353b6d tempest-SnapshotDependencyTests-154934529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:14 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:32:14 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:14 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c68bdf1c-de2f-4f15-ab45-958721fa70a1 tempest-ProjectReaderTests-1610880033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82cbb9dc-dc5c-4e52-9714-a975832346ec 1073741824" returned: 0 in 0.512s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-cb68010f-a544-40f6-93aa-1b1c6afb28e2 tempest-ProjectMemberTests-359761515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c68bdf1c-de2f-4f15-ab45-958721fa70a1 tempest-ProjectReaderTests-1610880033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82cbb9dc-dc5c-4e52-9714-a975832346ec {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:14 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82cbb9dc-dc5c-4e52-9714-a975832346ec Aug 31 15:32:14 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:14 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4c7a07cf-2b4c-4656-83c4-db676a1130ff tempest-SnapshotDependencyTests-154934529 None] Acquiring lock "cinder-33747dee-54f0-4cd8-ab9d-49ade4dddcd6-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:14 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4c7a07cf-2b4c-4656-83c4-db676a1130ff tempest-SnapshotDependencyTests-154934529 None] Lock "cinder-33747dee-54f0-4cd8-ab9d-49ade4dddcd6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:14 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4c7a07cf-2b4c-4656-83c4-db676a1130ff tempest-SnapshotDependencyTests-154934529 None] Acquiring lock "cinder-quobyte-33747dee-54f0-4cd8-ab9d-49ade4dddcd6" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:14 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4c7a07cf-2b4c-4656-83c4-db676a1130ff tempest-SnapshotDependencyTests-154934529 None] Lock "cinder-quobyte-33747dee-54f0-4cd8-ab9d-49ade4dddcd6" acquired by "delete_volume" :: waited 0.027s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:14 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8168d24-d466-4296-a909-113ed522079a]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:32:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4c7a07cf-2b4c-4656-83c4-db676a1130ff tempest-SnapshotDependencyTests-154934529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-33747dee-54f0-4cd8-ab9d-49ade4dddcd6 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:14 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-902e2d1c-c10d-4f82-9538-73928c353b6d tempest-SnapshotDependencyTests-154934529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.312s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:14 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-902e2d1c-c10d-4f82-9538-73928c353b6d tempest-SnapshotDependencyTests-154934529 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:32:14 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-902e2d1c-c10d-4f82-9538-73928c353b6d tempest-SnapshotDependencyTests-154934529 None] Deleted volume successfully. Aug 31 15:32:14 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-902e2d1c-c10d-4f82-9538-73928c353b6d tempest-SnapshotDependencyTests-154934529 None] Lock "cinder-255cab24-84cc-4bba-b94b-afd866a44ba9-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:14 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c68bdf1c-de2f-4f15-ab45-958721fa70a1 tempest-ProjectReaderTests-1610880033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82cbb9dc-dc5c-4e52-9714-a975832346ec" returned: 0 in 0.283s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:14 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c68bdf1c-de2f-4f15-ab45-958721fa70a1 tempest-ProjectReaderTests-1610880033 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:32:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c68bdf1c-de2f-4f15-ab45-958721fa70a1 tempest-ProjectReaderTests-1610880033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-cb68010f-a544-40f6-93aa-1b1c6afb28e2 tempest-ProjectMemberTests-359761515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.326s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:14 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-cb68010f-a544-40f6-93aa-1b1c6afb28e2 tempest-ProjectMemberTests-359761515 None] Creating offline snapshot 1b5ea0de-5c3c-4309-af7c-446f55880ec3 of volume 7e58dc11-0e53-4ea4-b297-6e1899196480 {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:32:14 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c68bdf1c-de2f-4f15-ab45-958721fa70a1 tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f08247da-bc47-406e-ac88-23865b5491ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82cbb9dc-dc5c-4e52-9714-a975832346ec', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:14 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c68bdf1c-de2f-4f15-ab45-958721fa70a1 tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1814da8-175e-41f3-a9eb-14f5b439a5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:14 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[783f846e-894b-4bbb-a79c-5030a3d4ecf7]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:32:14 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-33747dee-54f0-4cd8-ab9d-49ade4dddcd6 Aug 31 15:32:14 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cb68010f-a544-40f6-93aa-1b1c6afb28e2 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:14 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-c68bdf1c-de2f-4f15-ab45-958721fa70a1 tempest-ProjectReaderTests-1610880033 None] Volume volume-82cbb9dc-dc5c-4e52-9714-a975832346ec (82cbb9dc-dc5c-4e52-9714-a975832346ec): created successfully Aug 31 15:32:14 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c68bdf1c-de2f-4f15-ab45-958721fa70a1 tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1814da8-175e-41f3-a9eb-14f5b439a5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:14 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c68bdf1c-de2f-4f15-ab45-958721fa70a1 tempest-ProjectReaderTests-1610880033 None] Flow 'volume_create_manager' (f2ac2f3c-db11-4705-92b7-5ce78a46da2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:32:14 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-c68bdf1c-de2f-4f15-ab45-958721fa70a1 tempest-ProjectReaderTests-1610880033 None] Created volume successfully. Aug 31 15:32:14 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480 Aug 31 15:32:14 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:14 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4c7a07cf-2b4c-4656-83c4-db676a1130ff tempest-SnapshotDependencyTests-154934529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-33747dee-54f0-4cd8-ab9d-49ade4dddcd6" returned: 0 in 0.374s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4c7a07cf-2b4c-4656-83c4-db676a1130ff tempest-SnapshotDependencyTests-154934529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-33747dee-54f0-4cd8-ab9d-49ade4dddcd6 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:14 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-33747dee-54f0-4cd8-ab9d-49ade4dddcd6 Aug 31 15:32:14 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:15 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cb68010f-a544-40f6-93aa-1b1c6afb28e2 tempest-ProjectMemberTests-359761515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480" returned: 0 in 0.395s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cb68010f-a544-40f6-93aa-1b1c6afb28e2 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480.1b5ea0de-5c3c-4309-af7c-446f55880ec3 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:15 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480.1b5ea0de-5c3c-4309-af7c-446f55880ec3 1G Aug 31 15:32:15 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:15 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4c7a07cf-2b4c-4656-83c4-db676a1130ff tempest-SnapshotDependencyTests-154934529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-33747dee-54f0-4cd8-ab9d-49ade4dddcd6" returned: 0 in 0.251s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:15 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4c7a07cf-2b4c-4656-83c4-db676a1130ff tempest-SnapshotDependencyTests-154934529 None] Lock "cinder-quobyte-33747dee-54f0-4cd8-ab9d-49ade4dddcd6" released by "delete_volume" :: held 0.672s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:15 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-4c7a07cf-2b4c-4656-83c4-db676a1130ff tempest-SnapshotDependencyTests-154934529 None] Created reservations ['26c64e8f-b3c6-42b4-9abd-33e1dc83c025', 'ae1aa0a5-4ea3-4dce-ae15-7080d2d738b0', '7ded5184-fe71-4bbd-be4b-9a47bff8808a', 'f6790245-b589-47f9-993d-71412a51d892'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:32:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4c7a07cf-2b4c-4656-83c4-db676a1130ff tempest-SnapshotDependencyTests-154934529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4c7a07cf-2b4c-4656-83c4-db676a1130ff tempest-SnapshotDependencyTests-154934529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:15 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4c7a07cf-2b4c-4656-83c4-db676a1130ff tempest-SnapshotDependencyTests-154934529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:32:15 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-4c7a07cf-2b4c-4656-83c4-db676a1130ff tempest-SnapshotDependencyTests-154934529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:32:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-4c7a07cf-2b4c-4656-83c4-db676a1130ff tempest-SnapshotDependencyTests-154934529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4c7a07cf-2b4c-4656-83c4-db676a1130ff tempest-SnapshotDependencyTests-154934529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:15 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:32:15 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:15 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cb68010f-a544-40f6-93aa-1b1c6afb28e2 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480.1b5ea0de-5c3c-4309-af7c-446f55880ec3 1G" returned: 0 in 0.414s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cb68010f-a544-40f6-93aa-1b1c6afb28e2 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e58dc11-0e53-4ea4-b297-6e1899196480 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480.1b5ea0de-5c3c-4309-af7c-446f55880ec3 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:15 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e58dc11-0e53-4ea4-b297-6e1899196480 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480.1b5ea0de-5c3c-4309-af7c-446f55880ec3 Aug 31 15:32:15 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:15 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-4c7a07cf-2b4c-4656-83c4-db676a1130ff tempest-SnapshotDependencyTests-154934529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.256s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:15 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-4c7a07cf-2b4c-4656-83c4-db676a1130ff tempest-SnapshotDependencyTests-154934529 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:32:15 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-4c7a07cf-2b4c-4656-83c4-db676a1130ff tempest-SnapshotDependencyTests-154934529 None] Deleted volume successfully. Aug 31 15:32:15 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-4c7a07cf-2b4c-4656-83c4-db676a1130ff tempest-SnapshotDependencyTests-154934529 None] Lock "cinder-33747dee-54f0-4cd8-ab9d-49ade4dddcd6-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:15 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cb68010f-a544-40f6-93aa-1b1c6afb28e2 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e58dc11-0e53-4ea4-b297-6e1899196480 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480.1b5ea0de-5c3c-4309-af7c-446f55880ec3" returned: 0 in 0.325s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:15 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-cb68010f-a544-40f6-93aa-1b1c6afb28e2 tempest-ProjectMemberTests-359761515 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480.1b5ea0de-5c3c-4309-af7c-446f55880ec3 is being set with open permissions: ugo+rw Aug 31 15:32:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cb68010f-a544-40f6-93aa-1b1c6afb28e2 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480.1b5ea0de-5c3c-4309-af7c-446f55880ec3 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:15 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-8c2ad75a-1f0a-4460-be4a-13be58b72745 tempest-ProjectReaderTests-1610880033 None] Acquiring lock "cinder-82cbb9dc-dc5c-4e52-9714-a975832346ec-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:15 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480.1b5ea0de-5c3c-4309-af7c-446f55880ec3 Aug 31 15:32:15 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:15 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-8c2ad75a-1f0a-4460-be4a-13be58b72745 tempest-ProjectReaderTests-1610880033 None] Lock "cinder-82cbb9dc-dc5c-4e52-9714-a975832346ec-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:15 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-8c2ad75a-1f0a-4460-be4a-13be58b72745 tempest-ProjectReaderTests-1610880033 None] Acquiring lock "cinder-quobyte-82cbb9dc-dc5c-4e52-9714-a975832346ec" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:15 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-8c2ad75a-1f0a-4460-be4a-13be58b72745 tempest-ProjectReaderTests-1610880033 None] Lock "cinder-quobyte-82cbb9dc-dc5c-4e52-9714-a975832346ec" acquired by "delete_volume" :: waited 0.019s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:16 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34ef746-68f7-4768-82b3-94fff1638b0e]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:32:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8c2ad75a-1f0a-4460-be4a-13be58b72745 tempest-ProjectReaderTests-1610880033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82cbb9dc-dc5c-4e52-9714-a975832346ec {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:16 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82cbb9dc-dc5c-4e52-9714-a975832346ec Aug 31 15:32:16 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:16 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cb68010f-a544-40f6-93aa-1b1c6afb28e2 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480.1b5ea0de-5c3c-4309-af7c-446f55880ec3" returned: 0 in 0.293s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cb68010f-a544-40f6-93aa-1b1c6afb28e2 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:16 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480.info Aug 31 15:32:16 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:16 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8c2ad75a-1f0a-4460-be4a-13be58b72745 tempest-ProjectReaderTests-1610880033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82cbb9dc-dc5c-4e52-9714-a975832346ec" returned: 0 in 0.399s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8c2ad75a-1f0a-4460-be4a-13be58b72745 tempest-ProjectReaderTests-1610880033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82cbb9dc-dc5c-4e52-9714-a975832346ec {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:16 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82cbb9dc-dc5c-4e52-9714-a975832346ec Aug 31 15:32:16 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:16 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cb68010f-a544-40f6-93aa-1b1c6afb28e2 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480.info" returned: 0 in 0.307s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:16 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-cb68010f-a544-40f6-93aa-1b1c6afb28e2 tempest-ProjectMemberTests-359761515 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480.info is being set with open permissions: ugo+rw Aug 31 15:32:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cb68010f-a544-40f6-93aa-1b1c6afb28e2 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:16 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480.info Aug 31 15:32:16 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:16 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8c2ad75a-1f0a-4460-be4a-13be58b72745 tempest-ProjectReaderTests-1610880033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82cbb9dc-dc5c-4e52-9714-a975832346ec" returned: 0 in 0.282s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:16 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-8c2ad75a-1f0a-4460-be4a-13be58b72745 tempest-ProjectReaderTests-1610880033 None] Lock "cinder-quobyte-82cbb9dc-dc5c-4e52-9714-a975832346ec" released by "delete_volume" :: held 0.734s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:16 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-8c2ad75a-1f0a-4460-be4a-13be58b72745 tempest-ProjectReaderTests-1610880033 None] Created reservations ['718bf14c-2116-449d-b977-83b48dcaf0a0', '970f79d6-9f35-4e10-8837-0655d4d4b66d', '2a22ecc0-410a-46f8-90da-87d2a5f61b9c', '0419b0f1-acab-4bcb-ad6d-4ec189b8402e'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:32:16 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cb68010f-a544-40f6-93aa-1b1c6afb28e2 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480.info" returned: 0 in 0.297s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-cb68010f-a544-40f6-93aa-1b1c6afb28e2 tempest-ProjectMemberTests-359761515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.129s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:16 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-cb68010f-a544-40f6-93aa-1b1c6afb28e2 tempest-ProjectMemberTests-359761515 None] Create snapshot completed successfully Aug 31 15:32:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8c2ad75a-1f0a-4460-be4a-13be58b72745 tempest-ProjectReaderTests-1610880033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8c2ad75a-1f0a-4460-be4a-13be58b72745 tempest-ProjectReaderTests-1610880033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:16 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-8c2ad75a-1f0a-4460-be4a-13be58b72745 tempest-ProjectReaderTests-1610880033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:32:16 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-8c2ad75a-1f0a-4460-be4a-13be58b72745 tempest-ProjectReaderTests-1610880033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:32:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8c2ad75a-1f0a-4460-be4a-13be58b72745 tempest-ProjectReaderTests-1610880033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8c2ad75a-1f0a-4460-be4a-13be58b72745 tempest-ProjectReaderTests-1610880033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:16 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:32:16 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:17 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8c2ad75a-1f0a-4460-be4a-13be58b72745 tempest-ProjectReaderTests-1610880033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.265s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:17 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-8c2ad75a-1f0a-4460-be4a-13be58b72745 tempest-ProjectReaderTests-1610880033 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:32:17 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-8c2ad75a-1f0a-4460-be4a-13be58b72745 tempest-ProjectReaderTests-1610880033 None] Deleted volume successfully. Aug 31 15:32:17 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-8c2ad75a-1f0a-4460-be4a-13be58b72745 tempest-ProjectReaderTests-1610880033 None] Lock "cinder-82cbb9dc-dc5c-4e52-9714-a975832346ec-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:17 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-254623d1-f138-4c80-804d-d8430f9d1c62 tempest-ProjectMemberTests-359761515 None] Acquiring lock "cinder-1b5ea0de-5c3c-4309-af7c-446f55880ec3-delete_snapshot" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:17 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-254623d1-f138-4c80-804d-d8430f9d1c62 tempest-ProjectMemberTests-359761515 None] Lock "cinder-1b5ea0de-5c3c-4309-af7c-446f55880ec3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:17 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-254623d1-f138-4c80-804d-d8430f9d1c62 tempest-ProjectMemberTests-359761515 None] Acquiring lock "cinder-quobyte-7e58dc11-0e53-4ea4-b297-6e1899196480" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:17 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-254623d1-f138-4c80-804d-d8430f9d1c62 tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-7e58dc11-0e53-4ea4-b297-6e1899196480" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:17 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-254623d1-f138-4c80-804d-d8430f9d1c62 tempest-ProjectMemberTests-359761515 None] Acquiring lock "cinder-quobyte-1b5ea0de-5c3c-4309-af7c-446f55880ec3" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:17 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-254623d1-f138-4c80-804d-d8430f9d1c62 tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-1b5ea0de-5c3c-4309-af7c-446f55880ec3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:17 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-254623d1-f138-4c80-804d-d8430f9d1c62 tempest-ProjectMemberTests-359761515 None] Deleting offline snapshot 1b5ea0de-5c3c-4309-af7c-446f55880ec3 of volume 7e58dc11-0e53-4ea4-b297-6e1899196480 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:32:17 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-254623d1-f138-4c80-804d-d8430f9d1c62 tempest-ProjectMemberTests-359761515 None] snapshot_file for this snap is: volume-7e58dc11-0e53-4ea4-b297-6e1899196480.1b5ea0de-5c3c-4309-af7c-446f55880ec3 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:32:17 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbd5cf4-8257-4f4f-8078-7f5629451cee]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:32:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-254623d1-f138-4c80-804d-d8430f9d1c62 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480.1b5ea0de-5c3c-4309-af7c-446f55880ec3 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:17 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba511bb4-7576-4266-9bab-b782fe9ac530 tempest-ProjectReaderTests-1610880033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:32:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ba511bb4-7576-4266-9bab-b782fe9ac530 tempest-ProjectReaderTests-1610880033 None] Flow 'volume_create_manager' (a97d6a77-8efb-4fe8-8f35-2d5cf35b68ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:32:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ba511bb4-7576-4266-9bab-b782fe9ac530 tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f147eaf4-95e3-486b-9d83-427f7d8282d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ba511bb4-7576-4266-9bab-b782fe9ac530 tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f147eaf4-95e3-486b-9d83-427f7d8282d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-18871330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=884138a7-9837-4660-bb78-bed62cb67f75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b79b15895b454e8da3933af1bc11e4f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:32:18Z,use_quota=True,user_id='bc7ede8772e44e959581ef3ee880baf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ba511bb4-7576-4266-9bab-b782fe9ac530 tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2980e7f4-7a50-43d8-8eca-7965d2c7e561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ba511bb4-7576-4266-9bab-b782fe9ac530 tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2980e7f4-7a50-43d8-8eca-7965d2c7e561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ba511bb4-7576-4266-9bab-b782fe9ac530 tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b1da4b-b087-4f05-be99-12a612053b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ba511bb4-7576-4266-9bab-b782fe9ac530 tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b1da4b-b087-4f05-be99-12a612053b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '884138a7-9837-4660-bb78-bed62cb67f75', 'volume_name': 'volume-884138a7-9837-4660-bb78-bed62cb67f75', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ba511bb4-7576-4266-9bab-b782fe9ac530 tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99f82051-27a2-4d53-8c70-4287b8857248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ba511bb4-7576-4266-9bab-b782fe9ac530 tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99f82051-27a2-4d53-8c70-4287b8857248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:17 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480.1b5ea0de-5c3c-4309-af7c-446f55880ec3 Aug 31 15:32:17 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:17 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ba511bb4-7576-4266-9bab-b782fe9ac530 tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44266c87-2ae9-4f76-9655-96c3e28d5178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:17 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-ba511bb4-7576-4266-9bab-b782fe9ac530 tempest-ProjectReaderTests-1610880033 None] Volume 884138a7-9837-4660-bb78-bed62cb67f75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-884138a7-9837-4660-bb78-bed62cb67f75', 'volume_size': 1} Aug 31 15:32:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ba511bb4-7576-4266-9bab-b782fe9ac530 tempest-ProjectReaderTests-1610880033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ba511bb4-7576-4266-9bab-b782fe9ac530 tempest-ProjectReaderTests-1610880033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:17 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-ba511bb4-7576-4266-9bab-b782fe9ac530 tempest-ProjectReaderTests-1610880033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-18871330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=884138a7-9837-4660-bb78-bed62cb67f75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b79b15895b454e8da3933af1bc11e4f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:32:18Z,use_quota=True,user_id='bc7ede8772e44e959581ef3ee880baf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:32:17 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-ba511bb4-7576-4266-9bab-b782fe9ac530 tempest-ProjectReaderTests-1610880033 None] Creating volume 884138a7-9837-4660-bb78-bed62cb67f75 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:32:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ba511bb4-7576-4266-9bab-b782fe9ac530 tempest-ProjectReaderTests-1610880033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ba511bb4-7576-4266-9bab-b782fe9ac530 tempest-ProjectReaderTests-1610880033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:17 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-ba511bb4-7576-4266-9bab-b782fe9ac530 tempest-ProjectReaderTests-1610880033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:32:17 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-ba511bb4-7576-4266-9bab-b782fe9ac530 tempest-ProjectReaderTests-1610880033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:32:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ba511bb4-7576-4266-9bab-b782fe9ac530 tempest-ProjectReaderTests-1610880033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:17 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-ba511bb4-7576-4266-9bab-b782fe9ac530 tempest-ProjectReaderTests-1610880033 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:32:17 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-ba511bb4-7576-4266-9bab-b782fe9ac530 tempest-ProjectReaderTests-1610880033 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:32:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ba511bb4-7576-4266-9bab-b782fe9ac530 tempest-ProjectReaderTests-1610880033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-884138a7-9837-4660-bb78-bed62cb67f75 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:17 devstack sudo[106106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-884138a7-9837-4660-bb78-bed62cb67f75 1073741824 Aug 31 15:32:17 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:17 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-254623d1-f138-4c80-804d-d8430f9d1c62 tempest-ProjectMemberTests-359761515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480.1b5ea0de-5c3c-4309-af7c-446f55880ec3" returned: 0 in 0.384s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:17 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-254623d1-f138-4c80-804d-d8430f9d1c62 tempest-ProjectMemberTests-359761515 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e58dc11-0e53-4ea4-b297-6e1899196480(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:32:18 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[592514f9-3140-4f25-a696-2f1a8acb1007]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:32:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-254623d1-f138-4c80-804d-d8430f9d1c62 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:18 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480 Aug 31 15:32:18 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:18 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ba511bb4-7576-4266-9bab-b782fe9ac530 tempest-ProjectReaderTests-1610880033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-884138a7-9837-4660-bb78-bed62cb67f75 1073741824" returned: 0 in 0.485s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ba511bb4-7576-4266-9bab-b782fe9ac530 tempest-ProjectReaderTests-1610880033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-884138a7-9837-4660-bb78-bed62cb67f75 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:18 devstack sudo[106118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-884138a7-9837-4660-bb78-bed62cb67f75 Aug 31 15:32:18 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:18 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-254623d1-f138-4c80-804d-d8430f9d1c62 tempest-ProjectMemberTests-359761515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480" returned: 0 in 0.422s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-254623d1-f138-4c80-804d-d8430f9d1c62 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480.1b5ea0de-5c3c-4309-af7c-446f55880ec3 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:18 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480.1b5ea0de-5c3c-4309-af7c-446f55880ec3 Aug 31 15:32:18 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:18 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ba511bb4-7576-4266-9bab-b782fe9ac530 tempest-ProjectReaderTests-1610880033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-884138a7-9837-4660-bb78-bed62cb67f75" returned: 0 in 0.282s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:18 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-ba511bb4-7576-4266-9bab-b782fe9ac530 tempest-ProjectReaderTests-1610880033 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:32:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ba511bb4-7576-4266-9bab-b782fe9ac530 tempest-ProjectReaderTests-1610880033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:18 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ba511bb4-7576-4266-9bab-b782fe9ac530 tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44266c87-2ae9-4f76-9655-96c3e28d5178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-884138a7-9837-4660-bb78-bed62cb67f75', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:18 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ba511bb4-7576-4266-9bab-b782fe9ac530 tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a3748f3-b0de-4ea6-8efc-8c41970fde6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:18 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-ba511bb4-7576-4266-9bab-b782fe9ac530 tempest-ProjectReaderTests-1610880033 None] Volume volume-884138a7-9837-4660-bb78-bed62cb67f75 (884138a7-9837-4660-bb78-bed62cb67f75): created successfully Aug 31 15:32:18 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ba511bb4-7576-4266-9bab-b782fe9ac530 tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a3748f3-b0de-4ea6-8efc-8c41970fde6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:18 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ba511bb4-7576-4266-9bab-b782fe9ac530 tempest-ProjectReaderTests-1610880033 None] Flow 'volume_create_manager' (a97d6a77-8efb-4fe8-8f35-2d5cf35b68ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:32:18 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-ba511bb4-7576-4266-9bab-b782fe9ac530 tempest-ProjectReaderTests-1610880033 None] Created volume successfully. Aug 31 15:32:18 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-254623d1-f138-4c80-804d-d8430f9d1c62 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480.1b5ea0de-5c3c-4309-af7c-446f55880ec3" returned: 0 in 0.349s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-254623d1-f138-4c80-804d-d8430f9d1c62 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480.1b5ea0de-5c3c-4309-af7c-446f55880ec3 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:18 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480.1b5ea0de-5c3c-4309-af7c-446f55880ec3 Aug 31 15:32:18 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:19 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-254623d1-f138-4c80-804d-d8430f9d1c62 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480.1b5ea0de-5c3c-4309-af7c-446f55880ec3" returned: 0 in 0.244s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:19 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-254623d1-f138-4c80-804d-d8430f9d1c62 tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-1b5ea0de-5c3c-4309-af7c-446f55880ec3" released by "_delete_snapshot" :: held 1.520s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:19 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-254623d1-f138-4c80-804d-d8430f9d1c62 tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-7e58dc11-0e53-4ea4-b297-6e1899196480" released by "delete_snapshot" :: held 1.541s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:19 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-254623d1-f138-4c80-804d-d8430f9d1c62 tempest-ProjectMemberTests-359761515 None] Created reservations ['f5cbf399-3743-443b-b7ac-6724fa06b3c8', '6cba0196-5029-47e5-8a6e-4741d65553c7', 'de9e0f6a-44b0-469d-81ba-5c8f9c91a681', '2bccfa7e-ab40-4bfe-ba1a-f4ed83143e2f'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:32:19 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-254623d1-f138-4c80-804d-d8430f9d1c62 tempest-ProjectMemberTests-359761515 None] Delete snapshot completed successfully. Aug 31 15:32:19 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-254623d1-f138-4c80-804d-d8430f9d1c62 tempest-ProjectMemberTests-359761515 None] Lock "cinder-1b5ea0de-5c3c-4309-af7c-446f55880ec3-delete_snapshot" released by "delete_snapshot" :: held 1.680s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:19 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-44959e31-2c3c-4477-a097-5519310488b5 tempest-ProjectMemberTests-359761515 None] Acquiring lock "cinder-7e58dc11-0e53-4ea4-b297-6e1899196480-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:19 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-44959e31-2c3c-4477-a097-5519310488b5 tempest-ProjectMemberTests-359761515 None] Lock "cinder-7e58dc11-0e53-4ea4-b297-6e1899196480-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:19 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-f4827733-9451-440b-a5fe-8131c6e7f55b tempest-ProjectReaderTests-1610880033 None] Acquiring lock "cinder-884138a7-9837-4660-bb78-bed62cb67f75-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:19 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-44959e31-2c3c-4477-a097-5519310488b5 tempest-ProjectMemberTests-359761515 None] Acquiring lock "cinder-quobyte-7e58dc11-0e53-4ea4-b297-6e1899196480" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:19 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-f4827733-9451-440b-a5fe-8131c6e7f55b tempest-ProjectReaderTests-1610880033 None] Lock "cinder-884138a7-9837-4660-bb78-bed62cb67f75-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:19 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-44959e31-2c3c-4477-a097-5519310488b5 tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-7e58dc11-0e53-4ea4-b297-6e1899196480" acquired by "delete_volume" :: waited 0.023s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:19 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[404f85da-a7ff-4d82-bf36-22cbb7ec8952]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:32:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-44959e31-2c3c-4477-a097-5519310488b5 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:19 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-f4827733-9451-440b-a5fe-8131c6e7f55b tempest-ProjectReaderTests-1610880033 None] Acquiring lock "cinder-quobyte-884138a7-9837-4660-bb78-bed62cb67f75" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:19 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-f4827733-9451-440b-a5fe-8131c6e7f55b tempest-ProjectReaderTests-1610880033 None] Lock "cinder-quobyte-884138a7-9837-4660-bb78-bed62cb67f75" acquired by "delete_volume" :: waited 0.025s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:19 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb96c05-cd8d-438a-89a9-cf8833a57f70]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:32:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4827733-9451-440b-a5fe-8131c6e7f55b tempest-ProjectReaderTests-1610880033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-884138a7-9837-4660-bb78-bed62cb67f75 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:19 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480 Aug 31 15:32:19 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:20 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-884138a7-9837-4660-bb78-bed62cb67f75 Aug 31 15:32:20 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:20 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-44959e31-2c3c-4477-a097-5519310488b5 tempest-ProjectMemberTests-359761515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480" returned: 0 in 0.500s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-44959e31-2c3c-4477-a097-5519310488b5 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:20 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480 Aug 31 15:32:20 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:20 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4827733-9451-440b-a5fe-8131c6e7f55b tempest-ProjectReaderTests-1610880033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-884138a7-9837-4660-bb78-bed62cb67f75" returned: 0 in 0.482s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4827733-9451-440b-a5fe-8131c6e7f55b tempest-ProjectReaderTests-1610880033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-884138a7-9837-4660-bb78-bed62cb67f75 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:20 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-884138a7-9837-4660-bb78-bed62cb67f75 Aug 31 15:32:20 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:20 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-44959e31-2c3c-4477-a097-5519310488b5 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-7e58dc11-0e53-4ea4-b297-6e1899196480" returned: 0 in 0.260s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:20 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-44959e31-2c3c-4477-a097-5519310488b5 tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-7e58dc11-0e53-4ea4-b297-6e1899196480" released by "delete_volume" :: held 0.827s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:20 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4827733-9451-440b-a5fe-8131c6e7f55b tempest-ProjectReaderTests-1610880033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-884138a7-9837-4660-bb78-bed62cb67f75" returned: 0 in 0.270s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:20 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-44959e31-2c3c-4477-a097-5519310488b5 tempest-ProjectMemberTests-359761515 None] Created reservations ['fa3888aa-5eb0-4e2d-a627-680f23fdf566', '60bb74da-3144-4f0b-a6e5-d38f6cfe4de3', '444123c0-695e-4dcd-a269-d436e7202649', 'c3beefa1-fc49-4a27-b0cc-2acea95324b5'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:32:20 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-f4827733-9451-440b-a5fe-8131c6e7f55b tempest-ProjectReaderTests-1610880033 None] Lock "cinder-quobyte-884138a7-9837-4660-bb78-bed62cb67f75" released by "delete_volume" :: held 0.803s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-44959e31-2c3c-4477-a097-5519310488b5 tempest-ProjectMemberTests-359761515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-44959e31-2c3c-4477-a097-5519310488b5 tempest-ProjectMemberTests-359761515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:20 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-44959e31-2c3c-4477-a097-5519310488b5 tempest-ProjectMemberTests-359761515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:32:20 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-44959e31-2c3c-4477-a097-5519310488b5 tempest-ProjectMemberTests-359761515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:32:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-44959e31-2c3c-4477-a097-5519310488b5 tempest-ProjectMemberTests-359761515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-44959e31-2c3c-4477-a097-5519310488b5 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:20 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:32:20 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:20 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-f4827733-9451-440b-a5fe-8131c6e7f55b tempest-ProjectReaderTests-1610880033 None] Created reservations ['d30335af-498b-4646-93b3-fefe50b5f4b8', '8763bdda-4e59-4e21-88ad-8987f3e2ed34', 'b3d4931b-e904-40da-9d67-e6cfc187c10d', '04ffbc53-1d99-4997-93ec-56d8ce2c4513'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:32:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f4827733-9451-440b-a5fe-8131c6e7f55b tempest-ProjectReaderTests-1610880033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f4827733-9451-440b-a5fe-8131c6e7f55b tempest-ProjectReaderTests-1610880033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:20 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f4827733-9451-440b-a5fe-8131c6e7f55b tempest-ProjectReaderTests-1610880033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:32:20 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f4827733-9451-440b-a5fe-8131c6e7f55b tempest-ProjectReaderTests-1610880033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:32:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f4827733-9451-440b-a5fe-8131c6e7f55b tempest-ProjectReaderTests-1610880033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:20 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4827733-9451-440b-a5fe-8131c6e7f55b tempest-ProjectReaderTests-1610880033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:21 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:32:21 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:21 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-44959e31-2c3c-4477-a097-5519310488b5 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.412s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:21 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-44959e31-2c3c-4477-a097-5519310488b5 tempest-ProjectMemberTests-359761515 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:32:21 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-44959e31-2c3c-4477-a097-5519310488b5 tempest-ProjectMemberTests-359761515 None] Deleted volume successfully. Aug 31 15:32:21 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-44959e31-2c3c-4477-a097-5519310488b5 tempest-ProjectMemberTests-359761515 None] Lock "cinder-7e58dc11-0e53-4ea4-b297-6e1899196480-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:21 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f4827733-9451-440b-a5fe-8131c6e7f55b tempest-ProjectReaderTests-1610880033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.505s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:21 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-f4827733-9451-440b-a5fe-8131c6e7f55b tempest-ProjectReaderTests-1610880033 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:32:21 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-f4827733-9451-440b-a5fe-8131c6e7f55b tempest-ProjectReaderTests-1610880033 None] Deleted volume successfully. Aug 31 15:32:21 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-f4827733-9451-440b-a5fe-8131c6e7f55b tempest-ProjectReaderTests-1610880033 None] Lock "cinder-884138a7-9837-4660-bb78-bed62cb67f75-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:21 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-11fdb9e8-3fe2-4cb6-8107-732e14d645ab tempest-ProjectMemberTests-359761515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:32:21 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-11fdb9e8-3fe2-4cb6-8107-732e14d645ab tempest-ProjectMemberTests-359761515 None] Flow 'volume_create_manager' (7fa59346-954b-438e-9a9a-f52efe617b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:32:21 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-11fdb9e8-3fe2-4cb6-8107-732e14d645ab tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e1dc83-1ee4-426b-9c63-044b310f6465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:21 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-11fdb9e8-3fe2-4cb6-8107-732e14d645ab tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e1dc83-1ee4-426b-9c63-044b310f6465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-802704303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd593e09-75b3-4554-a4bd-4a07335a34c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1295f7809aa42af91604752ca7d0e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:32:22Z,use_quota=True,user_id='34bfe6cbc4544a40ad4b64e91c8b0d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:21 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-11fdb9e8-3fe2-4cb6-8107-732e14d645ab tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f61120-80fe-4049-92ef-c4453f6c94da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:21 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-11fdb9e8-3fe2-4cb6-8107-732e14d645ab tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f61120-80fe-4049-92ef-c4453f6c94da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:21 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-11fdb9e8-3fe2-4cb6-8107-732e14d645ab tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd665252-a507-44ee-9a39-8bcae8e38de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:21 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-11fdb9e8-3fe2-4cb6-8107-732e14d645ab tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd665252-a507-44ee-9a39-8bcae8e38de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd593e09-75b3-4554-a4bd-4a07335a34c0', 'volume_name': 'volume-bd593e09-75b3-4554-a4bd-4a07335a34c0', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:21 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-11fdb9e8-3fe2-4cb6-8107-732e14d645ab tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d8ef977-87d5-41bb-87dd-11293ef42584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:21 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-11fdb9e8-3fe2-4cb6-8107-732e14d645ab tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d8ef977-87d5-41bb-87dd-11293ef42584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:21 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-11fdb9e8-3fe2-4cb6-8107-732e14d645ab tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39aeee90-a040-4519-8e5f-6919849f2c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:21 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-11fdb9e8-3fe2-4cb6-8107-732e14d645ab tempest-ProjectMemberTests-359761515 None] Volume bd593e09-75b3-4554-a4bd-4a07335a34c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd593e09-75b3-4554-a4bd-4a07335a34c0', 'volume_size': 1} Aug 31 15:32:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-11fdb9e8-3fe2-4cb6-8107-732e14d645ab tempest-ProjectMemberTests-359761515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-11fdb9e8-3fe2-4cb6-8107-732e14d645ab tempest-ProjectMemberTests-359761515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:21 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-11fdb9e8-3fe2-4cb6-8107-732e14d645ab tempest-ProjectMemberTests-359761515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-802704303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd593e09-75b3-4554-a4bd-4a07335a34c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1295f7809aa42af91604752ca7d0e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:32:22Z,use_quota=True,user_id='34bfe6cbc4544a40ad4b64e91c8b0d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:32:21 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-11fdb9e8-3fe2-4cb6-8107-732e14d645ab tempest-ProjectMemberTests-359761515 None] Creating volume bd593e09-75b3-4554-a4bd-4a07335a34c0 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:32:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-11fdb9e8-3fe2-4cb6-8107-732e14d645ab tempest-ProjectMemberTests-359761515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-11fdb9e8-3fe2-4cb6-8107-732e14d645ab tempest-ProjectMemberTests-359761515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:21 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-11fdb9e8-3fe2-4cb6-8107-732e14d645ab tempest-ProjectMemberTests-359761515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:32:21 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-11fdb9e8-3fe2-4cb6-8107-732e14d645ab tempest-ProjectMemberTests-359761515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:32:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-11fdb9e8-3fe2-4cb6-8107-732e14d645ab tempest-ProjectMemberTests-359761515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:21 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-11fdb9e8-3fe2-4cb6-8107-732e14d645ab tempest-ProjectMemberTests-359761515 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:32:21 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-11fdb9e8-3fe2-4cb6-8107-732e14d645ab tempest-ProjectMemberTests-359761515 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:32:21 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-11fdb9e8-3fe2-4cb6-8107-732e14d645ab tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:21 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-f29aa26a-bbfc-4604-b24c-24818ab40e6b tempest-ProjectReaderTests-1610880033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:32:21 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0 1073741824 Aug 31 15:32:21 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:21 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f29aa26a-bbfc-4604-b24c-24818ab40e6b tempest-ProjectReaderTests-1610880033 None] Flow 'volume_create_manager' (7d18df5e-f2a7-489e-b04d-a4e55c34d2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:32:21 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f29aa26a-bbfc-4604-b24c-24818ab40e6b tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c4bb29b-9c9b-4f67-b6d2-b2ba085713cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:21 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f29aa26a-bbfc-4604-b24c-24818ab40e6b tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c4bb29b-9c9b-4f67-b6d2-b2ba085713cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1362143100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0b9ebae-901f-4e9a-93e7-49fd3668c599,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b79b15895b454e8da3933af1bc11e4f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:32:22Z,use_quota=True,user_id='bc7ede8772e44e959581ef3ee880baf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:21 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f29aa26a-bbfc-4604-b24c-24818ab40e6b tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c2bfa0b-73c7-468d-a184-66044c057adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:21 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f29aa26a-bbfc-4604-b24c-24818ab40e6b tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c2bfa0b-73c7-468d-a184-66044c057adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:21 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f29aa26a-bbfc-4604-b24c-24818ab40e6b tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08f4a83c-a151-4f54-9545-0a3700d33700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:21 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f29aa26a-bbfc-4604-b24c-24818ab40e6b tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08f4a83c-a151-4f54-9545-0a3700d33700) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0b9ebae-901f-4e9a-93e7-49fd3668c599', 'volume_name': 'volume-b0b9ebae-901f-4e9a-93e7-49fd3668c599', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f29aa26a-bbfc-4604-b24c-24818ab40e6b tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fdc7e4b-8a4a-44b6-9db4-70dc350b3408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f29aa26a-bbfc-4604-b24c-24818ab40e6b tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fdc7e4b-8a4a-44b6-9db4-70dc350b3408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f29aa26a-bbfc-4604-b24c-24818ab40e6b tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c4cf1ff-76f1-4da2-98a0-af04452a0edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:22 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-f29aa26a-bbfc-4604-b24c-24818ab40e6b tempest-ProjectReaderTests-1610880033 None] Volume b0b9ebae-901f-4e9a-93e7-49fd3668c599: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0b9ebae-901f-4e9a-93e7-49fd3668c599', 'volume_size': 1} Aug 31 15:32:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f29aa26a-bbfc-4604-b24c-24818ab40e6b tempest-ProjectReaderTests-1610880033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:22 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-11fdb9e8-3fe2-4cb6-8107-732e14d645ab tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0 1073741824" returned: 0 in 0.460s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-11fdb9e8-3fe2-4cb6-8107-732e14d645ab tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:22 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0 Aug 31 15:32:22 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:22 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-11fdb9e8-3fe2-4cb6-8107-732e14d645ab tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0" returned: 0 in 0.249s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:22 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-11fdb9e8-3fe2-4cb6-8107-732e14d645ab tempest-ProjectMemberTests-359761515 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:32:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-11fdb9e8-3fe2-4cb6-8107-732e14d645ab tempest-ProjectMemberTests-359761515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f29aa26a-bbfc-4604-b24c-24818ab40e6b tempest-ProjectReaderTests-1610880033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.634s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:22 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f29aa26a-bbfc-4604-b24c-24818ab40e6b tempest-ProjectReaderTests-1610880033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1362143100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0b9ebae-901f-4e9a-93e7-49fd3668c599,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b79b15895b454e8da3933af1bc11e4f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:32:22Z,use_quota=True,user_id='bc7ede8772e44e959581ef3ee880baf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:32:22 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-f29aa26a-bbfc-4604-b24c-24818ab40e6b tempest-ProjectReaderTests-1610880033 None] Creating volume b0b9ebae-901f-4e9a-93e7-49fd3668c599 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:32:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f29aa26a-bbfc-4604-b24c-24818ab40e6b tempest-ProjectReaderTests-1610880033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f29aa26a-bbfc-4604-b24c-24818ab40e6b tempest-ProjectReaderTests-1610880033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:22 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f29aa26a-bbfc-4604-b24c-24818ab40e6b tempest-ProjectReaderTests-1610880033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:32:22 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f29aa26a-bbfc-4604-b24c-24818ab40e6b tempest-ProjectReaderTests-1610880033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:32:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f29aa26a-bbfc-4604-b24c-24818ab40e6b tempest-ProjectReaderTests-1610880033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:22 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f29aa26a-bbfc-4604-b24c-24818ab40e6b tempest-ProjectReaderTests-1610880033 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:32:22 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-f29aa26a-bbfc-4604-b24c-24818ab40e6b tempest-ProjectReaderTests-1610880033 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:32:22 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f29aa26a-bbfc-4604-b24c-24818ab40e6b tempest-ProjectReaderTests-1610880033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b0b9ebae-901f-4e9a-93e7-49fd3668c599 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-11fdb9e8-3fe2-4cb6-8107-732e14d645ab tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39aeee90-a040-4519-8e5f-6919849f2c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd593e09-75b3-4554-a4bd-4a07335a34c0', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:22 devstack sudo[106169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b0b9ebae-901f-4e9a-93e7-49fd3668c599 1073741824 Aug 31 15:32:22 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-11fdb9e8-3fe2-4cb6-8107-732e14d645ab tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (556ee330-3897-4c84-81f5-0eeb6ed2bb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:22 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-11fdb9e8-3fe2-4cb6-8107-732e14d645ab tempest-ProjectMemberTests-359761515 None] Volume volume-bd593e09-75b3-4554-a4bd-4a07335a34c0 (bd593e09-75b3-4554-a4bd-4a07335a34c0): created successfully Aug 31 15:32:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-11fdb9e8-3fe2-4cb6-8107-732e14d645ab tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (556ee330-3897-4c84-81f5-0eeb6ed2bb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:22 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-11fdb9e8-3fe2-4cb6-8107-732e14d645ab tempest-ProjectMemberTests-359761515 None] Flow 'volume_create_manager' (7fa59346-954b-438e-9a9a-f52efe617b6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:32:22 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-11fdb9e8-3fe2-4cb6-8107-732e14d645ab tempest-ProjectMemberTests-359761515 None] Created volume successfully. Aug 31 15:32:23 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f29aa26a-bbfc-4604-b24c-24818ab40e6b tempest-ProjectReaderTests-1610880033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b0b9ebae-901f-4e9a-93e7-49fd3668c599 1073741824" returned: 0 in 0.443s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f29aa26a-bbfc-4604-b24c-24818ab40e6b tempest-ProjectReaderTests-1610880033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b0b9ebae-901f-4e9a-93e7-49fd3668c599 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:23 devstack sudo[106175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b0b9ebae-901f-4e9a-93e7-49fd3668c599 Aug 31 15:32:23 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:23 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f29aa26a-bbfc-4604-b24c-24818ab40e6b tempest-ProjectReaderTests-1610880033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b0b9ebae-901f-4e9a-93e7-49fd3668c599" returned: 0 in 0.244s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:23 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-f29aa26a-bbfc-4604-b24c-24818ab40e6b tempest-ProjectReaderTests-1610880033 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:32:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-f29aa26a-bbfc-4604-b24c-24818ab40e6b tempest-ProjectReaderTests-1610880033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f29aa26a-bbfc-4604-b24c-24818ab40e6b tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c4cf1ff-76f1-4da2-98a0-af04452a0edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0b9ebae-901f-4e9a-93e7-49fd3668c599', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f29aa26a-bbfc-4604-b24c-24818ab40e6b tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44d3c60b-622b-4709-b31a-c34cf14177ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:23 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-f29aa26a-bbfc-4604-b24c-24818ab40e6b tempest-ProjectReaderTests-1610880033 None] Volume volume-b0b9ebae-901f-4e9a-93e7-49fd3668c599 (b0b9ebae-901f-4e9a-93e7-49fd3668c599): created successfully Aug 31 15:32:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f29aa26a-bbfc-4604-b24c-24818ab40e6b tempest-ProjectReaderTests-1610880033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44d3c60b-622b-4709-b31a-c34cf14177ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-f29aa26a-bbfc-4604-b24c-24818ab40e6b tempest-ProjectReaderTests-1610880033 None] Flow 'volume_create_manager' (7d18df5e-f2a7-489e-b04d-a4e55c34d2f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:32:23 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-f29aa26a-bbfc-4604-b24c-24818ab40e6b tempest-ProjectReaderTests-1610880033 None] Created volume successfully. Aug 31 15:32:23 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-c3dde317-3c03-46d5-858f-4c85392001c0 tempest-ProjectReaderTests-1610880033 None] Acquiring lock "cinder-b0b9ebae-901f-4e9a-93e7-49fd3668c599-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:23 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-c3dde317-3c03-46d5-858f-4c85392001c0 tempest-ProjectReaderTests-1610880033 None] Lock "cinder-b0b9ebae-901f-4e9a-93e7-49fd3668c599-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-d79b7389-7df5-4b29-b6fe-0939d0f4aa4d tempest-ProjectMemberTests-359761515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-d79b7389-7df5-4b29-b6fe-0939d0f4aa4d tempest-ProjectMemberTests-359761515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:23 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-c3dde317-3c03-46d5-858f-4c85392001c0 tempest-ProjectReaderTests-1610880033 None] Acquiring lock "cinder-quobyte-b0b9ebae-901f-4e9a-93e7-49fd3668c599" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:23 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-d79b7389-7df5-4b29-b6fe-0939d0f4aa4d tempest-ProjectMemberTests-359761515 None] Creating offline snapshot bdb83983-4766-4436-ba43-ad6d280bbc4e of volume bd593e09-75b3-4554-a4bd-4a07335a34c0 {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:32:23 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-c3dde317-3c03-46d5-858f-4c85392001c0 tempest-ProjectReaderTests-1610880033 None] Lock "cinder-quobyte-b0b9ebae-901f-4e9a-93e7-49fd3668c599" acquired by "delete_volume" :: waited 0.044s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:23 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85093b8-1fa2-4854-9119-74f08d9198cc]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:32:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d79b7389-7df5-4b29-b6fe-0939d0f4aa4d tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:24 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2caf9593-017a-4b98-b67d-b9f429216e2b]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:32:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c3dde317-3c03-46d5-858f-4c85392001c0 tempest-ProjectReaderTests-1610880033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b0b9ebae-901f-4e9a-93e7-49fd3668c599 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:24 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0 Aug 31 15:32:24 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:24 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b0b9ebae-901f-4e9a-93e7-49fd3668c599 Aug 31 15:32:24 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:24 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d79b7389-7df5-4b29-b6fe-0939d0f4aa4d tempest-ProjectMemberTests-359761515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0" returned: 0 in 0.416s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d79b7389-7df5-4b29-b6fe-0939d0f4aa4d tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0.bdb83983-4766-4436-ba43-ad6d280bbc4e 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:24 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c3dde317-3c03-46d5-858f-4c85392001c0 tempest-ProjectReaderTests-1610880033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b0b9ebae-901f-4e9a-93e7-49fd3668c599" returned: 0 in 0.414s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c3dde317-3c03-46d5-858f-4c85392001c0 tempest-ProjectReaderTests-1610880033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b0b9ebae-901f-4e9a-93e7-49fd3668c599 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:24 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0.bdb83983-4766-4436-ba43-ad6d280bbc4e 1G Aug 31 15:32:24 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:24 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b0b9ebae-901f-4e9a-93e7-49fd3668c599 Aug 31 15:32:24 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:24 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c3dde317-3c03-46d5-858f-4c85392001c0 tempest-ProjectReaderTests-1610880033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-b0b9ebae-901f-4e9a-93e7-49fd3668c599" returned: 0 in 0.262s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:24 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-c3dde317-3c03-46d5-858f-4c85392001c0 tempest-ProjectReaderTests-1610880033 None] Lock "cinder-quobyte-b0b9ebae-901f-4e9a-93e7-49fd3668c599" released by "delete_volume" :: held 0.735s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:24 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-c3dde317-3c03-46d5-858f-4c85392001c0 tempest-ProjectReaderTests-1610880033 None] Created reservations ['56e6bf42-0dbe-4352-8a77-272f95f095ee', '74d6c2de-290f-4b16-9058-4e9cdca721aa', '463207b8-66ae-48c7-8412-eca11b1ba9f3', '1fcb5ff2-29b2-4154-8eb4-60537f56c4fc'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:32:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c3dde317-3c03-46d5-858f-4c85392001c0 tempest-ProjectReaderTests-1610880033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c3dde317-3c03-46d5-858f-4c85392001c0 tempest-ProjectReaderTests-1610880033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:24 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c3dde317-3c03-46d5-858f-4c85392001c0 tempest-ProjectReaderTests-1610880033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:32:24 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c3dde317-3c03-46d5-858f-4c85392001c0 tempest-ProjectReaderTests-1610880033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:32:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c3dde317-3c03-46d5-858f-4c85392001c0 tempest-ProjectReaderTests-1610880033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c3dde317-3c03-46d5-858f-4c85392001c0 tempest-ProjectReaderTests-1610880033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:24 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:32:24 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:24 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d79b7389-7df5-4b29-b6fe-0939d0f4aa4d tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0.bdb83983-4766-4436-ba43-ad6d280bbc4e 1G" returned: 0 in 0.527s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d79b7389-7df5-4b29-b6fe-0939d0f4aa4d tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd593e09-75b3-4554-a4bd-4a07335a34c0 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0.bdb83983-4766-4436-ba43-ad6d280bbc4e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:24 devstack sudo[106201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd593e09-75b3-4554-a4bd-4a07335a34c0 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0.bdb83983-4766-4436-ba43-ad6d280bbc4e Aug 31 15:32:24 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:25 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c3dde317-3c03-46d5-858f-4c85392001c0 tempest-ProjectReaderTests-1610880033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.289s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:25 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-c3dde317-3c03-46d5-858f-4c85392001c0 tempest-ProjectReaderTests-1610880033 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:32:25 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-c3dde317-3c03-46d5-858f-4c85392001c0 tempest-ProjectReaderTests-1610880033 None] Deleted volume successfully. Aug 31 15:32:25 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-c3dde317-3c03-46d5-858f-4c85392001c0 tempest-ProjectReaderTests-1610880033 None] Lock "cinder-b0b9ebae-901f-4e9a-93e7-49fd3668c599-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:25 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d79b7389-7df5-4b29-b6fe-0939d0f4aa4d tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd593e09-75b3-4554-a4bd-4a07335a34c0 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0.bdb83983-4766-4436-ba43-ad6d280bbc4e" returned: 0 in 0.363s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:25 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-d79b7389-7df5-4b29-b6fe-0939d0f4aa4d tempest-ProjectMemberTests-359761515 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0.bdb83983-4766-4436-ba43-ad6d280bbc4e is being set with open permissions: ugo+rw Aug 31 15:32:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d79b7389-7df5-4b29-b6fe-0939d0f4aa4d tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0.bdb83983-4766-4436-ba43-ad6d280bbc4e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:25 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0.bdb83983-4766-4436-ba43-ad6d280bbc4e Aug 31 15:32:25 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:25 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d79b7389-7df5-4b29-b6fe-0939d0f4aa4d tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0.bdb83983-4766-4436-ba43-ad6d280bbc4e" returned: 0 in 0.279s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d79b7389-7df5-4b29-b6fe-0939d0f4aa4d tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:25 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0.info Aug 31 15:32:25 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:25 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d79b7389-7df5-4b29-b6fe-0939d0f4aa4d tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0.info" returned: 0 in 0.281s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:25 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-d79b7389-7df5-4b29-b6fe-0939d0f4aa4d tempest-ProjectMemberTests-359761515 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0.info is being set with open permissions: ugo+rw Aug 31 15:32:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d79b7389-7df5-4b29-b6fe-0939d0f4aa4d tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:25 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0.info Aug 31 15:32:25 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:26 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d79b7389-7df5-4b29-b6fe-0939d0f4aa4d tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0.info" returned: 0 in 0.336s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-d79b7389-7df5-4b29-b6fe-0939d0f4aa4d tempest-ProjectMemberTests-359761515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.332s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:26 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-d79b7389-7df5-4b29-b6fe-0939d0f4aa4d tempest-ProjectMemberTests-359761515 None] Create snapshot completed successfully Aug 31 15:32:27 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-1c1ae132-7515-4e9f-a5ee-6d60967e20e6 tempest-ProjectMemberTests-359761515 None] Acquiring lock "cinder-bdb83983-4766-4436-ba43-ad6d280bbc4e-delete_snapshot" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:27 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-1c1ae132-7515-4e9f-a5ee-6d60967e20e6 tempest-ProjectMemberTests-359761515 None] Lock "cinder-bdb83983-4766-4436-ba43-ad6d280bbc4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:27 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-1c1ae132-7515-4e9f-a5ee-6d60967e20e6 tempest-ProjectMemberTests-359761515 None] Acquiring lock "cinder-quobyte-bd593e09-75b3-4554-a4bd-4a07335a34c0" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:27 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-1c1ae132-7515-4e9f-a5ee-6d60967e20e6 tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-bd593e09-75b3-4554-a4bd-4a07335a34c0" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:27 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-1c1ae132-7515-4e9f-a5ee-6d60967e20e6 tempest-ProjectMemberTests-359761515 None] Acquiring lock "cinder-quobyte-bdb83983-4766-4436-ba43-ad6d280bbc4e" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:27 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-1c1ae132-7515-4e9f-a5ee-6d60967e20e6 tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-bdb83983-4766-4436-ba43-ad6d280bbc4e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:27 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-1c1ae132-7515-4e9f-a5ee-6d60967e20e6 tempest-ProjectMemberTests-359761515 None] Deleting offline snapshot bdb83983-4766-4436-ba43-ad6d280bbc4e of volume bd593e09-75b3-4554-a4bd-4a07335a34c0 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:32:27 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-1c1ae132-7515-4e9f-a5ee-6d60967e20e6 tempest-ProjectMemberTests-359761515 None] snapshot_file for this snap is: volume-bd593e09-75b3-4554-a4bd-4a07335a34c0.bdb83983-4766-4436-ba43-ad6d280bbc4e {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:32:27 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6fe55f-c277-4c91-8f00-9ccc69c4cf3b]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:32:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1c1ae132-7515-4e9f-a5ee-6d60967e20e6 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0.bdb83983-4766-4436-ba43-ad6d280bbc4e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:27 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0.bdb83983-4766-4436-ba43-ad6d280bbc4e Aug 31 15:32:27 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:27 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1c1ae132-7515-4e9f-a5ee-6d60967e20e6 tempest-ProjectMemberTests-359761515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0.bdb83983-4766-4436-ba43-ad6d280bbc4e" returned: 0 in 0.384s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:27 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-1c1ae132-7515-4e9f-a5ee-6d60967e20e6 tempest-ProjectMemberTests-359761515 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd593e09-75b3-4554-a4bd-4a07335a34c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:32:27 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b11ff6-7aa0-4416-9242-9dcc8ef9d54b]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:32:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1c1ae132-7515-4e9f-a5ee-6d60967e20e6 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:27 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0 Aug 31 15:32:27 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:27 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1c1ae132-7515-4e9f-a5ee-6d60967e20e6 tempest-ProjectMemberTests-359761515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0" returned: 0 in 0.363s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1c1ae132-7515-4e9f-a5ee-6d60967e20e6 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0.bdb83983-4766-4436-ba43-ad6d280bbc4e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:27 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0.bdb83983-4766-4436-ba43-ad6d280bbc4e Aug 31 15:32:27 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:28 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1c1ae132-7515-4e9f-a5ee-6d60967e20e6 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0.bdb83983-4766-4436-ba43-ad6d280bbc4e" returned: 0 in 0.332s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1c1ae132-7515-4e9f-a5ee-6d60967e20e6 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0.bdb83983-4766-4436-ba43-ad6d280bbc4e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:28 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0.bdb83983-4766-4436-ba43-ad6d280bbc4e Aug 31 15:32:28 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:28 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1c1ae132-7515-4e9f-a5ee-6d60967e20e6 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0.bdb83983-4766-4436-ba43-ad6d280bbc4e" returned: 0 in 0.265s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:28 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-1c1ae132-7515-4e9f-a5ee-6d60967e20e6 tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-bdb83983-4766-4436-ba43-ad6d280bbc4e" released by "_delete_snapshot" :: held 1.454s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:28 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-1c1ae132-7515-4e9f-a5ee-6d60967e20e6 tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-bd593e09-75b3-4554-a4bd-4a07335a34c0" released by "delete_snapshot" :: held 1.478s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:28 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-1c1ae132-7515-4e9f-a5ee-6d60967e20e6 tempest-ProjectMemberTests-359761515 None] Created reservations ['05b0591d-59d3-4a6d-b2b4-c19e8d304372', '80687933-fe2e-4947-9f0c-9fcf1247ecbf', '2bb5116e-2129-46aa-b92f-c5cd7d426a95', 'f8a45ea1-03fc-4704-b5ec-638d14c6ecad'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:32:28 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-1c1ae132-7515-4e9f-a5ee-6d60967e20e6 tempest-ProjectMemberTests-359761515 None] Delete snapshot completed successfully. Aug 31 15:32:28 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-1c1ae132-7515-4e9f-a5ee-6d60967e20e6 tempest-ProjectMemberTests-359761515 None] Lock "cinder-bdb83983-4766-4436-ba43-ad6d280bbc4e-delete_snapshot" released by "delete_snapshot" :: held 1.606s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:29 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6d3d0b99-1252-4d46-9f23-92301f2a730c tempest-ProjectMemberTests-359761515 None] Acquiring lock "cinder-bd593e09-75b3-4554-a4bd-4a07335a34c0-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:29 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6d3d0b99-1252-4d46-9f23-92301f2a730c tempest-ProjectMemberTests-359761515 None] Lock "cinder-bd593e09-75b3-4554-a4bd-4a07335a34c0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:29 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6d3d0b99-1252-4d46-9f23-92301f2a730c tempest-ProjectMemberTests-359761515 None] Acquiring lock "cinder-quobyte-bd593e09-75b3-4554-a4bd-4a07335a34c0" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:29 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6d3d0b99-1252-4d46-9f23-92301f2a730c tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-bd593e09-75b3-4554-a4bd-4a07335a34c0" acquired by "delete_volume" :: waited 0.015s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:29 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b0939f-e599-45ed-aaea-b105a712101a]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:32:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6d3d0b99-1252-4d46-9f23-92301f2a730c tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:29 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0 Aug 31 15:32:29 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:29 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6d3d0b99-1252-4d46-9f23-92301f2a730c tempest-ProjectMemberTests-359761515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0" returned: 0 in 0.349s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6d3d0b99-1252-4d46-9f23-92301f2a730c tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:29 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0 Aug 31 15:32:29 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:29 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6d3d0b99-1252-4d46-9f23-92301f2a730c tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-bd593e09-75b3-4554-a4bd-4a07335a34c0" returned: 0 in 0.234s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:29 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6d3d0b99-1252-4d46-9f23-92301f2a730c tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-bd593e09-75b3-4554-a4bd-4a07335a34c0" released by "delete_volume" :: held 0.639s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:30 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-6d3d0b99-1252-4d46-9f23-92301f2a730c tempest-ProjectMemberTests-359761515 None] Created reservations ['365d3ae9-1908-4a7f-8180-d0a8376ba589', 'de90dd88-5ec9-4462-b78b-262895d384f8', 'f6d03839-3d12-475e-a244-d07ef46f2065', '4338168e-bae3-4517-b81e-ef28b92ee15a'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:32:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6d3d0b99-1252-4d46-9f23-92301f2a730c tempest-ProjectMemberTests-359761515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6d3d0b99-1252-4d46-9f23-92301f2a730c tempest-ProjectMemberTests-359761515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:30 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6d3d0b99-1252-4d46-9f23-92301f2a730c tempest-ProjectMemberTests-359761515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:32:30 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-6d3d0b99-1252-4d46-9f23-92301f2a730c tempest-ProjectMemberTests-359761515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:32:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-6d3d0b99-1252-4d46-9f23-92301f2a730c tempest-ProjectMemberTests-359761515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6d3d0b99-1252-4d46-9f23-92301f2a730c tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:30 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:32:30 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:30 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6d3d0b99-1252-4d46-9f23-92301f2a730c tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.265s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:30 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-6d3d0b99-1252-4d46-9f23-92301f2a730c tempest-ProjectMemberTests-359761515 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:32:30 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-6d3d0b99-1252-4d46-9f23-92301f2a730c tempest-ProjectMemberTests-359761515 None] Deleted volume successfully. Aug 31 15:32:30 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6d3d0b99-1252-4d46-9f23-92301f2a730c tempest-ProjectMemberTests-359761515 None] Lock "cinder-bd593e09-75b3-4554-a4bd-4a07335a34c0-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:30 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-c286d03d-13f9-4bac-99a1-80104dfe3427 tempest-ProjectMemberTests-359761515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:32:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c286d03d-13f9-4bac-99a1-80104dfe3427 tempest-ProjectMemberTests-359761515 None] Flow 'volume_create_manager' (67be41fa-ee1f-440c-abcc-c75a9b3a13ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:32:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c286d03d-13f9-4bac-99a1-80104dfe3427 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b188647b-83ee-4c78-8f6a-17b5ffa955b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c286d03d-13f9-4bac-99a1-80104dfe3427 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b188647b-83ee-4c78-8f6a-17b5ffa955b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-509163270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8281abfa-287b-46c5-bc56-da376a0803b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1295f7809aa42af91604752ca7d0e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:32:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:32:31Z,use_quota=True,user_id='34bfe6cbc4544a40ad4b64e91c8b0d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c286d03d-13f9-4bac-99a1-80104dfe3427 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6464a06-6cd8-47c0-b677-302afe658111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c286d03d-13f9-4bac-99a1-80104dfe3427 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6464a06-6cd8-47c0-b677-302afe658111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c286d03d-13f9-4bac-99a1-80104dfe3427 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1bd5fbf-a0b1-47f6-88f6-387cac5946b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c286d03d-13f9-4bac-99a1-80104dfe3427 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1bd5fbf-a0b1-47f6-88f6-387cac5946b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8281abfa-287b-46c5-bc56-da376a0803b4', 'volume_name': 'volume-8281abfa-287b-46c5-bc56-da376a0803b4', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c286d03d-13f9-4bac-99a1-80104dfe3427 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46f60a1c-4112-4308-87ec-d78db58c69cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c286d03d-13f9-4bac-99a1-80104dfe3427 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46f60a1c-4112-4308-87ec-d78db58c69cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c286d03d-13f9-4bac-99a1-80104dfe3427 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd8e3990-d991-4ae7-acc7-7deab4bce0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:30 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-c286d03d-13f9-4bac-99a1-80104dfe3427 tempest-ProjectMemberTests-359761515 None] Volume 8281abfa-287b-46c5-bc56-da376a0803b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8281abfa-287b-46c5-bc56-da376a0803b4', 'volume_size': 1} Aug 31 15:32:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c286d03d-13f9-4bac-99a1-80104dfe3427 tempest-ProjectMemberTests-359761515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c286d03d-13f9-4bac-99a1-80104dfe3427 tempest-ProjectMemberTests-359761515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:30 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c286d03d-13f9-4bac-99a1-80104dfe3427 tempest-ProjectMemberTests-359761515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-509163270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8281abfa-287b-46c5-bc56-da376a0803b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1295f7809aa42af91604752ca7d0e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:32:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:32:31Z,use_quota=True,user_id='34bfe6cbc4544a40ad4b64e91c8b0d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:32:30 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-c286d03d-13f9-4bac-99a1-80104dfe3427 tempest-ProjectMemberTests-359761515 None] Creating volume 8281abfa-287b-46c5-bc56-da376a0803b4 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:32:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c286d03d-13f9-4bac-99a1-80104dfe3427 tempest-ProjectMemberTests-359761515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c286d03d-13f9-4bac-99a1-80104dfe3427 tempest-ProjectMemberTests-359761515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:30 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c286d03d-13f9-4bac-99a1-80104dfe3427 tempest-ProjectMemberTests-359761515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:32:30 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c286d03d-13f9-4bac-99a1-80104dfe3427 tempest-ProjectMemberTests-359761515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:32:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c286d03d-13f9-4bac-99a1-80104dfe3427 tempest-ProjectMemberTests-359761515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:30 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c286d03d-13f9-4bac-99a1-80104dfe3427 tempest-ProjectMemberTests-359761515 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:32:30 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-c286d03d-13f9-4bac-99a1-80104dfe3427 tempest-ProjectMemberTests-359761515 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:32:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c286d03d-13f9-4bac-99a1-80104dfe3427 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:30 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4 1073741824 Aug 31 15:32:30 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:31 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c286d03d-13f9-4bac-99a1-80104dfe3427 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4 1073741824" returned: 0 in 0.407s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c286d03d-13f9-4bac-99a1-80104dfe3427 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:31 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4 Aug 31 15:32:31 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:31 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c286d03d-13f9-4bac-99a1-80104dfe3427 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4" returned: 0 in 0.237s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:31 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-c286d03d-13f9-4bac-99a1-80104dfe3427 tempest-ProjectMemberTests-359761515 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:32:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c286d03d-13f9-4bac-99a1-80104dfe3427 tempest-ProjectMemberTests-359761515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c286d03d-13f9-4bac-99a1-80104dfe3427 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd8e3990-d991-4ae7-acc7-7deab4bce0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8281abfa-287b-46c5-bc56-da376a0803b4', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c286d03d-13f9-4bac-99a1-80104dfe3427 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e3d04da-2453-49ce-8cbf-08963a5abe05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:31 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-c286d03d-13f9-4bac-99a1-80104dfe3427 tempest-ProjectMemberTests-359761515 None] Volume volume-8281abfa-287b-46c5-bc56-da376a0803b4 (8281abfa-287b-46c5-bc56-da376a0803b4): created successfully Aug 31 15:32:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c286d03d-13f9-4bac-99a1-80104dfe3427 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e3d04da-2453-49ce-8cbf-08963a5abe05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-c286d03d-13f9-4bac-99a1-80104dfe3427 tempest-ProjectMemberTests-359761515 None] Flow 'volume_create_manager' (67be41fa-ee1f-440c-abcc-c75a9b3a13ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:32:31 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-c286d03d-13f9-4bac-99a1-80104dfe3427 tempest-ProjectMemberTests-359761515 None] Created volume successfully. Aug 31 15:32:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-0e0109cb-7545-4fbc-9f80-98c74353308e tempest-ProjectMemberTests-359761515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-0e0109cb-7545-4fbc-9f80-98c74353308e tempest-ProjectMemberTests-359761515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:32 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-0e0109cb-7545-4fbc-9f80-98c74353308e tempest-ProjectMemberTests-359761515 None] Creating offline snapshot 4c3f7f3d-4890-4e3c-9e4d-59b9335e4ba5 of volume 8281abfa-287b-46c5-bc56-da376a0803b4 {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:32:32 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9a832f-d579-4d3c-8331-de98116e1d2c]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:32:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0e0109cb-7545-4fbc-9f80-98c74353308e tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:32 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4 Aug 31 15:32:32 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:32 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0e0109cb-7545-4fbc-9f80-98c74353308e tempest-ProjectMemberTests-359761515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4" returned: 0 in 0.356s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0e0109cb-7545-4fbc-9f80-98c74353308e tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4.4c3f7f3d-4890-4e3c-9e4d-59b9335e4ba5 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:32 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4.4c3f7f3d-4890-4e3c-9e4d-59b9335e4ba5 1G Aug 31 15:32:32 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:32 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0e0109cb-7545-4fbc-9f80-98c74353308e tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4.4c3f7f3d-4890-4e3c-9e4d-59b9335e4ba5 1G" returned: 0 in 0.366s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0e0109cb-7545-4fbc-9f80-98c74353308e tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8281abfa-287b-46c5-bc56-da376a0803b4 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4.4c3f7f3d-4890-4e3c-9e4d-59b9335e4ba5 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:32 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8281abfa-287b-46c5-bc56-da376a0803b4 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4.4c3f7f3d-4890-4e3c-9e4d-59b9335e4ba5 Aug 31 15:32:32 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:33 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0e0109cb-7545-4fbc-9f80-98c74353308e tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8281abfa-287b-46c5-bc56-da376a0803b4 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4.4c3f7f3d-4890-4e3c-9e4d-59b9335e4ba5" returned: 0 in 0.283s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:33 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-0e0109cb-7545-4fbc-9f80-98c74353308e tempest-ProjectMemberTests-359761515 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4.4c3f7f3d-4890-4e3c-9e4d-59b9335e4ba5 is being set with open permissions: ugo+rw Aug 31 15:32:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0e0109cb-7545-4fbc-9f80-98c74353308e tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4.4c3f7f3d-4890-4e3c-9e4d-59b9335e4ba5 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:33 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4.4c3f7f3d-4890-4e3c-9e4d-59b9335e4ba5 Aug 31 15:32:33 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:33 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0e0109cb-7545-4fbc-9f80-98c74353308e tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4.4c3f7f3d-4890-4e3c-9e4d-59b9335e4ba5" returned: 0 in 0.241s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0e0109cb-7545-4fbc-9f80-98c74353308e tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:33 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4.info Aug 31 15:32:33 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:33 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0e0109cb-7545-4fbc-9f80-98c74353308e tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4.info" returned: 0 in 0.244s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:33 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-0e0109cb-7545-4fbc-9f80-98c74353308e tempest-ProjectMemberTests-359761515 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4.info is being set with open permissions: ugo+rw Aug 31 15:32:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0e0109cb-7545-4fbc-9f80-98c74353308e tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:33 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4.info Aug 31 15:32:33 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:33 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0e0109cb-7545-4fbc-9f80-98c74353308e tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4.info" returned: 0 in 0.230s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-0e0109cb-7545-4fbc-9f80-98c74353308e tempest-ProjectMemberTests-359761515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.798s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:33 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-0e0109cb-7545-4fbc-9f80-98c74353308e tempest-ProjectMemberTests-359761515 None] Create snapshot completed successfully Aug 31 15:32:34 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-899c2b7f-b368-4e17-a4c1-abfc0c5fb60f tempest-ProjectMemberTests-359761515 None] Acquiring lock "cinder-4c3f7f3d-4890-4e3c-9e4d-59b9335e4ba5-delete_snapshot" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:34 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-899c2b7f-b368-4e17-a4c1-abfc0c5fb60f tempest-ProjectMemberTests-359761515 None] Lock "cinder-4c3f7f3d-4890-4e3c-9e4d-59b9335e4ba5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:34 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-899c2b7f-b368-4e17-a4c1-abfc0c5fb60f tempest-ProjectMemberTests-359761515 None] Acquiring lock "cinder-quobyte-8281abfa-287b-46c5-bc56-da376a0803b4" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:34 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-899c2b7f-b368-4e17-a4c1-abfc0c5fb60f tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-8281abfa-287b-46c5-bc56-da376a0803b4" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:34 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-899c2b7f-b368-4e17-a4c1-abfc0c5fb60f tempest-ProjectMemberTests-359761515 None] Acquiring lock "cinder-quobyte-4c3f7f3d-4890-4e3c-9e4d-59b9335e4ba5" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:34 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-899c2b7f-b368-4e17-a4c1-abfc0c5fb60f tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-4c3f7f3d-4890-4e3c-9e4d-59b9335e4ba5" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:34 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-899c2b7f-b368-4e17-a4c1-abfc0c5fb60f tempest-ProjectMemberTests-359761515 None] Deleting offline snapshot 4c3f7f3d-4890-4e3c-9e4d-59b9335e4ba5 of volume 8281abfa-287b-46c5-bc56-da376a0803b4 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:32:34 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-899c2b7f-b368-4e17-a4c1-abfc0c5fb60f tempest-ProjectMemberTests-359761515 None] snapshot_file for this snap is: volume-8281abfa-287b-46c5-bc56-da376a0803b4.4c3f7f3d-4890-4e3c-9e4d-59b9335e4ba5 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:32:34 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[095d2c8c-36cb-4e8c-8092-c7900c81fafb]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:32:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-899c2b7f-b368-4e17-a4c1-abfc0c5fb60f tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4.4c3f7f3d-4890-4e3c-9e4d-59b9335e4ba5 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:34 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4.4c3f7f3d-4890-4e3c-9e4d-59b9335e4ba5 Aug 31 15:32:34 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:34 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-899c2b7f-b368-4e17-a4c1-abfc0c5fb60f tempest-ProjectMemberTests-359761515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4.4c3f7f3d-4890-4e3c-9e4d-59b9335e4ba5" returned: 0 in 0.374s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:34 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-899c2b7f-b368-4e17-a4c1-abfc0c5fb60f tempest-ProjectMemberTests-359761515 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8281abfa-287b-46c5-bc56-da376a0803b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:32:34 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5b147e-132e-48e5-a845-cd88cbd467c0]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:32:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-899c2b7f-b368-4e17-a4c1-abfc0c5fb60f tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:34 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4 Aug 31 15:32:34 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:34 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-899c2b7f-b368-4e17-a4c1-abfc0c5fb60f tempest-ProjectMemberTests-359761515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4" returned: 0 in 0.354s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-899c2b7f-b368-4e17-a4c1-abfc0c5fb60f tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4.4c3f7f3d-4890-4e3c-9e4d-59b9335e4ba5 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:35 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4.4c3f7f3d-4890-4e3c-9e4d-59b9335e4ba5 Aug 31 15:32:35 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:35 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-899c2b7f-b368-4e17-a4c1-abfc0c5fb60f tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4.4c3f7f3d-4890-4e3c-9e4d-59b9335e4ba5" returned: 0 in 0.318s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-899c2b7f-b368-4e17-a4c1-abfc0c5fb60f tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4.4c3f7f3d-4890-4e3c-9e4d-59b9335e4ba5 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:35 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4.4c3f7f3d-4890-4e3c-9e4d-59b9335e4ba5 Aug 31 15:32:35 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:35 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-899c2b7f-b368-4e17-a4c1-abfc0c5fb60f tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4.4c3f7f3d-4890-4e3c-9e4d-59b9335e4ba5" returned: 0 in 0.241s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:35 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-899c2b7f-b368-4e17-a4c1-abfc0c5fb60f tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-4c3f7f3d-4890-4e3c-9e4d-59b9335e4ba5" released by "_delete_snapshot" :: held 1.380s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:35 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-899c2b7f-b368-4e17-a4c1-abfc0c5fb60f tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-8281abfa-287b-46c5-bc56-da376a0803b4" released by "delete_snapshot" :: held 1.403s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:35 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-899c2b7f-b368-4e17-a4c1-abfc0c5fb60f tempest-ProjectMemberTests-359761515 None] Created reservations ['8cf4366b-1431-4b58-8b7f-83a0303640cc', 'e3af7fdb-e304-470a-bd22-461ad066ecd1', '4478c04b-50b3-468e-b46f-d5534e993d7c', '9b7e778a-332d-48d8-ab5d-0d0d8cd7e8ee'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:32:35 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-899c2b7f-b368-4e17-a4c1-abfc0c5fb60f tempest-ProjectMemberTests-359761515 None] Delete snapshot completed successfully. Aug 31 15:32:35 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-899c2b7f-b368-4e17-a4c1-abfc0c5fb60f tempest-ProjectMemberTests-359761515 None] Lock "cinder-4c3f7f3d-4890-4e3c-9e4d-59b9335e4ba5-delete_snapshot" released by "delete_snapshot" :: held 1.537s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:36 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-36ee1b70-4b78-433b-ba6e-3b1242a9ed40 tempest-ProjectMemberTests-359761515 None] Acquiring lock "cinder-8281abfa-287b-46c5-bc56-da376a0803b4-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:36 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-36ee1b70-4b78-433b-ba6e-3b1242a9ed40 tempest-ProjectMemberTests-359761515 None] Lock "cinder-8281abfa-287b-46c5-bc56-da376a0803b4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:36 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-36ee1b70-4b78-433b-ba6e-3b1242a9ed40 tempest-ProjectMemberTests-359761515 None] Acquiring lock "cinder-quobyte-8281abfa-287b-46c5-bc56-da376a0803b4" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:36 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-36ee1b70-4b78-433b-ba6e-3b1242a9ed40 tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-8281abfa-287b-46c5-bc56-da376a0803b4" acquired by "delete_volume" :: waited 0.016s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:36 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed325e87-6048-4e27-b9fa-df7b743e85c7]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:32:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-36ee1b70-4b78-433b-ba6e-3b1242a9ed40 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:36 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4 Aug 31 15:32:36 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:36 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-36ee1b70-4b78-433b-ba6e-3b1242a9ed40 tempest-ProjectMemberTests-359761515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4" returned: 0 in 0.342s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-36ee1b70-4b78-433b-ba6e-3b1242a9ed40 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:36 devstack sudo[106342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4 Aug 31 15:32:36 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:36 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-36ee1b70-4b78-433b-ba6e-3b1242a9ed40 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-8281abfa-287b-46c5-bc56-da376a0803b4" returned: 0 in 0.244s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:36 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-36ee1b70-4b78-433b-ba6e-3b1242a9ed40 tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-8281abfa-287b-46c5-bc56-da376a0803b4" released by "delete_volume" :: held 0.641s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:37 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-36ee1b70-4b78-433b-ba6e-3b1242a9ed40 tempest-ProjectMemberTests-359761515 None] Created reservations ['854d313e-edb5-4997-b402-287fae774690', '1c263ce9-8744-4231-927c-8767e8863193', '08b51aba-726d-4692-a80f-e258782c8294', 'cf1ca328-7b82-45c6-a486-408674aa1f33'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:32:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-36ee1b70-4b78-433b-ba6e-3b1242a9ed40 tempest-ProjectMemberTests-359761515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-36ee1b70-4b78-433b-ba6e-3b1242a9ed40 tempest-ProjectMemberTests-359761515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:37 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-36ee1b70-4b78-433b-ba6e-3b1242a9ed40 tempest-ProjectMemberTests-359761515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:32:37 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-36ee1b70-4b78-433b-ba6e-3b1242a9ed40 tempest-ProjectMemberTests-359761515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:32:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-36ee1b70-4b78-433b-ba6e-3b1242a9ed40 tempest-ProjectMemberTests-359761515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-36ee1b70-4b78-433b-ba6e-3b1242a9ed40 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:37 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:32:37 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:37 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-36ee1b70-4b78-433b-ba6e-3b1242a9ed40 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.246s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:37 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-36ee1b70-4b78-433b-ba6e-3b1242a9ed40 tempest-ProjectMemberTests-359761515 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:32:37 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-36ee1b70-4b78-433b-ba6e-3b1242a9ed40 tempest-ProjectMemberTests-359761515 None] Deleted volume successfully. Aug 31 15:32:37 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-36ee1b70-4b78-433b-ba6e-3b1242a9ed40 tempest-ProjectMemberTests-359761515 None] Lock "cinder-8281abfa-287b-46c5-bc56-da376a0803b4-delete_volume" released by "delete_volume" :: held 1.080s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:37 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-45b361ff-cbb9-4bf4-932e-3be87e58ae49 tempest-ProjectMemberTests-359761515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:32:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-45b361ff-cbb9-4bf4-932e-3be87e58ae49 tempest-ProjectMemberTests-359761515 None] Flow 'volume_create_manager' (7ce77650-3368-4c1d-be00-7495b6937ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:32:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-45b361ff-cbb9-4bf4-932e-3be87e58ae49 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e670e2c-efe4-4e75-a4ea-62c8a0624a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-45b361ff-cbb9-4bf4-932e-3be87e58ae49 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e670e2c-efe4-4e75-a4ea-62c8a0624a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-283379739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eca530b-bde6-41f5-be0a-170e455a833b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1295f7809aa42af91604752ca7d0e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:32:38Z,use_quota=True,user_id='34bfe6cbc4544a40ad4b64e91c8b0d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-45b361ff-cbb9-4bf4-932e-3be87e58ae49 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da41ee90-a6e4-43c3-911a-6220a3cffac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-45b361ff-cbb9-4bf4-932e-3be87e58ae49 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da41ee90-a6e4-43c3-911a-6220a3cffac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-45b361ff-cbb9-4bf4-932e-3be87e58ae49 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10c98be7-0661-4013-93cc-28b75bccdc17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-45b361ff-cbb9-4bf4-932e-3be87e58ae49 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10c98be7-0661-4013-93cc-28b75bccdc17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eca530b-bde6-41f5-be0a-170e455a833b', 'volume_name': 'volume-9eca530b-bde6-41f5-be0a-170e455a833b', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-45b361ff-cbb9-4bf4-932e-3be87e58ae49 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119a07a9-e515-41f2-83f9-b1467cf70666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-45b361ff-cbb9-4bf4-932e-3be87e58ae49 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119a07a9-e515-41f2-83f9-b1467cf70666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-45b361ff-cbb9-4bf4-932e-3be87e58ae49 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebbd2d1b-2af7-478f-bab7-9b0a8a3b3d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:37 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-45b361ff-cbb9-4bf4-932e-3be87e58ae49 tempest-ProjectMemberTests-359761515 None] Volume 9eca530b-bde6-41f5-be0a-170e455a833b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eca530b-bde6-41f5-be0a-170e455a833b', 'volume_size': 1} Aug 31 15:32:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-45b361ff-cbb9-4bf4-932e-3be87e58ae49 tempest-ProjectMemberTests-359761515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-45b361ff-cbb9-4bf4-932e-3be87e58ae49 tempest-ProjectMemberTests-359761515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:37 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-45b361ff-cbb9-4bf4-932e-3be87e58ae49 tempest-ProjectMemberTests-359761515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-283379739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eca530b-bde6-41f5-be0a-170e455a833b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1295f7809aa42af91604752ca7d0e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:32:38Z,use_quota=True,user_id='34bfe6cbc4544a40ad4b64e91c8b0d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:32:37 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-45b361ff-cbb9-4bf4-932e-3be87e58ae49 tempest-ProjectMemberTests-359761515 None] Creating volume 9eca530b-bde6-41f5-be0a-170e455a833b {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:32:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-45b361ff-cbb9-4bf4-932e-3be87e58ae49 tempest-ProjectMemberTests-359761515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-45b361ff-cbb9-4bf4-932e-3be87e58ae49 tempest-ProjectMemberTests-359761515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:37 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-45b361ff-cbb9-4bf4-932e-3be87e58ae49 tempest-ProjectMemberTests-359761515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:32:37 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-45b361ff-cbb9-4bf4-932e-3be87e58ae49 tempest-ProjectMemberTests-359761515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:32:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-45b361ff-cbb9-4bf4-932e-3be87e58ae49 tempest-ProjectMemberTests-359761515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:37 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-45b361ff-cbb9-4bf4-932e-3be87e58ae49 tempest-ProjectMemberTests-359761515 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:32:37 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-45b361ff-cbb9-4bf4-932e-3be87e58ae49 tempest-ProjectMemberTests-359761515 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:32:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-45b361ff-cbb9-4bf4-932e-3be87e58ae49 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:37 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b 1073741824 Aug 31 15:32:37 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:38 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-45b361ff-cbb9-4bf4-932e-3be87e58ae49 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b 1073741824" returned: 0 in 0.462s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-45b361ff-cbb9-4bf4-932e-3be87e58ae49 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:38 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b Aug 31 15:32:38 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:38 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-45b361ff-cbb9-4bf4-932e-3be87e58ae49 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b" returned: 0 in 0.237s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:38 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-45b361ff-cbb9-4bf4-932e-3be87e58ae49 tempest-ProjectMemberTests-359761515 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:32:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-45b361ff-cbb9-4bf4-932e-3be87e58ae49 tempest-ProjectMemberTests-359761515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:38 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-45b361ff-cbb9-4bf4-932e-3be87e58ae49 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebbd2d1b-2af7-478f-bab7-9b0a8a3b3d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eca530b-bde6-41f5-be0a-170e455a833b', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:38 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-45b361ff-cbb9-4bf4-932e-3be87e58ae49 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0d6a11b-a396-4182-bc5e-f392e47503be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:38 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-45b361ff-cbb9-4bf4-932e-3be87e58ae49 tempest-ProjectMemberTests-359761515 None] Volume volume-9eca530b-bde6-41f5-be0a-170e455a833b (9eca530b-bde6-41f5-be0a-170e455a833b): created successfully Aug 31 15:32:38 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-45b361ff-cbb9-4bf4-932e-3be87e58ae49 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0d6a11b-a396-4182-bc5e-f392e47503be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:38 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-45b361ff-cbb9-4bf4-932e-3be87e58ae49 tempest-ProjectMemberTests-359761515 None] Flow 'volume_create_manager' (7ce77650-3368-4c1d-be00-7495b6937ae5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:32:38 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-45b361ff-cbb9-4bf4-932e-3be87e58ae49 tempest-ProjectMemberTests-359761515 None] Created volume successfully. Aug 31 15:32:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ae348522-8f5f-4549-834a-6ee3c4dd5e4f tempest-ProjectMemberTests-359761515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ae348522-8f5f-4549-834a-6ee3c4dd5e4f tempest-ProjectMemberTests-359761515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:39 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-ae348522-8f5f-4549-834a-6ee3c4dd5e4f tempest-ProjectMemberTests-359761515 None] Creating offline snapshot 085f8c00-702f-4fdf-a33f-59636d7a2cd8 of volume 9eca530b-bde6-41f5-be0a-170e455a833b {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:32:39 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[02194e23-6cf4-414a-832f-725938fae07f]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:32:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ae348522-8f5f-4549-834a-6ee3c4dd5e4f tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:39 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b Aug 31 15:32:39 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:39 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ae348522-8f5f-4549-834a-6ee3c4dd5e4f tempest-ProjectMemberTests-359761515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b" returned: 0 in 0.367s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ae348522-8f5f-4549-834a-6ee3c4dd5e4f tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b.085f8c00-702f-4fdf-a33f-59636d7a2cd8 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:39 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b.085f8c00-702f-4fdf-a33f-59636d7a2cd8 1G Aug 31 15:32:39 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:39 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ae348522-8f5f-4549-834a-6ee3c4dd5e4f tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b.085f8c00-702f-4fdf-a33f-59636d7a2cd8 1G" returned: 0 in 0.375s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ae348522-8f5f-4549-834a-6ee3c4dd5e4f tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9eca530b-bde6-41f5-be0a-170e455a833b -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b.085f8c00-702f-4fdf-a33f-59636d7a2cd8 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:39 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9eca530b-bde6-41f5-be0a-170e455a833b -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b.085f8c00-702f-4fdf-a33f-59636d7a2cd8 Aug 31 15:32:39 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:40 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ae348522-8f5f-4549-834a-6ee3c4dd5e4f tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9eca530b-bde6-41f5-be0a-170e455a833b -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b.085f8c00-702f-4fdf-a33f-59636d7a2cd8" returned: 0 in 0.278s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:40 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-ae348522-8f5f-4549-834a-6ee3c4dd5e4f tempest-ProjectMemberTests-359761515 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b.085f8c00-702f-4fdf-a33f-59636d7a2cd8 is being set with open permissions: ugo+rw Aug 31 15:32:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ae348522-8f5f-4549-834a-6ee3c4dd5e4f tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b.085f8c00-702f-4fdf-a33f-59636d7a2cd8 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:40 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b.085f8c00-702f-4fdf-a33f-59636d7a2cd8 Aug 31 15:32:40 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:40 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ae348522-8f5f-4549-834a-6ee3c4dd5e4f tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b.085f8c00-702f-4fdf-a33f-59636d7a2cd8" returned: 0 in 0.246s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ae348522-8f5f-4549-834a-6ee3c4dd5e4f tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:40 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b.info Aug 31 15:32:40 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:40 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ae348522-8f5f-4549-834a-6ee3c4dd5e4f tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b.info" returned: 0 in 0.244s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:40 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-ae348522-8f5f-4549-834a-6ee3c4dd5e4f tempest-ProjectMemberTests-359761515 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b.info is being set with open permissions: ugo+rw Aug 31 15:32:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ae348522-8f5f-4549-834a-6ee3c4dd5e4f tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:40 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b.info Aug 31 15:32:40 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:40 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ae348522-8f5f-4549-834a-6ee3c4dd5e4f tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b.info" returned: 0 in 0.243s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ae348522-8f5f-4549-834a-6ee3c4dd5e4f tempest-ProjectMemberTests-359761515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.828s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:40 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-ae348522-8f5f-4549-834a-6ee3c4dd5e4f tempest-ProjectMemberTests-359761515 None] Create snapshot completed successfully Aug 31 15:32:41 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6065467c-94b1-4682-8726-f93caf3d1171 tempest-ProjectMemberTests-359761515 None] Acquiring lock "cinder-085f8c00-702f-4fdf-a33f-59636d7a2cd8-delete_snapshot" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:41 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6065467c-94b1-4682-8726-f93caf3d1171 tempest-ProjectMemberTests-359761515 None] Lock "cinder-085f8c00-702f-4fdf-a33f-59636d7a2cd8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:41 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6065467c-94b1-4682-8726-f93caf3d1171 tempest-ProjectMemberTests-359761515 None] Acquiring lock "cinder-quobyte-9eca530b-bde6-41f5-be0a-170e455a833b" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:41 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6065467c-94b1-4682-8726-f93caf3d1171 tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-9eca530b-bde6-41f5-be0a-170e455a833b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:41 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6065467c-94b1-4682-8726-f93caf3d1171 tempest-ProjectMemberTests-359761515 None] Acquiring lock "cinder-quobyte-085f8c00-702f-4fdf-a33f-59636d7a2cd8" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:41 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6065467c-94b1-4682-8726-f93caf3d1171 tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-085f8c00-702f-4fdf-a33f-59636d7a2cd8" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:41 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-6065467c-94b1-4682-8726-f93caf3d1171 tempest-ProjectMemberTests-359761515 None] Deleting offline snapshot 085f8c00-702f-4fdf-a33f-59636d7a2cd8 of volume 9eca530b-bde6-41f5-be0a-170e455a833b {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:32:41 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-6065467c-94b1-4682-8726-f93caf3d1171 tempest-ProjectMemberTests-359761515 None] snapshot_file for this snap is: volume-9eca530b-bde6-41f5-be0a-170e455a833b.085f8c00-702f-4fdf-a33f-59636d7a2cd8 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:32:41 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b9f215-99ce-46b9-989e-48f607eb52d1]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:32:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6065467c-94b1-4682-8726-f93caf3d1171 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b.085f8c00-702f-4fdf-a33f-59636d7a2cd8 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:41 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b.085f8c00-702f-4fdf-a33f-59636d7a2cd8 Aug 31 15:32:41 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:41 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6065467c-94b1-4682-8726-f93caf3d1171 tempest-ProjectMemberTests-359761515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b.085f8c00-702f-4fdf-a33f-59636d7a2cd8" returned: 0 in 0.359s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:41 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-6065467c-94b1-4682-8726-f93caf3d1171 tempest-ProjectMemberTests-359761515 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9eca530b-bde6-41f5-be0a-170e455a833b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:32:41 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9c6a3e-e846-43c8-84ce-24b1b68e761f]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:32:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6065467c-94b1-4682-8726-f93caf3d1171 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:41 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b Aug 31 15:32:41 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:41 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6065467c-94b1-4682-8726-f93caf3d1171 tempest-ProjectMemberTests-359761515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b" returned: 0 in 0.346s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6065467c-94b1-4682-8726-f93caf3d1171 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b.085f8c00-702f-4fdf-a33f-59636d7a2cd8 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:41 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b.085f8c00-702f-4fdf-a33f-59636d7a2cd8 Aug 31 15:32:41 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:42 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6065467c-94b1-4682-8726-f93caf3d1171 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b.085f8c00-702f-4fdf-a33f-59636d7a2cd8" returned: 0 in 0.345s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6065467c-94b1-4682-8726-f93caf3d1171 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b.085f8c00-702f-4fdf-a33f-59636d7a2cd8 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:42 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b.085f8c00-702f-4fdf-a33f-59636d7a2cd8 Aug 31 15:32:42 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:42 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-6065467c-94b1-4682-8726-f93caf3d1171 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b.085f8c00-702f-4fdf-a33f-59636d7a2cd8" returned: 0 in 0.247s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:42 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6065467c-94b1-4682-8726-f93caf3d1171 tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-085f8c00-702f-4fdf-a33f-59636d7a2cd8" released by "_delete_snapshot" :: held 1.387s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:42 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6065467c-94b1-4682-8726-f93caf3d1171 tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-9eca530b-bde6-41f5-be0a-170e455a833b" released by "delete_snapshot" :: held 1.407s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:42 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-6065467c-94b1-4682-8726-f93caf3d1171 tempest-ProjectMemberTests-359761515 None] Created reservations ['b693e0ae-b0be-49bb-bb7d-89300da05e49', 'd199a635-ca87-4131-bcf6-cfe006562361', 'd0736e44-257c-4542-8d9b-72a585f67d38', '3beece7f-1bf4-4610-b240-be01c43d668a'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:32:42 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-6065467c-94b1-4682-8726-f93caf3d1171 tempest-ProjectMemberTests-359761515 None] Delete snapshot completed successfully. Aug 31 15:32:42 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-6065467c-94b1-4682-8726-f93caf3d1171 tempest-ProjectMemberTests-359761515 None] Lock "cinder-085f8c00-702f-4fdf-a33f-59636d7a2cd8-delete_snapshot" released by "delete_snapshot" :: held 1.556s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:43 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-625e8e5b-1eb0-4490-8e24-f15a7427f845 tempest-ProjectMemberTests-359761515 None] Acquiring lock "cinder-9eca530b-bde6-41f5-be0a-170e455a833b-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:43 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-625e8e5b-1eb0-4490-8e24-f15a7427f845 tempest-ProjectMemberTests-359761515 None] Lock "cinder-9eca530b-bde6-41f5-be0a-170e455a833b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:43 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-625e8e5b-1eb0-4490-8e24-f15a7427f845 tempest-ProjectMemberTests-359761515 None] Acquiring lock "cinder-quobyte-9eca530b-bde6-41f5-be0a-170e455a833b" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:43 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-625e8e5b-1eb0-4490-8e24-f15a7427f845 tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-9eca530b-bde6-41f5-be0a-170e455a833b" acquired by "delete_volume" :: waited 0.015s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:43 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[592d056e-9431-4416-989d-df5b36af9a95]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:32:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-625e8e5b-1eb0-4490-8e24-f15a7427f845 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:43 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b Aug 31 15:32:43 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:43 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-625e8e5b-1eb0-4490-8e24-f15a7427f845 tempest-ProjectMemberTests-359761515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b" returned: 0 in 0.357s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-625e8e5b-1eb0-4490-8e24-f15a7427f845 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:43 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b Aug 31 15:32:43 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:44 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-625e8e5b-1eb0-4490-8e24-f15a7427f845 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-9eca530b-bde6-41f5-be0a-170e455a833b" returned: 0 in 0.247s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:44 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-625e8e5b-1eb0-4490-8e24-f15a7427f845 tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-9eca530b-bde6-41f5-be0a-170e455a833b" released by "delete_volume" :: held 0.656s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:44 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:UPDATE=199,cinder:DELETE=23,cinder:SELECT=169,cinder:INSERT=61 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:32:44 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-625e8e5b-1eb0-4490-8e24-f15a7427f845 tempest-ProjectMemberTests-359761515 None] Created reservations ['389b0e3a-9b84-498d-bd82-455552940528', '0d3570fc-6e10-4b67-b6b4-d8bb7c430bf4', '56164633-3a9b-4c5b-9960-ef007f06221a', 'bd4c4d98-c3fc-40a4-ad8f-e3350d4b233d'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:32:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-625e8e5b-1eb0-4490-8e24-f15a7427f845 tempest-ProjectMemberTests-359761515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-625e8e5b-1eb0-4490-8e24-f15a7427f845 tempest-ProjectMemberTests-359761515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:44 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-625e8e5b-1eb0-4490-8e24-f15a7427f845 tempest-ProjectMemberTests-359761515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:32:44 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-625e8e5b-1eb0-4490-8e24-f15a7427f845 tempest-ProjectMemberTests-359761515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:32:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-625e8e5b-1eb0-4490-8e24-f15a7427f845 tempest-ProjectMemberTests-359761515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-625e8e5b-1eb0-4490-8e24-f15a7427f845 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:44 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:32:44 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:44 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-625e8e5b-1eb0-4490-8e24-f15a7427f845 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.260s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:44 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-625e8e5b-1eb0-4490-8e24-f15a7427f845 tempest-ProjectMemberTests-359761515 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:32:44 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-625e8e5b-1eb0-4490-8e24-f15a7427f845 tempest-ProjectMemberTests-359761515 None] Deleted volume successfully. Aug 31 15:32:44 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-625e8e5b-1eb0-4490-8e24-f15a7427f845 tempest-ProjectMemberTests-359761515 None] Lock "cinder-9eca530b-bde6-41f5-be0a-170e455a833b-delete_volume" released by "delete_volume" :: held 1.130s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:44 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:UPDATE=241,cinder:INSERT=50,cinder:SELECT=157,cinder:DELETE=15 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:32:44 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-46b48935-09d3-4811-a826-a76785ce7446 tempest-ProjectMemberTests-359761515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:32:44 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-46b48935-09d3-4811-a826-a76785ce7446 tempest-ProjectMemberTests-359761515 None] Flow 'volume_create_manager' (8169f7cc-456d-44dc-a5d6-d316b889a365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:32:44 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-46b48935-09d3-4811-a826-a76785ce7446 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e00fdd7d-735e-482d-87ef-3604430dd44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:44 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-46b48935-09d3-4811-a826-a76785ce7446 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e00fdd7d-735e-482d-87ef-3604430dd44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1249856119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bd9837c-c9f7-4349-a835-3c61c47ce2ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1295f7809aa42af91604752ca7d0e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:32:45Z,use_quota=True,user_id='34bfe6cbc4544a40ad4b64e91c8b0d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:44 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-46b48935-09d3-4811-a826-a76785ce7446 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (694383fa-20bd-4bf2-bf86-1c226628ed0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:44 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-46b48935-09d3-4811-a826-a76785ce7446 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (694383fa-20bd-4bf2-bf86-1c226628ed0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:44 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-46b48935-09d3-4811-a826-a76785ce7446 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b60526f-85fb-4a2c-a4e6-a140dcd883dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:44 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-46b48935-09d3-4811-a826-a76785ce7446 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b60526f-85fb-4a2c-a4e6-a140dcd883dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bd9837c-c9f7-4349-a835-3c61c47ce2ed', 'volume_name': 'volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:44 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-46b48935-09d3-4811-a826-a76785ce7446 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a02df4ce-062f-4c1d-aaed-beb785673087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:44 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-46b48935-09d3-4811-a826-a76785ce7446 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a02df4ce-062f-4c1d-aaed-beb785673087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:44 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-46b48935-09d3-4811-a826-a76785ce7446 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9978026d-1c31-40c1-9c21-59ece08e8916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:44 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-46b48935-09d3-4811-a826-a76785ce7446 tempest-ProjectMemberTests-359761515 None] Volume 0bd9837c-c9f7-4349-a835-3c61c47ce2ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed', 'volume_size': 1} Aug 31 15:32:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-46b48935-09d3-4811-a826-a76785ce7446 tempest-ProjectMemberTests-359761515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-46b48935-09d3-4811-a826-a76785ce7446 tempest-ProjectMemberTests-359761515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:44 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-46b48935-09d3-4811-a826-a76785ce7446 tempest-ProjectMemberTests-359761515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1249856119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bd9837c-c9f7-4349-a835-3c61c47ce2ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1295f7809aa42af91604752ca7d0e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:32:45Z,use_quota=True,user_id='34bfe6cbc4544a40ad4b64e91c8b0d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:32:44 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-46b48935-09d3-4811-a826-a76785ce7446 tempest-ProjectMemberTests-359761515 None] Creating volume 0bd9837c-c9f7-4349-a835-3c61c47ce2ed {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:32:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-46b48935-09d3-4811-a826-a76785ce7446 tempest-ProjectMemberTests-359761515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-46b48935-09d3-4811-a826-a76785ce7446 tempest-ProjectMemberTests-359761515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:44 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-46b48935-09d3-4811-a826-a76785ce7446 tempest-ProjectMemberTests-359761515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:32:44 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-46b48935-09d3-4811-a826-a76785ce7446 tempest-ProjectMemberTests-359761515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:32:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-46b48935-09d3-4811-a826-a76785ce7446 tempest-ProjectMemberTests-359761515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:44 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-46b48935-09d3-4811-a826-a76785ce7446 tempest-ProjectMemberTests-359761515 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:32:44 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-46b48935-09d3-4811-a826-a76785ce7446 tempest-ProjectMemberTests-359761515 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:32:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-46b48935-09d3-4811-a826-a76785ce7446 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:45 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed 1073741824 Aug 31 15:32:45 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:45 devstack cinder-volume[86000]: DEBUG oslo_service.periodic_task [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86000) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:32:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:32:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:32:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:45 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:32:45 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:45 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.285s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:45 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:32:45 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:45 devstack cinder-volume[86000]: DEBUG oslo_service.periodic_task [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running periodic task VolumeManager._thread_info {{(pid=86000) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:32:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] thread count: 28 {{(pid=86000) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 31 15:32:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] thread info: [<_MainThread(MainThread, started 137631281086592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86000) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 31 15:32:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-46b48935-09d3-4811-a826-a76785ce7446 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed 1073741824" returned: 0 in 0.426s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-46b48935-09d3-4811-a826-a76785ce7446 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:45 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed Aug 31 15:32:45 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:45 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-46b48935-09d3-4811-a826-a76785ce7446 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed" returned: 0 in 0.249s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-46b48935-09d3-4811-a826-a76785ce7446 tempest-ProjectMemberTests-359761515 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:32:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-46b48935-09d3-4811-a826-a76785ce7446 tempest-ProjectMemberTests-359761515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-46b48935-09d3-4811-a826-a76785ce7446 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9978026d-1c31-40c1-9c21-59ece08e8916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-46b48935-09d3-4811-a826-a76785ce7446 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e7efbcd-bd0f-4470-be7a-a009846fdc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:45 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-46b48935-09d3-4811-a826-a76785ce7446 tempest-ProjectMemberTests-359761515 None] Volume volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed (0bd9837c-c9f7-4349-a835-3c61c47ce2ed): created successfully Aug 31 15:32:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-46b48935-09d3-4811-a826-a76785ce7446 tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e7efbcd-bd0f-4470-be7a-a009846fdc93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-46b48935-09d3-4811-a826-a76785ce7446 tempest-ProjectMemberTests-359761515 None] Flow 'volume_create_manager' (8169f7cc-456d-44dc-a5d6-d316b889a365) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:32:45 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-46b48935-09d3-4811-a826-a76785ce7446 tempest-ProjectMemberTests-359761515 None] Created volume successfully. Aug 31 15:32:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ceedc5a7-a642-4f58-8475-4a1c9f941743 tempest-ProjectMemberTests-359761515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ceedc5a7-a642-4f58-8475-4a1c9f941743 tempest-ProjectMemberTests-359761515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:46 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-ceedc5a7-a642-4f58-8475-4a1c9f941743 tempest-ProjectMemberTests-359761515 None] Creating offline snapshot 7cfc90d1-21dc-445f-b4c1-41272c856d7f of volume 0bd9837c-c9f7-4349-a835-3c61c47ce2ed {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:32:46 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a826a0b-b1a1-423c-88aa-793c6d8476b2]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:32:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ceedc5a7-a642-4f58-8475-4a1c9f941743 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:46 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed Aug 31 15:32:46 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:46 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ceedc5a7-a642-4f58-8475-4a1c9f941743 tempest-ProjectMemberTests-359761515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed" returned: 0 in 0.358s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ceedc5a7-a642-4f58-8475-4a1c9f941743 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed.7cfc90d1-21dc-445f-b4c1-41272c856d7f 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:46 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed.7cfc90d1-21dc-445f-b4c1-41272c856d7f 1G Aug 31 15:32:46 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:46 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ceedc5a7-a642-4f58-8475-4a1c9f941743 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed.7cfc90d1-21dc-445f-b4c1-41272c856d7f 1G" returned: 0 in 0.364s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ceedc5a7-a642-4f58-8475-4a1c9f941743 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed.7cfc90d1-21dc-445f-b4c1-41272c856d7f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:46 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed.7cfc90d1-21dc-445f-b4c1-41272c856d7f Aug 31 15:32:46 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:47 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ceedc5a7-a642-4f58-8475-4a1c9f941743 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed.7cfc90d1-21dc-445f-b4c1-41272c856d7f" returned: 0 in 0.294s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:47 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-ceedc5a7-a642-4f58-8475-4a1c9f941743 tempest-ProjectMemberTests-359761515 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed.7cfc90d1-21dc-445f-b4c1-41272c856d7f is being set with open permissions: ugo+rw Aug 31 15:32:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ceedc5a7-a642-4f58-8475-4a1c9f941743 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed.7cfc90d1-21dc-445f-b4c1-41272c856d7f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:47 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed.7cfc90d1-21dc-445f-b4c1-41272c856d7f Aug 31 15:32:47 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:47 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ceedc5a7-a642-4f58-8475-4a1c9f941743 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed.7cfc90d1-21dc-445f-b4c1-41272c856d7f" returned: 0 in 0.247s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ceedc5a7-a642-4f58-8475-4a1c9f941743 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:47 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed.info Aug 31 15:32:47 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:47 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ceedc5a7-a642-4f58-8475-4a1c9f941743 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed.info" returned: 0 in 0.257s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:47 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-ceedc5a7-a642-4f58-8475-4a1c9f941743 tempest-ProjectMemberTests-359761515 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed.info is being set with open permissions: ugo+rw Aug 31 15:32:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ceedc5a7-a642-4f58-8475-4a1c9f941743 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:47 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed.info Aug 31 15:32:47 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:47 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ceedc5a7-a642-4f58-8475-4a1c9f941743 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed.info" returned: 0 in 0.240s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ceedc5a7-a642-4f58-8475-4a1c9f941743 tempest-ProjectMemberTests-359761515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.835s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:47 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-ceedc5a7-a642-4f58-8475-4a1c9f941743 tempest-ProjectMemberTests-359761515 None] Create snapshot completed successfully Aug 31 15:32:48 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-0cefa8f0-15f4-4283-8bb4-ee08632d6773 tempest-ProjectMemberTests-359761515 None] Acquiring lock "cinder-7cfc90d1-21dc-445f-b4c1-41272c856d7f-delete_snapshot" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:48 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-0cefa8f0-15f4-4283-8bb4-ee08632d6773 tempest-ProjectMemberTests-359761515 None] Lock "cinder-7cfc90d1-21dc-445f-b4c1-41272c856d7f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:48 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-0cefa8f0-15f4-4283-8bb4-ee08632d6773 tempest-ProjectMemberTests-359761515 None] Acquiring lock "cinder-quobyte-0bd9837c-c9f7-4349-a835-3c61c47ce2ed" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:48 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-0cefa8f0-15f4-4283-8bb4-ee08632d6773 tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-0bd9837c-c9f7-4349-a835-3c61c47ce2ed" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:48 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-0cefa8f0-15f4-4283-8bb4-ee08632d6773 tempest-ProjectMemberTests-359761515 None] Acquiring lock "cinder-quobyte-7cfc90d1-21dc-445f-b4c1-41272c856d7f" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:48 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-0cefa8f0-15f4-4283-8bb4-ee08632d6773 tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-7cfc90d1-21dc-445f-b4c1-41272c856d7f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:48 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-0cefa8f0-15f4-4283-8bb4-ee08632d6773 tempest-ProjectMemberTests-359761515 None] Deleting offline snapshot 7cfc90d1-21dc-445f-b4c1-41272c856d7f of volume 0bd9837c-c9f7-4349-a835-3c61c47ce2ed {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:32:48 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-0cefa8f0-15f4-4283-8bb4-ee08632d6773 tempest-ProjectMemberTests-359761515 None] snapshot_file for this snap is: volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed.7cfc90d1-21dc-445f-b4c1-41272c856d7f {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:32:48 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bc2cd1-3dfa-479f-a3df-71f2af909ff3]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:32:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0cefa8f0-15f4-4283-8bb4-ee08632d6773 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed.7cfc90d1-21dc-445f-b4c1-41272c856d7f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:48 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed.7cfc90d1-21dc-445f-b4c1-41272c856d7f Aug 31 15:32:48 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:48 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0cefa8f0-15f4-4283-8bb4-ee08632d6773 tempest-ProjectMemberTests-359761515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed.7cfc90d1-21dc-445f-b4c1-41272c856d7f" returned: 0 in 0.365s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:48 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-0cefa8f0-15f4-4283-8bb4-ee08632d6773 tempest-ProjectMemberTests-359761515 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:32:48 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d936639c-a168-4cb8-a54b-6dc4b6d2ee1d]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:32:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0cefa8f0-15f4-4283-8bb4-ee08632d6773 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:48 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed Aug 31 15:32:48 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:49 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0cefa8f0-15f4-4283-8bb4-ee08632d6773 tempest-ProjectMemberTests-359761515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed" returned: 0 in 0.352s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0cefa8f0-15f4-4283-8bb4-ee08632d6773 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed.7cfc90d1-21dc-445f-b4c1-41272c856d7f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:49 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed.7cfc90d1-21dc-445f-b4c1-41272c856d7f Aug 31 15:32:49 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:49 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0cefa8f0-15f4-4283-8bb4-ee08632d6773 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed.7cfc90d1-21dc-445f-b4c1-41272c856d7f" returned: 0 in 0.346s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0cefa8f0-15f4-4283-8bb4-ee08632d6773 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed.7cfc90d1-21dc-445f-b4c1-41272c856d7f {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:49 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed.7cfc90d1-21dc-445f-b4c1-41272c856d7f Aug 31 15:32:49 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:49 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0cefa8f0-15f4-4283-8bb4-ee08632d6773 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed.7cfc90d1-21dc-445f-b4c1-41272c856d7f" returned: 0 in 0.254s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:49 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-0cefa8f0-15f4-4283-8bb4-ee08632d6773 tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-7cfc90d1-21dc-445f-b4c1-41272c856d7f" released by "_delete_snapshot" :: held 1.404s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:49 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-0cefa8f0-15f4-4283-8bb4-ee08632d6773 tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-0bd9837c-c9f7-4349-a835-3c61c47ce2ed" released by "delete_snapshot" :: held 1.425s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:49 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-0cefa8f0-15f4-4283-8bb4-ee08632d6773 tempest-ProjectMemberTests-359761515 None] Created reservations ['cf9ae35b-9af1-4b48-b526-86eaf9e54e37', 'e20049c8-e13a-495f-b2ad-f484d95ce883', 'fcc191c2-8e03-4e30-9707-2bf8f834d2bf', '7f7c92c6-d394-41e0-bb72-7c3f303111fd'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:32:49 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-0cefa8f0-15f4-4283-8bb4-ee08632d6773 tempest-ProjectMemberTests-359761515 None] Delete snapshot completed successfully. Aug 31 15:32:49 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-0cefa8f0-15f4-4283-8bb4-ee08632d6773 tempest-ProjectMemberTests-359761515 None] Lock "cinder-7cfc90d1-21dc-445f-b4c1-41272c856d7f-delete_snapshot" released by "delete_snapshot" :: held 1.548s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:50 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-3f329fda-a689-44ef-ad72-38511caf1727 tempest-ProjectMemberTests-359761515 None] Acquiring lock "cinder-0bd9837c-c9f7-4349-a835-3c61c47ce2ed-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:50 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-3f329fda-a689-44ef-ad72-38511caf1727 tempest-ProjectMemberTests-359761515 None] Lock "cinder-0bd9837c-c9f7-4349-a835-3c61c47ce2ed-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:50 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-3f329fda-a689-44ef-ad72-38511caf1727 tempest-ProjectMemberTests-359761515 None] Acquiring lock "cinder-quobyte-0bd9837c-c9f7-4349-a835-3c61c47ce2ed" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:50 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-3f329fda-a689-44ef-ad72-38511caf1727 tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-0bd9837c-c9f7-4349-a835-3c61c47ce2ed" acquired by "delete_volume" :: waited 0.017s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:50 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7383ec-2999-4a08-afc2-49f927881051]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:32:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-3f329fda-a689-44ef-ad72-38511caf1727 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:50 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed Aug 31 15:32:50 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:50 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-3f329fda-a689-44ef-ad72-38511caf1727 tempest-ProjectMemberTests-359761515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed" returned: 0 in 0.370s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-3f329fda-a689-44ef-ad72-38511caf1727 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:50 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed Aug 31 15:32:50 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:51 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-3f329fda-a689-44ef-ad72-38511caf1727 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-0bd9837c-c9f7-4349-a835-3c61c47ce2ed" returned: 0 in 0.231s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:51 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-3f329fda-a689-44ef-ad72-38511caf1727 tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-0bd9837c-c9f7-4349-a835-3c61c47ce2ed" released by "delete_volume" :: held 0.651s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:51 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-3f329fda-a689-44ef-ad72-38511caf1727 tempest-ProjectMemberTests-359761515 None] Created reservations ['ad99fdda-7516-43d9-939a-d17fb4417dca', '80725de0-724f-4371-a0c0-65298e31628f', '00595ee1-9c16-4e78-b961-0faa92f85a17', '97f24511-e61d-48b3-9d8f-d46d1dc5751c'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:32:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-3f329fda-a689-44ef-ad72-38511caf1727 tempest-ProjectMemberTests-359761515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-3f329fda-a689-44ef-ad72-38511caf1727 tempest-ProjectMemberTests-359761515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:51 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-3f329fda-a689-44ef-ad72-38511caf1727 tempest-ProjectMemberTests-359761515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:32:51 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-3f329fda-a689-44ef-ad72-38511caf1727 tempest-ProjectMemberTests-359761515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:32:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-3f329fda-a689-44ef-ad72-38511caf1727 tempest-ProjectMemberTests-359761515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-3f329fda-a689-44ef-ad72-38511caf1727 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:51 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:32:51 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:51 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-3f329fda-a689-44ef-ad72-38511caf1727 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.253s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:51 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-3f329fda-a689-44ef-ad72-38511caf1727 tempest-ProjectMemberTests-359761515 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:32:51 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-3f329fda-a689-44ef-ad72-38511caf1727 tempest-ProjectMemberTests-359761515 None] Deleted volume successfully. Aug 31 15:32:51 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-3f329fda-a689-44ef-ad72-38511caf1727 tempest-ProjectMemberTests-359761515 None] Lock "cinder-0bd9837c-c9f7-4349-a835-3c61c47ce2ed-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:51 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddd5db2d-71b1-4f26-8e69-1fc828ef645e tempest-ProjectMemberTests-359761515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:32:51 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ddd5db2d-71b1-4f26-8e69-1fc828ef645e tempest-ProjectMemberTests-359761515 None] Flow 'volume_create_manager' (7b66644a-a2aa-4711-8ba7-3946f5e8d3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:32:51 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ddd5db2d-71b1-4f26-8e69-1fc828ef645e tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d635547-5deb-446e-b763-2673200701c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:51 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ddd5db2d-71b1-4f26-8e69-1fc828ef645e tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d635547-5deb-446e-b763-2673200701c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-477344829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e6b7a00-92f3-4754-9a2b-0c4666d5d7af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1295f7809aa42af91604752ca7d0e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:32:52Z,use_quota=True,user_id='34bfe6cbc4544a40ad4b64e91c8b0d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:51 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ddd5db2d-71b1-4f26-8e69-1fc828ef645e tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (289e277a-6972-46b7-8cfa-63824780c180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:52 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ddd5db2d-71b1-4f26-8e69-1fc828ef645e tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (289e277a-6972-46b7-8cfa-63824780c180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:52 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ddd5db2d-71b1-4f26-8e69-1fc828ef645e tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a9b72b9-7ac6-4c3e-a2c7-83483adc0c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:52 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ddd5db2d-71b1-4f26-8e69-1fc828ef645e tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a9b72b9-7ac6-4c3e-a2c7-83483adc0c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e6b7a00-92f3-4754-9a2b-0c4666d5d7af', 'volume_name': 'volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:52 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ddd5db2d-71b1-4f26-8e69-1fc828ef645e tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38d111a6-ac88-481d-9eb9-92e8cc3b565d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:52 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ddd5db2d-71b1-4f26-8e69-1fc828ef645e tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38d111a6-ac88-481d-9eb9-92e8cc3b565d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:52 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ddd5db2d-71b1-4f26-8e69-1fc828ef645e tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6472be34-0af1-4058-9421-413766822a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:52 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-ddd5db2d-71b1-4f26-8e69-1fc828ef645e tempest-ProjectMemberTests-359761515 None] Volume 2e6b7a00-92f3-4754-9a2b-0c4666d5d7af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af', 'volume_size': 1} Aug 31 15:32:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ddd5db2d-71b1-4f26-8e69-1fc828ef645e tempest-ProjectMemberTests-359761515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ddd5db2d-71b1-4f26-8e69-1fc828ef645e tempest-ProjectMemberTests-359761515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:52 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-ddd5db2d-71b1-4f26-8e69-1fc828ef645e tempest-ProjectMemberTests-359761515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-477344829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e6b7a00-92f3-4754-9a2b-0c4666d5d7af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1295f7809aa42af91604752ca7d0e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:32:52Z,use_quota=True,user_id='34bfe6cbc4544a40ad4b64e91c8b0d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:32:52 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-ddd5db2d-71b1-4f26-8e69-1fc828ef645e tempest-ProjectMemberTests-359761515 None] Creating volume 2e6b7a00-92f3-4754-9a2b-0c4666d5d7af {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:32:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ddd5db2d-71b1-4f26-8e69-1fc828ef645e tempest-ProjectMemberTests-359761515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ddd5db2d-71b1-4f26-8e69-1fc828ef645e tempest-ProjectMemberTests-359761515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:52 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-ddd5db2d-71b1-4f26-8e69-1fc828ef645e tempest-ProjectMemberTests-359761515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:32:52 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-ddd5db2d-71b1-4f26-8e69-1fc828ef645e tempest-ProjectMemberTests-359761515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:32:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ddd5db2d-71b1-4f26-8e69-1fc828ef645e tempest-ProjectMemberTests-359761515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:52 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-ddd5db2d-71b1-4f26-8e69-1fc828ef645e tempest-ProjectMemberTests-359761515 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:32:52 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-ddd5db2d-71b1-4f26-8e69-1fc828ef645e tempest-ProjectMemberTests-359761515 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:32:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ddd5db2d-71b1-4f26-8e69-1fc828ef645e tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:52 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af 1073741824 Aug 31 15:32:52 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:52 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ddd5db2d-71b1-4f26-8e69-1fc828ef645e tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af 1073741824" returned: 0 in 0.402s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ddd5db2d-71b1-4f26-8e69-1fc828ef645e tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:52 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af Aug 31 15:32:52 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:52 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ddd5db2d-71b1-4f26-8e69-1fc828ef645e tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af" returned: 0 in 0.242s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:52 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-ddd5db2d-71b1-4f26-8e69-1fc828ef645e tempest-ProjectMemberTests-359761515 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:32:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ddd5db2d-71b1-4f26-8e69-1fc828ef645e tempest-ProjectMemberTests-359761515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:52 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ddd5db2d-71b1-4f26-8e69-1fc828ef645e tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6472be34-0af1-4058-9421-413766822a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:52 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ddd5db2d-71b1-4f26-8e69-1fc828ef645e tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (734a0f3c-fbcf-4974-bd8a-8a2bdfb5ae12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:52 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-ddd5db2d-71b1-4f26-8e69-1fc828ef645e tempest-ProjectMemberTests-359761515 None] Volume volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af (2e6b7a00-92f3-4754-9a2b-0c4666d5d7af): created successfully Aug 31 15:32:52 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ddd5db2d-71b1-4f26-8e69-1fc828ef645e tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (734a0f3c-fbcf-4974-bd8a-8a2bdfb5ae12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:52 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-ddd5db2d-71b1-4f26-8e69-1fc828ef645e tempest-ProjectMemberTests-359761515 None] Flow 'volume_create_manager' (7b66644a-a2aa-4711-8ba7-3946f5e8d3b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:32:52 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-ddd5db2d-71b1-4f26-8e69-1fc828ef645e tempest-ProjectMemberTests-359761515 None] Created volume successfully. Aug 31 15:32:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b6ac4b7d-f836-45a9-b8cc-124f5d5e07ac tempest-ProjectMemberTests-359761515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b6ac4b7d-f836-45a9-b8cc-124f5d5e07ac tempest-ProjectMemberTests-359761515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:53 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-b6ac4b7d-f836-45a9-b8cc-124f5d5e07ac tempest-ProjectMemberTests-359761515 None] Creating offline snapshot fccb86e9-c08e-4ebd-a404-de716fe0ae30 of volume 2e6b7a00-92f3-4754-9a2b-0c4666d5d7af {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:32:53 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[17cdb707-2bfd-4828-8778-82178ca01671]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:32:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b6ac4b7d-f836-45a9-b8cc-124f5d5e07ac tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:53 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af Aug 31 15:32:53 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:53 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b6ac4b7d-f836-45a9-b8cc-124f5d5e07ac tempest-ProjectMemberTests-359761515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af" returned: 0 in 0.357s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b6ac4b7d-f836-45a9-b8cc-124f5d5e07ac tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af.fccb86e9-c08e-4ebd-a404-de716fe0ae30 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:53 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af.fccb86e9-c08e-4ebd-a404-de716fe0ae30 1G Aug 31 15:32:53 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:53 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b6ac4b7d-f836-45a9-b8cc-124f5d5e07ac tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af.fccb86e9-c08e-4ebd-a404-de716fe0ae30 1G" returned: 0 in 0.399s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b6ac4b7d-f836-45a9-b8cc-124f5d5e07ac tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af.fccb86e9-c08e-4ebd-a404-de716fe0ae30 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:53 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af.fccb86e9-c08e-4ebd-a404-de716fe0ae30 Aug 31 15:32:53 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:54 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b6ac4b7d-f836-45a9-b8cc-124f5d5e07ac tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af.fccb86e9-c08e-4ebd-a404-de716fe0ae30" returned: 0 in 0.294s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:54 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-b6ac4b7d-f836-45a9-b8cc-124f5d5e07ac tempest-ProjectMemberTests-359761515 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af.fccb86e9-c08e-4ebd-a404-de716fe0ae30 is being set with open permissions: ugo+rw Aug 31 15:32:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b6ac4b7d-f836-45a9-b8cc-124f5d5e07ac tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af.fccb86e9-c08e-4ebd-a404-de716fe0ae30 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:54 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af.fccb86e9-c08e-4ebd-a404-de716fe0ae30 Aug 31 15:32:54 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:54 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b6ac4b7d-f836-45a9-b8cc-124f5d5e07ac tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af.fccb86e9-c08e-4ebd-a404-de716fe0ae30" returned: 0 in 0.252s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b6ac4b7d-f836-45a9-b8cc-124f5d5e07ac tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:54 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af.info Aug 31 15:32:54 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:54 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b6ac4b7d-f836-45a9-b8cc-124f5d5e07ac tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af.info" returned: 0 in 0.241s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:54 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-b6ac4b7d-f836-45a9-b8cc-124f5d5e07ac tempest-ProjectMemberTests-359761515 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af.info is being set with open permissions: ugo+rw Aug 31 15:32:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b6ac4b7d-f836-45a9-b8cc-124f5d5e07ac tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:54 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af.info Aug 31 15:32:54 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:54 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b6ac4b7d-f836-45a9-b8cc-124f5d5e07ac tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af.info" returned: 0 in 0.241s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b6ac4b7d-f836-45a9-b8cc-124f5d5e07ac tempest-ProjectMemberTests-359761515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.864s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:55 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-b6ac4b7d-f836-45a9-b8cc-124f5d5e07ac tempest-ProjectMemberTests-359761515 None] Create snapshot completed successfully Aug 31 15:32:55 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-66d793c8-0717-4e33-aeb0-237622b6bda2 tempest-ProjectMemberTests-359761515 None] Acquiring lock "cinder-fccb86e9-c08e-4ebd-a404-de716fe0ae30-delete_snapshot" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:55 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-66d793c8-0717-4e33-aeb0-237622b6bda2 tempest-ProjectMemberTests-359761515 None] Lock "cinder-fccb86e9-c08e-4ebd-a404-de716fe0ae30-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:55 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-66d793c8-0717-4e33-aeb0-237622b6bda2 tempest-ProjectMemberTests-359761515 None] Acquiring lock "cinder-quobyte-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:55 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-66d793c8-0717-4e33-aeb0-237622b6bda2 tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:55 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-66d793c8-0717-4e33-aeb0-237622b6bda2 tempest-ProjectMemberTests-359761515 None] Acquiring lock "cinder-quobyte-fccb86e9-c08e-4ebd-a404-de716fe0ae30" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:55 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-66d793c8-0717-4e33-aeb0-237622b6bda2 tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-fccb86e9-c08e-4ebd-a404-de716fe0ae30" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:55 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-66d793c8-0717-4e33-aeb0-237622b6bda2 tempest-ProjectMemberTests-359761515 None] Deleting offline snapshot fccb86e9-c08e-4ebd-a404-de716fe0ae30 of volume 2e6b7a00-92f3-4754-9a2b-0c4666d5d7af {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:32:55 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-66d793c8-0717-4e33-aeb0-237622b6bda2 tempest-ProjectMemberTests-359761515 None] snapshot_file for this snap is: volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af.fccb86e9-c08e-4ebd-a404-de716fe0ae30 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:32:55 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[692ead62-af38-444d-ab24-e849c84fe855]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:32:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-66d793c8-0717-4e33-aeb0-237622b6bda2 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af.fccb86e9-c08e-4ebd-a404-de716fe0ae30 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:55 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af.fccb86e9-c08e-4ebd-a404-de716fe0ae30 Aug 31 15:32:55 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:55 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-66d793c8-0717-4e33-aeb0-237622b6bda2 tempest-ProjectMemberTests-359761515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af.fccb86e9-c08e-4ebd-a404-de716fe0ae30" returned: 0 in 0.357s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:55 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-66d793c8-0717-4e33-aeb0-237622b6bda2 tempest-ProjectMemberTests-359761515 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:32:55 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[13006bda-649b-4046-92b3-7266106ed67b]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:32:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-66d793c8-0717-4e33-aeb0-237622b6bda2 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:55 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af Aug 31 15:32:55 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:56 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-66d793c8-0717-4e33-aeb0-237622b6bda2 tempest-ProjectMemberTests-359761515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af" returned: 0 in 0.349s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-66d793c8-0717-4e33-aeb0-237622b6bda2 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af.fccb86e9-c08e-4ebd-a404-de716fe0ae30 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:56 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af.fccb86e9-c08e-4ebd-a404-de716fe0ae30 Aug 31 15:32:56 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:56 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-66d793c8-0717-4e33-aeb0-237622b6bda2 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af.fccb86e9-c08e-4ebd-a404-de716fe0ae30" returned: 0 in 0.350s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-66d793c8-0717-4e33-aeb0-237622b6bda2 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af.fccb86e9-c08e-4ebd-a404-de716fe0ae30 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:56 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af.fccb86e9-c08e-4ebd-a404-de716fe0ae30 Aug 31 15:32:56 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:56 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-66d793c8-0717-4e33-aeb0-237622b6bda2 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af.fccb86e9-c08e-4ebd-a404-de716fe0ae30" returned: 0 in 0.256s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:56 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-66d793c8-0717-4e33-aeb0-237622b6bda2 tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-fccb86e9-c08e-4ebd-a404-de716fe0ae30" released by "_delete_snapshot" :: held 1.400s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:56 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-66d793c8-0717-4e33-aeb0-237622b6bda2 tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af" released by "delete_snapshot" :: held 1.426s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:56 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-66d793c8-0717-4e33-aeb0-237622b6bda2 tempest-ProjectMemberTests-359761515 None] Created reservations ['64346911-fd7a-4aee-ab90-cdaa5d9f548a', 'a4b2e23c-7ca8-41fc-8ea9-6267d4af6215', 'accd5bf1-cb3f-4f42-b258-e1e75bc5bd8d', '80e84476-1dc1-40b4-8bdc-298eff298b32'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:32:56 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-66d793c8-0717-4e33-aeb0-237622b6bda2 tempest-ProjectMemberTests-359761515 None] Delete snapshot completed successfully. Aug 31 15:32:56 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-66d793c8-0717-4e33-aeb0-237622b6bda2 tempest-ProjectMemberTests-359761515 None] Lock "cinder-fccb86e9-c08e-4ebd-a404-de716fe0ae30-delete_snapshot" released by "delete_snapshot" :: held 1.561s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:57 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-ab878f67-331d-4119-b4b0-76c28c106d6b tempest-ProjectMemberTests-359761515 None] Acquiring lock "cinder-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:57 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-ab878f67-331d-4119-b4b0-76c28c106d6b tempest-ProjectMemberTests-359761515 None] Lock "cinder-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:57 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-ab878f67-331d-4119-b4b0-76c28c106d6b tempest-ProjectMemberTests-359761515 None] Acquiring lock "cinder-quobyte-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:32:57 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-ab878f67-331d-4119-b4b0-76c28c106d6b tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af" acquired by "delete_volume" :: waited 0.019s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:32:57 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f67c12-a76a-4d94-b8c4-400984a41765]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:32:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ab878f67-331d-4119-b4b0-76c28c106d6b tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:57 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af Aug 31 15:32:57 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:57 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ab878f67-331d-4119-b4b0-76c28c106d6b tempest-ProjectMemberTests-359761515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af" returned: 0 in 0.361s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ab878f67-331d-4119-b4b0-76c28c106d6b tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:57 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af Aug 31 15:32:57 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:58 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ab878f67-331d-4119-b4b0-76c28c106d6b tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af" returned: 0 in 0.266s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:58 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-ab878f67-331d-4119-b4b0-76c28c106d6b tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af" released by "delete_volume" :: held 0.685s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:58 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-ab878f67-331d-4119-b4b0-76c28c106d6b tempest-ProjectMemberTests-359761515 None] Created reservations ['450f1d57-fe23-42b5-96ac-36f754c3e5fc', '13b8aca6-87dd-43ab-9791-d4df732c9f3d', 'a8f1d5e9-17da-4e2c-baab-11eb9cf333b2', 'd8085a4c-b42b-4ad2-ae84-e9f5cfd19f8d'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:32:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ab878f67-331d-4119-b4b0-76c28c106d6b tempest-ProjectMemberTests-359761515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ab878f67-331d-4119-b4b0-76c28c106d6b tempest-ProjectMemberTests-359761515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:58 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-ab878f67-331d-4119-b4b0-76c28c106d6b tempest-ProjectMemberTests-359761515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:32:58 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-ab878f67-331d-4119-b4b0-76c28c106d6b tempest-ProjectMemberTests-359761515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:32:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ab878f67-331d-4119-b4b0-76c28c106d6b tempest-ProjectMemberTests-359761515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ab878f67-331d-4119-b4b0-76c28c106d6b tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:58 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:32:58 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:58 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ab878f67-331d-4119-b4b0-76c28c106d6b tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.252s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:58 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-ab878f67-331d-4119-b4b0-76c28c106d6b tempest-ProjectMemberTests-359761515 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:32:58 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-ab878f67-331d-4119-b4b0-76c28c106d6b tempest-ProjectMemberTests-359761515 None] Deleted volume successfully. Aug 31 15:32:58 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-ab878f67-331d-4119-b4b0-76c28c106d6b tempest-ProjectMemberTests-359761515 None] Lock "cinder-2e6b7a00-92f3-4754-9a2b-0c4666d5d7af-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:32:58 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-1537a809-0c77-46ae-adee-e1c7b7c720ae tempest-ProjectMemberTests-359761515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:32:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1537a809-0c77-46ae-adee-e1c7b7c720ae tempest-ProjectMemberTests-359761515 None] Flow 'volume_create_manager' (159082f7-0621-4f88-b359-7e5a9725ac81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:32:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1537a809-0c77-46ae-adee-e1c7b7c720ae tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (929443cb-9912-42cd-9410-8da6b77e8d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1537a809-0c77-46ae-adee-e1c7b7c720ae tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (929443cb-9912-42cd-9410-8da6b77e8d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1842188129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e68eb25f-6965-49f8-acf7-5e550fe4f300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1295f7809aa42af91604752ca7d0e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:32:59Z,use_quota=True,user_id='34bfe6cbc4544a40ad4b64e91c8b0d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1537a809-0c77-46ae-adee-e1c7b7c720ae tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dfd6a8f-0b17-4a19-925a-46b6e8f1b4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1537a809-0c77-46ae-adee-e1c7b7c720ae tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dfd6a8f-0b17-4a19-925a-46b6e8f1b4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1537a809-0c77-46ae-adee-e1c7b7c720ae tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1623ec2a-27e4-47aa-9113-4333274f75c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1537a809-0c77-46ae-adee-e1c7b7c720ae tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1623ec2a-27e4-47aa-9113-4333274f75c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e68eb25f-6965-49f8-acf7-5e550fe4f300', 'volume_name': 'volume-e68eb25f-6965-49f8-acf7-5e550fe4f300', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1537a809-0c77-46ae-adee-e1c7b7c720ae tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8332da93-efef-4f30-b3e0-f1e31432407f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1537a809-0c77-46ae-adee-e1c7b7c720ae tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8332da93-efef-4f30-b3e0-f1e31432407f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1537a809-0c77-46ae-adee-e1c7b7c720ae tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c38f134a-a671-418e-aa50-34c29bdb08da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:59 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-1537a809-0c77-46ae-adee-e1c7b7c720ae tempest-ProjectMemberTests-359761515 None] Volume e68eb25f-6965-49f8-acf7-5e550fe4f300: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e68eb25f-6965-49f8-acf7-5e550fe4f300', 'volume_size': 1} Aug 31 15:32:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1537a809-0c77-46ae-adee-e1c7b7c720ae tempest-ProjectMemberTests-359761515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1537a809-0c77-46ae-adee-e1c7b7c720ae tempest-ProjectMemberTests-359761515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:59 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1537a809-0c77-46ae-adee-e1c7b7c720ae tempest-ProjectMemberTests-359761515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1842188129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e68eb25f-6965-49f8-acf7-5e550fe4f300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1295f7809aa42af91604752ca7d0e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:32:59Z,use_quota=True,user_id='34bfe6cbc4544a40ad4b64e91c8b0d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:32:59 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-1537a809-0c77-46ae-adee-e1c7b7c720ae tempest-ProjectMemberTests-359761515 None] Creating volume e68eb25f-6965-49f8-acf7-5e550fe4f300 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:32:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1537a809-0c77-46ae-adee-e1c7b7c720ae tempest-ProjectMemberTests-359761515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:32:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1537a809-0c77-46ae-adee-e1c7b7c720ae tempest-ProjectMemberTests-359761515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:32:59 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1537a809-0c77-46ae-adee-e1c7b7c720ae tempest-ProjectMemberTests-359761515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:32:59 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1537a809-0c77-46ae-adee-e1c7b7c720ae tempest-ProjectMemberTests-359761515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:32:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1537a809-0c77-46ae-adee-e1c7b7c720ae tempest-ProjectMemberTests-359761515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:59 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1537a809-0c77-46ae-adee-e1c7b7c720ae tempest-ProjectMemberTests-359761515 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:32:59 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-1537a809-0c77-46ae-adee-e1c7b7c720ae tempest-ProjectMemberTests-359761515 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:32:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1537a809-0c77-46ae-adee-e1c7b7c720ae tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:59 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300 1073741824 Aug 31 15:32:59 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:59 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1537a809-0c77-46ae-adee-e1c7b7c720ae tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300 1073741824" returned: 0 in 0.421s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1537a809-0c77-46ae-adee-e1c7b7c720ae tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:32:59 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300 Aug 31 15:32:59 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:32:59 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Aug 31 15:32:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-1537a809-0c77-46ae-adee-e1c7b7c720ae tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300" returned: 0 in 0.258s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:32:59 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-1537a809-0c77-46ae-adee-e1c7b7c720ae tempest-ProjectMemberTests-359761515 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:32:59 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-1537a809-0c77-46ae-adee-e1c7b7c720ae tempest-ProjectMemberTests-359761515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:32:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1537a809-0c77-46ae-adee-e1c7b7c720ae tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c38f134a-a671-418e-aa50-34c29bdb08da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e68eb25f-6965-49f8-acf7-5e550fe4f300', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1537a809-0c77-46ae-adee-e1c7b7c720ae tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (144782dc-942a-41ab-b7ea-82612a350b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:32:59 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-1537a809-0c77-46ae-adee-e1c7b7c720ae tempest-ProjectMemberTests-359761515 None] Volume volume-e68eb25f-6965-49f8-acf7-5e550fe4f300 (e68eb25f-6965-49f8-acf7-5e550fe4f300): created successfully Aug 31 15:32:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1537a809-0c77-46ae-adee-e1c7b7c720ae tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (144782dc-942a-41ab-b7ea-82612a350b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:32:59 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-1537a809-0c77-46ae-adee-e1c7b7c720ae tempest-ProjectMemberTests-359761515 None] Flow 'volume_create_manager' (159082f7-0621-4f88-b359-7e5a9725ac81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:32:59 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-1537a809-0c77-46ae-adee-e1c7b7c720ae tempest-ProjectMemberTests-359761515 None] Created volume successfully. Aug 31 15:33:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c275bcdb-b147-40cd-ab8d-657d12df1168 tempest-ProjectMemberTests-359761515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:33:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c275bcdb-b147-40cd-ab8d-657d12df1168 tempest-ProjectMemberTests-359761515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:33:00 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-c275bcdb-b147-40cd-ab8d-657d12df1168 tempest-ProjectMemberTests-359761515 None] Creating offline snapshot 0393f541-20dd-4bb1-bd87-f806e16de6b8 of volume e68eb25f-6965-49f8-acf7-5e550fe4f300 {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:33:00 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[371be076-0248-432c-82e5-d1ca47f28b1a]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:33:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c275bcdb-b147-40cd-ab8d-657d12df1168 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:00 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300 Aug 31 15:33:00 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:00 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c275bcdb-b147-40cd-ab8d-657d12df1168 tempest-ProjectMemberTests-359761515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300" returned: 0 in 0.358s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c275bcdb-b147-40cd-ab8d-657d12df1168 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300.0393f541-20dd-4bb1-bd87-f806e16de6b8 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:00 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300.0393f541-20dd-4bb1-bd87-f806e16de6b8 1G Aug 31 15:33:00 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:00 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c275bcdb-b147-40cd-ab8d-657d12df1168 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300.0393f541-20dd-4bb1-bd87-f806e16de6b8 1G" returned: 0 in 0.377s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:00 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c275bcdb-b147-40cd-ab8d-657d12df1168 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e68eb25f-6965-49f8-acf7-5e550fe4f300 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300.0393f541-20dd-4bb1-bd87-f806e16de6b8 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:00 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e68eb25f-6965-49f8-acf7-5e550fe4f300 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300.0393f541-20dd-4bb1-bd87-f806e16de6b8 Aug 31 15:33:00 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:01 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c275bcdb-b147-40cd-ab8d-657d12df1168 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e68eb25f-6965-49f8-acf7-5e550fe4f300 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300.0393f541-20dd-4bb1-bd87-f806e16de6b8" returned: 0 in 0.304s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:01 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-c275bcdb-b147-40cd-ab8d-657d12df1168 tempest-ProjectMemberTests-359761515 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300.0393f541-20dd-4bb1-bd87-f806e16de6b8 is being set with open permissions: ugo+rw Aug 31 15:33:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c275bcdb-b147-40cd-ab8d-657d12df1168 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300.0393f541-20dd-4bb1-bd87-f806e16de6b8 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:01 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300.0393f541-20dd-4bb1-bd87-f806e16de6b8 Aug 31 15:33:01 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:01 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c275bcdb-b147-40cd-ab8d-657d12df1168 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300.0393f541-20dd-4bb1-bd87-f806e16de6b8" returned: 0 in 0.244s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c275bcdb-b147-40cd-ab8d-657d12df1168 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:01 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300.info Aug 31 15:33:01 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:01 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c275bcdb-b147-40cd-ab8d-657d12df1168 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300.info" returned: 0 in 0.257s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:01 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-c275bcdb-b147-40cd-ab8d-657d12df1168 tempest-ProjectMemberTests-359761515 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300.info is being set with open permissions: ugo+rw Aug 31 15:33:01 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c275bcdb-b147-40cd-ab8d-657d12df1168 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:01 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300.info Aug 31 15:33:01 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:01 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-c275bcdb-b147-40cd-ab8d-657d12df1168 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300.info" returned: 0 in 0.245s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-c275bcdb-b147-40cd-ab8d-657d12df1168 tempest-ProjectMemberTests-359761515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.870s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:33:02 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-c275bcdb-b147-40cd-ab8d-657d12df1168 tempest-ProjectMemberTests-359761515 None] Create snapshot completed successfully Aug 31 15:33:02 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-24062ab4-7a3d-4319-97cf-2b78cf33d7ef tempest-ProjectMemberTests-359761515 None] Acquiring lock "cinder-0393f541-20dd-4bb1-bd87-f806e16de6b8-delete_snapshot" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:33:02 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-24062ab4-7a3d-4319-97cf-2b78cf33d7ef tempest-ProjectMemberTests-359761515 None] Lock "cinder-0393f541-20dd-4bb1-bd87-f806e16de6b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:33:02 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-24062ab4-7a3d-4319-97cf-2b78cf33d7ef tempest-ProjectMemberTests-359761515 None] Acquiring lock "cinder-quobyte-e68eb25f-6965-49f8-acf7-5e550fe4f300" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:33:02 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-24062ab4-7a3d-4319-97cf-2b78cf33d7ef tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-e68eb25f-6965-49f8-acf7-5e550fe4f300" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:33:02 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-24062ab4-7a3d-4319-97cf-2b78cf33d7ef tempest-ProjectMemberTests-359761515 None] Acquiring lock "cinder-quobyte-0393f541-20dd-4bb1-bd87-f806e16de6b8" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:33:02 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-24062ab4-7a3d-4319-97cf-2b78cf33d7ef tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-0393f541-20dd-4bb1-bd87-f806e16de6b8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:33:02 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-24062ab4-7a3d-4319-97cf-2b78cf33d7ef tempest-ProjectMemberTests-359761515 None] Deleting offline snapshot 0393f541-20dd-4bb1-bd87-f806e16de6b8 of volume e68eb25f-6965-49f8-acf7-5e550fe4f300 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:33:02 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-24062ab4-7a3d-4319-97cf-2b78cf33d7ef tempest-ProjectMemberTests-359761515 None] snapshot_file for this snap is: volume-e68eb25f-6965-49f8-acf7-5e550fe4f300.0393f541-20dd-4bb1-bd87-f806e16de6b8 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:33:02 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02f45d5-6da2-4f08-9687-686d7c297ae9]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:33:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-24062ab4-7a3d-4319-97cf-2b78cf33d7ef tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300.0393f541-20dd-4bb1-bd87-f806e16de6b8 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:02 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300.0393f541-20dd-4bb1-bd87-f806e16de6b8 Aug 31 15:33:02 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:02 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-24062ab4-7a3d-4319-97cf-2b78cf33d7ef tempest-ProjectMemberTests-359761515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300.0393f541-20dd-4bb1-bd87-f806e16de6b8" returned: 0 in 0.356s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:02 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-24062ab4-7a3d-4319-97cf-2b78cf33d7ef tempest-ProjectMemberTests-359761515 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e68eb25f-6965-49f8-acf7-5e550fe4f300(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:33:02 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d761b2c3-4f06-4208-b304-7a3ca58d1bc3]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:33:02 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-24062ab4-7a3d-4319-97cf-2b78cf33d7ef tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:02 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300 Aug 31 15:33:02 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:03 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-24062ab4-7a3d-4319-97cf-2b78cf33d7ef tempest-ProjectMemberTests-359761515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300" returned: 0 in 0.345s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-24062ab4-7a3d-4319-97cf-2b78cf33d7ef tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300.0393f541-20dd-4bb1-bd87-f806e16de6b8 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:03 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300.0393f541-20dd-4bb1-bd87-f806e16de6b8 Aug 31 15:33:03 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:03 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-24062ab4-7a3d-4319-97cf-2b78cf33d7ef tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300.0393f541-20dd-4bb1-bd87-f806e16de6b8" returned: 0 in 0.339s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-24062ab4-7a3d-4319-97cf-2b78cf33d7ef tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300.0393f541-20dd-4bb1-bd87-f806e16de6b8 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:03 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300.0393f541-20dd-4bb1-bd87-f806e16de6b8 Aug 31 15:33:03 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:03 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:03 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-24062ab4-7a3d-4319-97cf-2b78cf33d7ef tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300.0393f541-20dd-4bb1-bd87-f806e16de6b8" returned: 0 in 0.248s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:03 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-24062ab4-7a3d-4319-97cf-2b78cf33d7ef tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-0393f541-20dd-4bb1-bd87-f806e16de6b8" released by "_delete_snapshot" :: held 1.375s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:33:03 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-24062ab4-7a3d-4319-97cf-2b78cf33d7ef tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-e68eb25f-6965-49f8-acf7-5e550fe4f300" released by "delete_snapshot" :: held 1.398s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:33:03 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-24062ab4-7a3d-4319-97cf-2b78cf33d7ef tempest-ProjectMemberTests-359761515 None] Created reservations ['125963ad-5201-41d2-b921-db98ccc92c9c', 'a3df9125-5fd7-4f5d-9980-071c731b805d', '4f36c39e-08e3-4b92-8630-7539cbfb29c2', 'ba2d134e-8e99-4dc0-b1ed-bdfb4769dc04'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:33:03 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-24062ab4-7a3d-4319-97cf-2b78cf33d7ef tempest-ProjectMemberTests-359761515 None] Delete snapshot completed successfully. Aug 31 15:33:03 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-24062ab4-7a3d-4319-97cf-2b78cf33d7ef tempest-ProjectMemberTests-359761515 None] Lock "cinder-0393f541-20dd-4bb1-bd87-f806e16de6b8-delete_snapshot" released by "delete_snapshot" :: held 1.545s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:33:04 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-bb689965-e882-4679-b736-55a704cd8d38 tempest-ProjectMemberTests-359761515 None] Acquiring lock "cinder-e68eb25f-6965-49f8-acf7-5e550fe4f300-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:33:04 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-bb689965-e882-4679-b736-55a704cd8d38 tempest-ProjectMemberTests-359761515 None] Lock "cinder-e68eb25f-6965-49f8-acf7-5e550fe4f300-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:33:04 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-bb689965-e882-4679-b736-55a704cd8d38 tempest-ProjectMemberTests-359761515 None] Acquiring lock "cinder-quobyte-e68eb25f-6965-49f8-acf7-5e550fe4f300" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:33:04 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-bb689965-e882-4679-b736-55a704cd8d38 tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-e68eb25f-6965-49f8-acf7-5e550fe4f300" acquired by "delete_volume" :: waited 0.016s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:33:04 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c792ed2c-31a0-42e0-9fdd-05b65ae9fd90]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:33:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bb689965-e882-4679-b736-55a704cd8d38 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:04 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300 Aug 31 15:33:04 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:04 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bb689965-e882-4679-b736-55a704cd8d38 tempest-ProjectMemberTests-359761515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300" returned: 0 in 0.359s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:04 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bb689965-e882-4679-b736-55a704cd8d38 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:04 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300 Aug 31 15:33:04 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:05 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bb689965-e882-4679-b736-55a704cd8d38 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-e68eb25f-6965-49f8-acf7-5e550fe4f300" returned: 0 in 0.263s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:05 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-bb689965-e882-4679-b736-55a704cd8d38 tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-e68eb25f-6965-49f8-acf7-5e550fe4f300" released by "delete_volume" :: held 0.678s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:33:05 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-bb689965-e882-4679-b736-55a704cd8d38 tempest-ProjectMemberTests-359761515 None] Created reservations ['bbf1fcaf-94b4-46f6-8bb2-892e6788839b', '5324c977-d6a0-4dc6-82c2-6a159204440a', 'c539c399-3c67-430d-b416-393fbaa59b50', 'd5f58d97-63b6-4056-8e97-407d92e25fc8'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:33:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bb689965-e882-4679-b736-55a704cd8d38 tempest-ProjectMemberTests-359761515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:33:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bb689965-e882-4679-b736-55a704cd8d38 tempest-ProjectMemberTests-359761515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:33:05 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-bb689965-e882-4679-b736-55a704cd8d38 tempest-ProjectMemberTests-359761515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:33:05 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-bb689965-e882-4679-b736-55a704cd8d38 tempest-ProjectMemberTests-359761515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:33:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bb689965-e882-4679-b736-55a704cd8d38 tempest-ProjectMemberTests-359761515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:33:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bb689965-e882-4679-b736-55a704cd8d38 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:05 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:33:05 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:05 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:05 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bb689965-e882-4679-b736-55a704cd8d38 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.257s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:05 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-bb689965-e882-4679-b736-55a704cd8d38 tempest-ProjectMemberTests-359761515 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:33:05 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-bb689965-e882-4679-b736-55a704cd8d38 tempest-ProjectMemberTests-359761515 None] Deleted volume successfully. Aug 31 15:33:05 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-bb689965-e882-4679-b736-55a704cd8d38 tempest-ProjectMemberTests-359761515 None] Lock "cinder-e68eb25f-6965-49f8-acf7-5e550fe4f300-delete_volume" released by "delete_volume" :: held 1.122s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:33:06 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-73eec10c-8141-42c1-bc27-35146a876e2b tempest-ProjectMemberTests-359761515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:33:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-73eec10c-8141-42c1-bc27-35146a876e2b tempest-ProjectMemberTests-359761515 None] Flow 'volume_create_manager' (99a0012c-a892-483e-b133-0d78844fe7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:33:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-73eec10c-8141-42c1-bc27-35146a876e2b tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b94c3fe9-18be-4164-a0cf-00192262e4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:33:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-73eec10c-8141-42c1-bc27-35146a876e2b tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b94c3fe9-18be-4164-a0cf-00192262e4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-267480428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a18a63-2609-46aa-9732-5fdf26e145e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1295f7809aa42af91604752ca7d0e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:33:06Z,use_quota=True,user_id='34bfe6cbc4544a40ad4b64e91c8b0d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:33:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-73eec10c-8141-42c1-bc27-35146a876e2b tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1706d404-8b85-404b-8ea3-0cbb791d5e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:33:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-73eec10c-8141-42c1-bc27-35146a876e2b tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1706d404-8b85-404b-8ea3-0cbb791d5e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:33:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-73eec10c-8141-42c1-bc27-35146a876e2b tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba62fc98-b95a-4609-92a9-145184363fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:33:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-73eec10c-8141-42c1-bc27-35146a876e2b tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba62fc98-b95a-4609-92a9-145184363fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82a18a63-2609-46aa-9732-5fdf26e145e0', 'volume_name': 'volume-82a18a63-2609-46aa-9732-5fdf26e145e0', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:33:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-73eec10c-8141-42c1-bc27-35146a876e2b tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c63ee51c-8344-46f2-b462-2abc39fcce9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:33:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-73eec10c-8141-42c1-bc27-35146a876e2b tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c63ee51c-8344-46f2-b462-2abc39fcce9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:33:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-73eec10c-8141-42c1-bc27-35146a876e2b tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e717111-434b-4f6a-9891-d1fcc2ac0068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:33:06 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-73eec10c-8141-42c1-bc27-35146a876e2b tempest-ProjectMemberTests-359761515 None] Volume 82a18a63-2609-46aa-9732-5fdf26e145e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82a18a63-2609-46aa-9732-5fdf26e145e0', 'volume_size': 1} Aug 31 15:33:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-73eec10c-8141-42c1-bc27-35146a876e2b tempest-ProjectMemberTests-359761515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:33:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-73eec10c-8141-42c1-bc27-35146a876e2b tempest-ProjectMemberTests-359761515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:33:06 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-73eec10c-8141-42c1-bc27-35146a876e2b tempest-ProjectMemberTests-359761515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-267480428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a18a63-2609-46aa-9732-5fdf26e145e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1295f7809aa42af91604752ca7d0e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:33:06Z,use_quota=True,user_id='34bfe6cbc4544a40ad4b64e91c8b0d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:33:06 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-73eec10c-8141-42c1-bc27-35146a876e2b tempest-ProjectMemberTests-359761515 None] Creating volume 82a18a63-2609-46aa-9732-5fdf26e145e0 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:33:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-73eec10c-8141-42c1-bc27-35146a876e2b tempest-ProjectMemberTests-359761515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:33:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-73eec10c-8141-42c1-bc27-35146a876e2b tempest-ProjectMemberTests-359761515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:33:06 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-73eec10c-8141-42c1-bc27-35146a876e2b tempest-ProjectMemberTests-359761515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:33:06 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-73eec10c-8141-42c1-bc27-35146a876e2b tempest-ProjectMemberTests-359761515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:33:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-73eec10c-8141-42c1-bc27-35146a876e2b tempest-ProjectMemberTests-359761515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:33:06 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-73eec10c-8141-42c1-bc27-35146a876e2b tempest-ProjectMemberTests-359761515 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:33:06 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-73eec10c-8141-42c1-bc27-35146a876e2b tempest-ProjectMemberTests-359761515 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:33:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-73eec10c-8141-42c1-bc27-35146a876e2b tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:06 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0 1073741824 Aug 31 15:33:06 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:06 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-73eec10c-8141-42c1-bc27-35146a876e2b tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0 1073741824" returned: 0 in 0.426s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-73eec10c-8141-42c1-bc27-35146a876e2b tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:06 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0 Aug 31 15:33:06 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:06 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-73eec10c-8141-42c1-bc27-35146a876e2b tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0" returned: 0 in 0.289s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:06 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-73eec10c-8141-42c1-bc27-35146a876e2b tempest-ProjectMemberTests-359761515 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:33:06 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-73eec10c-8141-42c1-bc27-35146a876e2b tempest-ProjectMemberTests-359761515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:33:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-73eec10c-8141-42c1-bc27-35146a876e2b tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e717111-434b-4f6a-9891-d1fcc2ac0068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82a18a63-2609-46aa-9732-5fdf26e145e0', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:33:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-73eec10c-8141-42c1-bc27-35146a876e2b tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c43f551e-7d54-4aae-b432-488c69658c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:33:06 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-73eec10c-8141-42c1-bc27-35146a876e2b tempest-ProjectMemberTests-359761515 None] Volume volume-82a18a63-2609-46aa-9732-5fdf26e145e0 (82a18a63-2609-46aa-9732-5fdf26e145e0): created successfully Aug 31 15:33:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-73eec10c-8141-42c1-bc27-35146a876e2b tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c43f551e-7d54-4aae-b432-488c69658c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:33:06 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-73eec10c-8141-42c1-bc27-35146a876e2b tempest-ProjectMemberTests-359761515 None] Flow 'volume_create_manager' (99a0012c-a892-483e-b133-0d78844fe7cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:33:06 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-73eec10c-8141-42c1-bc27-35146a876e2b tempest-ProjectMemberTests-359761515 None] Created volume successfully. Aug 31 15:33:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e2421e0c-5339-4fbe-9bad-891b1d9e04d1 tempest-ProjectMemberTests-359761515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:33:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e2421e0c-5339-4fbe-9bad-891b1d9e04d1 tempest-ProjectMemberTests-359761515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:33:07 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-e2421e0c-5339-4fbe-9bad-891b1d9e04d1 tempest-ProjectMemberTests-359761515 None] Creating offline snapshot 2c8813b9-156d-41e7-8648-cb3158736c7e of volume 82a18a63-2609-46aa-9732-5fdf26e145e0 {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:33:07 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5def6b8b-1efe-4611-a531-12538e0e6663]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:33:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e2421e0c-5339-4fbe-9bad-891b1d9e04d1 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:07 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0 Aug 31 15:33:07 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:07 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e2421e0c-5339-4fbe-9bad-891b1d9e04d1 tempest-ProjectMemberTests-359761515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0" returned: 0 in 0.348s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e2421e0c-5339-4fbe-9bad-891b1d9e04d1 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0.2c8813b9-156d-41e7-8648-cb3158736c7e 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:07 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0.2c8813b9-156d-41e7-8648-cb3158736c7e 1G Aug 31 15:33:07 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:07 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e2421e0c-5339-4fbe-9bad-891b1d9e04d1 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0.2c8813b9-156d-41e7-8648-cb3158736c7e 1G" returned: 0 in 0.369s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:07 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e2421e0c-5339-4fbe-9bad-891b1d9e04d1 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82a18a63-2609-46aa-9732-5fdf26e145e0 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0.2c8813b9-156d-41e7-8648-cb3158736c7e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:07 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82a18a63-2609-46aa-9732-5fdf26e145e0 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0.2c8813b9-156d-41e7-8648-cb3158736c7e Aug 31 15:33:07 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:08 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e2421e0c-5339-4fbe-9bad-891b1d9e04d1 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82a18a63-2609-46aa-9732-5fdf26e145e0 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0.2c8813b9-156d-41e7-8648-cb3158736c7e" returned: 0 in 0.284s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:08 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-e2421e0c-5339-4fbe-9bad-891b1d9e04d1 tempest-ProjectMemberTests-359761515 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0.2c8813b9-156d-41e7-8648-cb3158736c7e is being set with open permissions: ugo+rw Aug 31 15:33:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e2421e0c-5339-4fbe-9bad-891b1d9e04d1 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0.2c8813b9-156d-41e7-8648-cb3158736c7e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:08 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0.2c8813b9-156d-41e7-8648-cb3158736c7e Aug 31 15:33:08 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:08 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e2421e0c-5339-4fbe-9bad-891b1d9e04d1 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0.2c8813b9-156d-41e7-8648-cb3158736c7e" returned: 0 in 0.233s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e2421e0c-5339-4fbe-9bad-891b1d9e04d1 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:08 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0.info Aug 31 15:33:08 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:08 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e2421e0c-5339-4fbe-9bad-891b1d9e04d1 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0.info" returned: 0 in 0.239s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:08 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-e2421e0c-5339-4fbe-9bad-891b1d9e04d1 tempest-ProjectMemberTests-359761515 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0.info is being set with open permissions: ugo+rw Aug 31 15:33:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e2421e0c-5339-4fbe-9bad-891b1d9e04d1 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:08 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0.info Aug 31 15:33:08 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:08 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e2421e0c-5339-4fbe-9bad-891b1d9e04d1 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0.info" returned: 0 in 0.236s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:08 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e2421e0c-5339-4fbe-9bad-891b1d9e04d1 tempest-ProjectMemberTests-359761515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.784s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:33:09 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-e2421e0c-5339-4fbe-9bad-891b1d9e04d1 tempest-ProjectMemberTests-359761515 None] Create snapshot completed successfully Aug 31 15:33:09 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5b97d566-5f98-4a95-99f0-b3f67de8afd6 tempest-ProjectMemberTests-359761515 None] Acquiring lock "cinder-2c8813b9-156d-41e7-8648-cb3158736c7e-delete_snapshot" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:33:09 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5b97d566-5f98-4a95-99f0-b3f67de8afd6 tempest-ProjectMemberTests-359761515 None] Lock "cinder-2c8813b9-156d-41e7-8648-cb3158736c7e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:33:09 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5b97d566-5f98-4a95-99f0-b3f67de8afd6 tempest-ProjectMemberTests-359761515 None] Acquiring lock "cinder-quobyte-82a18a63-2609-46aa-9732-5fdf26e145e0" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:33:09 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5b97d566-5f98-4a95-99f0-b3f67de8afd6 tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-82a18a63-2609-46aa-9732-5fdf26e145e0" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:33:09 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5b97d566-5f98-4a95-99f0-b3f67de8afd6 tempest-ProjectMemberTests-359761515 None] Acquiring lock "cinder-quobyte-2c8813b9-156d-41e7-8648-cb3158736c7e" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:33:09 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5b97d566-5f98-4a95-99f0-b3f67de8afd6 tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-2c8813b9-156d-41e7-8648-cb3158736c7e" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:33:09 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-5b97d566-5f98-4a95-99f0-b3f67de8afd6 tempest-ProjectMemberTests-359761515 None] Deleting offline snapshot 2c8813b9-156d-41e7-8648-cb3158736c7e of volume 82a18a63-2609-46aa-9732-5fdf26e145e0 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:33:09 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-5b97d566-5f98-4a95-99f0-b3f67de8afd6 tempest-ProjectMemberTests-359761515 None] snapshot_file for this snap is: volume-82a18a63-2609-46aa-9732-5fdf26e145e0.2c8813b9-156d-41e7-8648-cb3158736c7e {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:33:09 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[167c2799-3189-4414-b0bf-610a084aa37e]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:33:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5b97d566-5f98-4a95-99f0-b3f67de8afd6 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0.2c8813b9-156d-41e7-8648-cb3158736c7e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:09 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0.2c8813b9-156d-41e7-8648-cb3158736c7e Aug 31 15:33:09 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:09 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5b97d566-5f98-4a95-99f0-b3f67de8afd6 tempest-ProjectMemberTests-359761515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0.2c8813b9-156d-41e7-8648-cb3158736c7e" returned: 0 in 0.345s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:09 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-5b97d566-5f98-4a95-99f0-b3f67de8afd6 tempest-ProjectMemberTests-359761515 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82a18a63-2609-46aa-9732-5fdf26e145e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:33:09 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[083748b6-3493-472a-9ecf-8f31c0e5af3e]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:33:09 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5b97d566-5f98-4a95-99f0-b3f67de8afd6 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:09 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0 Aug 31 15:33:09 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:10 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5b97d566-5f98-4a95-99f0-b3f67de8afd6 tempest-ProjectMemberTests-359761515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0" returned: 0 in 0.344s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5b97d566-5f98-4a95-99f0-b3f67de8afd6 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0.2c8813b9-156d-41e7-8648-cb3158736c7e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:10 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0.2c8813b9-156d-41e7-8648-cb3158736c7e Aug 31 15:33:10 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:10 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5b97d566-5f98-4a95-99f0-b3f67de8afd6 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0.2c8813b9-156d-41e7-8648-cb3158736c7e" returned: 0 in 0.323s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5b97d566-5f98-4a95-99f0-b3f67de8afd6 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0.2c8813b9-156d-41e7-8648-cb3158736c7e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:10 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0.2c8813b9-156d-41e7-8648-cb3158736c7e Aug 31 15:33:10 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:10 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:10 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-5b97d566-5f98-4a95-99f0-b3f67de8afd6 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0.2c8813b9-156d-41e7-8648-cb3158736c7e" returned: 0 in 0.235s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:10 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5b97d566-5f98-4a95-99f0-b3f67de8afd6 tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-2c8813b9-156d-41e7-8648-cb3158736c7e" released by "_delete_snapshot" :: held 1.329s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:33:10 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5b97d566-5f98-4a95-99f0-b3f67de8afd6 tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-82a18a63-2609-46aa-9732-5fdf26e145e0" released by "delete_snapshot" :: held 1.348s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:33:10 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-5b97d566-5f98-4a95-99f0-b3f67de8afd6 tempest-ProjectMemberTests-359761515 None] Created reservations ['343570d0-f161-4483-8a6c-c340b6f79a1f', 'e4c39208-8a68-4b40-b8fe-50b6fee62f94', '01d3a468-d030-4331-90dd-1e187a1ec30d', 'e0e83859-3929-49bc-9ae2-d18646c22232'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:33:10 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-5b97d566-5f98-4a95-99f0-b3f67de8afd6 tempest-ProjectMemberTests-359761515 None] Delete snapshot completed successfully. Aug 31 15:33:10 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-5b97d566-5f98-4a95-99f0-b3f67de8afd6 tempest-ProjectMemberTests-359761515 None] Lock "cinder-2c8813b9-156d-41e7-8648-cb3158736c7e-delete_snapshot" released by "delete_snapshot" :: held 1.472s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:33:11 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b33ed1cc-d4fa-4d25-969d-e6df109b6437 tempest-ProjectMemberTests-359761515 None] Acquiring lock "cinder-82a18a63-2609-46aa-9732-5fdf26e145e0-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:33:11 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b33ed1cc-d4fa-4d25-969d-e6df109b6437 tempest-ProjectMemberTests-359761515 None] Lock "cinder-82a18a63-2609-46aa-9732-5fdf26e145e0-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:33:11 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b33ed1cc-d4fa-4d25-969d-e6df109b6437 tempest-ProjectMemberTests-359761515 None] Acquiring lock "cinder-quobyte-82a18a63-2609-46aa-9732-5fdf26e145e0" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:33:11 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b33ed1cc-d4fa-4d25-969d-e6df109b6437 tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-82a18a63-2609-46aa-9732-5fdf26e145e0" acquired by "delete_volume" :: waited 0.016s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:33:11 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a6f581-7715-45b7-a8db-c945218e5055]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:33:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b33ed1cc-d4fa-4d25-969d-e6df109b6437 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:11 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0 Aug 31 15:33:11 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:11 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b33ed1cc-d4fa-4d25-969d-e6df109b6437 tempest-ProjectMemberTests-359761515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0" returned: 0 in 0.346s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:11 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b33ed1cc-d4fa-4d25-969d-e6df109b6437 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:11 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0 Aug 31 15:33:11 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:12 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b33ed1cc-d4fa-4d25-969d-e6df109b6437 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-82a18a63-2609-46aa-9732-5fdf26e145e0" returned: 0 in 0.238s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:12 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b33ed1cc-d4fa-4d25-969d-e6df109b6437 tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-82a18a63-2609-46aa-9732-5fdf26e145e0" released by "delete_volume" :: held 0.637s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:33:12 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-b33ed1cc-d4fa-4d25-969d-e6df109b6437 tempest-ProjectMemberTests-359761515 None] Created reservations ['63d3229a-b5f9-4a18-9a4f-1b282acdc885', 'd9f0a4fc-8ba2-43f2-983b-608aa4b118b6', 'bb040ae2-4bc1-4170-85d7-88650f91cbde', '904c60e1-2daf-4d3c-8979-d884a7a7dcbd'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:33:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b33ed1cc-d4fa-4d25-969d-e6df109b6437 tempest-ProjectMemberTests-359761515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:33:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b33ed1cc-d4fa-4d25-969d-e6df109b6437 tempest-ProjectMemberTests-359761515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:33:12 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-b33ed1cc-d4fa-4d25-969d-e6df109b6437 tempest-ProjectMemberTests-359761515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:33:12 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-b33ed1cc-d4fa-4d25-969d-e6df109b6437 tempest-ProjectMemberTests-359761515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:33:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b33ed1cc-d4fa-4d25-969d-e6df109b6437 tempest-ProjectMemberTests-359761515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:33:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b33ed1cc-d4fa-4d25-969d-e6df109b6437 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:12 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:33:12 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:12 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:12 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b33ed1cc-d4fa-4d25-969d-e6df109b6437 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.239s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:12 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-b33ed1cc-d4fa-4d25-969d-e6df109b6437 tempest-ProjectMemberTests-359761515 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:33:12 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-b33ed1cc-d4fa-4d25-969d-e6df109b6437 tempest-ProjectMemberTests-359761515 None] Deleted volume successfully. Aug 31 15:33:12 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-b33ed1cc-d4fa-4d25-969d-e6df109b6437 tempest-ProjectMemberTests-359761515 None] Lock "cinder-82a18a63-2609-46aa-9732-5fdf26e145e0-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:33:13 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc13d449-7aea-4842-9c28-4391890a052f tempest-ProjectMemberTests-359761515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:33:13 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cc13d449-7aea-4842-9c28-4391890a052f tempest-ProjectMemberTests-359761515 None] Flow 'volume_create_manager' (4380fbb2-745e-41cc-92dd-256a0a323765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:33:13 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cc13d449-7aea-4842-9c28-4391890a052f tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0170012-3945-418a-ab56-c4841c00516f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:33:13 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cc13d449-7aea-4842-9c28-4391890a052f tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0170012-3945-418a-ab56-c4841c00516f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-571492262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ecced69-65b6-4a2f-b10b-50e433ce439c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1295f7809aa42af91604752ca7d0e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:33:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:33:13Z,use_quota=True,user_id='34bfe6cbc4544a40ad4b64e91c8b0d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:33:13 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cc13d449-7aea-4842-9c28-4391890a052f tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d5e2049-cfea-4a51-a8e6-7fae701c295a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:33:13 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cc13d449-7aea-4842-9c28-4391890a052f tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d5e2049-cfea-4a51-a8e6-7fae701c295a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:33:13 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cc13d449-7aea-4842-9c28-4391890a052f tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d5db97d-0245-40ce-a4ff-80fa0568a800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:33:13 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cc13d449-7aea-4842-9c28-4391890a052f tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d5db97d-0245-40ce-a4ff-80fa0568a800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ecced69-65b6-4a2f-b10b-50e433ce439c', 'volume_name': 'volume-1ecced69-65b6-4a2f-b10b-50e433ce439c', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:33:13 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cc13d449-7aea-4842-9c28-4391890a052f tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd93c921-2233-439d-b67a-169ec5556b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:33:13 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cc13d449-7aea-4842-9c28-4391890a052f tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd93c921-2233-439d-b67a-169ec5556b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:33:13 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cc13d449-7aea-4842-9c28-4391890a052f tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c9274ee-09a0-4cf8-a471-7835d32aa0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:33:13 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-cc13d449-7aea-4842-9c28-4391890a052f tempest-ProjectMemberTests-359761515 None] Volume 1ecced69-65b6-4a2f-b10b-50e433ce439c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ecced69-65b6-4a2f-b10b-50e433ce439c', 'volume_size': 1} Aug 31 15:33:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-cc13d449-7aea-4842-9c28-4391890a052f tempest-ProjectMemberTests-359761515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:33:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-cc13d449-7aea-4842-9c28-4391890a052f tempest-ProjectMemberTests-359761515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:33:13 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-cc13d449-7aea-4842-9c28-4391890a052f tempest-ProjectMemberTests-359761515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-571492262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ecced69-65b6-4a2f-b10b-50e433ce439c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1295f7809aa42af91604752ca7d0e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:33:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:33:13Z,use_quota=True,user_id='34bfe6cbc4544a40ad4b64e91c8b0d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:33:13 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-cc13d449-7aea-4842-9c28-4391890a052f tempest-ProjectMemberTests-359761515 None] Creating volume 1ecced69-65b6-4a2f-b10b-50e433ce439c {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:33:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-cc13d449-7aea-4842-9c28-4391890a052f tempest-ProjectMemberTests-359761515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:33:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-cc13d449-7aea-4842-9c28-4391890a052f tempest-ProjectMemberTests-359761515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:33:13 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-cc13d449-7aea-4842-9c28-4391890a052f tempest-ProjectMemberTests-359761515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:33:13 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-cc13d449-7aea-4842-9c28-4391890a052f tempest-ProjectMemberTests-359761515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:33:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-cc13d449-7aea-4842-9c28-4391890a052f tempest-ProjectMemberTests-359761515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:33:13 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-cc13d449-7aea-4842-9c28-4391890a052f tempest-ProjectMemberTests-359761515 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:33:13 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-cc13d449-7aea-4842-9c28-4391890a052f tempest-ProjectMemberTests-359761515 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:33:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cc13d449-7aea-4842-9c28-4391890a052f tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:13 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c 1073741824 Aug 31 15:33:13 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:13 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cc13d449-7aea-4842-9c28-4391890a052f tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c 1073741824" returned: 0 in 0.391s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cc13d449-7aea-4842-9c28-4391890a052f tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:13 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c Aug 31 15:33:13 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:13 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cc13d449-7aea-4842-9c28-4391890a052f tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c" returned: 0 in 0.240s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:13 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-cc13d449-7aea-4842-9c28-4391890a052f tempest-ProjectMemberTests-359761515 None] <== create_volume: return (668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:33:13 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-cc13d449-7aea-4842-9c28-4391890a052f tempest-ProjectMemberTests-359761515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.670s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:33:13 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cc13d449-7aea-4842-9c28-4391890a052f tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c9274ee-09a0-4cf8-a471-7835d32aa0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ecced69-65b6-4a2f-b10b-50e433ce439c', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:33:13 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cc13d449-7aea-4842-9c28-4391890a052f tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebebb978-9776-4c88-9da8-9740f69ba1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:33:13 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-cc13d449-7aea-4842-9c28-4391890a052f tempest-ProjectMemberTests-359761515 None] Volume volume-1ecced69-65b6-4a2f-b10b-50e433ce439c (1ecced69-65b6-4a2f-b10b-50e433ce439c): created successfully Aug 31 15:33:13 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cc13d449-7aea-4842-9c28-4391890a052f tempest-ProjectMemberTests-359761515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebebb978-9776-4c88-9da8-9740f69ba1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:33:13 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-cc13d449-7aea-4842-9c28-4391890a052f tempest-ProjectMemberTests-359761515 None] Flow 'volume_create_manager' (4380fbb2-745e-41cc-92dd-256a0a323765) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:33:13 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-cc13d449-7aea-4842-9c28-4391890a052f tempest-ProjectMemberTests-359761515 None] Created volume successfully. Aug 31 15:33:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8f39e7fe-bda7-49ae-a19a-414fa0d43bf8 tempest-ProjectMemberTests-359761515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:33:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8f39e7fe-bda7-49ae-a19a-414fa0d43bf8 tempest-ProjectMemberTests-359761515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:33:14 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-8f39e7fe-bda7-49ae-a19a-414fa0d43bf8 tempest-ProjectMemberTests-359761515 None] Creating offline snapshot 964e5741-6fa1-47c0-8a8a-2f2af117678d of volume 1ecced69-65b6-4a2f-b10b-50e433ce439c {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:33:14 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[772ea006-e125-4bd3-a1ec-0a9eb7f8e2c8]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:33:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8f39e7fe-bda7-49ae-a19a-414fa0d43bf8 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:14 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c Aug 31 15:33:14 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:14 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8f39e7fe-bda7-49ae-a19a-414fa0d43bf8 tempest-ProjectMemberTests-359761515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c" returned: 0 in 0.343s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:14 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8f39e7fe-bda7-49ae-a19a-414fa0d43bf8 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c.964e5741-6fa1-47c0-8a8a-2f2af117678d 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:14 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c.964e5741-6fa1-47c0-8a8a-2f2af117678d 1G Aug 31 15:33:14 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:15 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8f39e7fe-bda7-49ae-a19a-414fa0d43bf8 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c.964e5741-6fa1-47c0-8a8a-2f2af117678d 1G" returned: 0 in 0.362s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8f39e7fe-bda7-49ae-a19a-414fa0d43bf8 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ecced69-65b6-4a2f-b10b-50e433ce439c -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c.964e5741-6fa1-47c0-8a8a-2f2af117678d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:15 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ecced69-65b6-4a2f-b10b-50e433ce439c -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c.964e5741-6fa1-47c0-8a8a-2f2af117678d Aug 31 15:33:15 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:15 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8f39e7fe-bda7-49ae-a19a-414fa0d43bf8 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ecced69-65b6-4a2f-b10b-50e433ce439c -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c.964e5741-6fa1-47c0-8a8a-2f2af117678d" returned: 0 in 0.272s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:15 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-8f39e7fe-bda7-49ae-a19a-414fa0d43bf8 tempest-ProjectMemberTests-359761515 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c.964e5741-6fa1-47c0-8a8a-2f2af117678d is being set with open permissions: ugo+rw Aug 31 15:33:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8f39e7fe-bda7-49ae-a19a-414fa0d43bf8 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c.964e5741-6fa1-47c0-8a8a-2f2af117678d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:15 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c.964e5741-6fa1-47c0-8a8a-2f2af117678d Aug 31 15:33:15 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:15 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8f39e7fe-bda7-49ae-a19a-414fa0d43bf8 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c.964e5741-6fa1-47c0-8a8a-2f2af117678d" returned: 0 in 0.234s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8f39e7fe-bda7-49ae-a19a-414fa0d43bf8 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:15 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c.info Aug 31 15:33:15 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:15 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8f39e7fe-bda7-49ae-a19a-414fa0d43bf8 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c.info" returned: 0 in 0.236s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:15 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-8f39e7fe-bda7-49ae-a19a-414fa0d43bf8 tempest-ProjectMemberTests-359761515 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c.info is being set with open permissions: ugo+rw Aug 31 15:33:15 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8f39e7fe-bda7-49ae-a19a-414fa0d43bf8 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:15 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c.info Aug 31 15:33:15 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:16 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-8f39e7fe-bda7-49ae-a19a-414fa0d43bf8 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c.info" returned: 0 in 0.235s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-8f39e7fe-bda7-49ae-a19a-414fa0d43bf8 tempest-ProjectMemberTests-359761515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.758s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:33:16 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-8f39e7fe-bda7-49ae-a19a-414fa0d43bf8 tempest-ProjectMemberTests-359761515 None] Create snapshot completed successfully Aug 31 15:33:16 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-d403b839-a566-4385-bb89-956fc30012b1 tempest-ProjectMemberTests-359761515 None] Acquiring lock "cinder-964e5741-6fa1-47c0-8a8a-2f2af117678d-delete_snapshot" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:33:16 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-d403b839-a566-4385-bb89-956fc30012b1 tempest-ProjectMemberTests-359761515 None] Lock "cinder-964e5741-6fa1-47c0-8a8a-2f2af117678d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:33:16 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-d403b839-a566-4385-bb89-956fc30012b1 tempest-ProjectMemberTests-359761515 None] Acquiring lock "cinder-quobyte-1ecced69-65b6-4a2f-b10b-50e433ce439c" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:33:16 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-d403b839-a566-4385-bb89-956fc30012b1 tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-1ecced69-65b6-4a2f-b10b-50e433ce439c" acquired by "delete_snapshot" :: waited 0.012s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:33:16 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-d403b839-a566-4385-bb89-956fc30012b1 tempest-ProjectMemberTests-359761515 None] Acquiring lock "cinder-quobyte-964e5741-6fa1-47c0-8a8a-2f2af117678d" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:33:16 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-d403b839-a566-4385-bb89-956fc30012b1 tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-964e5741-6fa1-47c0-8a8a-2f2af117678d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:33:16 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-d403b839-a566-4385-bb89-956fc30012b1 tempest-ProjectMemberTests-359761515 None] Deleting offline snapshot 964e5741-6fa1-47c0-8a8a-2f2af117678d of volume 1ecced69-65b6-4a2f-b10b-50e433ce439c {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:33:16 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-d403b839-a566-4385-bb89-956fc30012b1 tempest-ProjectMemberTests-359761515 None] snapshot_file for this snap is: volume-1ecced69-65b6-4a2f-b10b-50e433ce439c.964e5741-6fa1-47c0-8a8a-2f2af117678d {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:33:16 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c808948-d45a-46c5-b101-2dc7e93c164e]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:33:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d403b839-a566-4385-bb89-956fc30012b1 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c.964e5741-6fa1-47c0-8a8a-2f2af117678d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:16 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c.964e5741-6fa1-47c0-8a8a-2f2af117678d Aug 31 15:33:16 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:16 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d403b839-a566-4385-bb89-956fc30012b1 tempest-ProjectMemberTests-359761515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c.964e5741-6fa1-47c0-8a8a-2f2af117678d" returned: 0 in 0.351s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:16 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-d403b839-a566-4385-bb89-956fc30012b1 tempest-ProjectMemberTests-359761515 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ecced69-65b6-4a2f-b10b-50e433ce439c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:33:16 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2479404d-963a-450b-9af3-4b8f23628dd4]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:33:16 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d403b839-a566-4385-bb89-956fc30012b1 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:17 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c Aug 31 15:33:17 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:17 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d403b839-a566-4385-bb89-956fc30012b1 tempest-ProjectMemberTests-359761515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c" returned: 0 in 0.348s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d403b839-a566-4385-bb89-956fc30012b1 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c.964e5741-6fa1-47c0-8a8a-2f2af117678d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:17 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c.964e5741-6fa1-47c0-8a8a-2f2af117678d Aug 31 15:33:17 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:17 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d403b839-a566-4385-bb89-956fc30012b1 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c.964e5741-6fa1-47c0-8a8a-2f2af117678d" returned: 0 in 0.329s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d403b839-a566-4385-bb89-956fc30012b1 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c.964e5741-6fa1-47c0-8a8a-2f2af117678d {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:17 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c.964e5741-6fa1-47c0-8a8a-2f2af117678d Aug 31 15:33:17 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:17 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:17 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-d403b839-a566-4385-bb89-956fc30012b1 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c.964e5741-6fa1-47c0-8a8a-2f2af117678d" returned: 0 in 0.237s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:17 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-d403b839-a566-4385-bb89-956fc30012b1 tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-964e5741-6fa1-47c0-8a8a-2f2af117678d" released by "_delete_snapshot" :: held 1.348s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:33:17 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-d403b839-a566-4385-bb89-956fc30012b1 tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-1ecced69-65b6-4a2f-b10b-50e433ce439c" released by "delete_snapshot" :: held 1.370s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:33:17 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-d403b839-a566-4385-bb89-956fc30012b1 tempest-ProjectMemberTests-359761515 None] Created reservations ['3743c8f9-d641-4263-8655-ff761f04e067', '1949d2d6-5fa4-4626-a031-e4cf4736686b', '921b3b84-29c7-43f1-ae61-0417acbc3213', '9c6728ed-f109-4e0d-bd94-dbbec5cb830f'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:33:18 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-d403b839-a566-4385-bb89-956fc30012b1 tempest-ProjectMemberTests-359761515 None] Delete snapshot completed successfully. Aug 31 15:33:18 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-d403b839-a566-4385-bb89-956fc30012b1 tempest-ProjectMemberTests-359761515 None] Lock "cinder-964e5741-6fa1-47c0-8a8a-2f2af117678d-delete_snapshot" released by "delete_snapshot" :: held 1.494s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:33:18 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-9373c87a-5f90-43dc-9f4d-2ad6b1c48586 tempest-ProjectMemberTests-359761515 None] Acquiring lock "cinder-1ecced69-65b6-4a2f-b10b-50e433ce439c-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:33:18 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-9373c87a-5f90-43dc-9f4d-2ad6b1c48586 tempest-ProjectMemberTests-359761515 None] Lock "cinder-1ecced69-65b6-4a2f-b10b-50e433ce439c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:33:18 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-9373c87a-5f90-43dc-9f4d-2ad6b1c48586 tempest-ProjectMemberTests-359761515 None] Acquiring lock "cinder-quobyte-1ecced69-65b6-4a2f-b10b-50e433ce439c" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:33:18 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-9373c87a-5f90-43dc-9f4d-2ad6b1c48586 tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-1ecced69-65b6-4a2f-b10b-50e433ce439c" acquired by "delete_volume" :: waited 0.014s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:33:18 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbb1b8f-e3dd-4209-a731-e0e36661d052]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:33:18 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9373c87a-5f90-43dc-9f4d-2ad6b1c48586 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:18 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c Aug 31 15:33:18 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:19 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9373c87a-5f90-43dc-9f4d-2ad6b1c48586 tempest-ProjectMemberTests-359761515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c" returned: 0 in 0.343s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9373c87a-5f90-43dc-9f4d-2ad6b1c48586 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:19 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c Aug 31 15:33:19 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:19 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9373c87a-5f90-43dc-9f4d-2ad6b1c48586 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1ecced69-65b6-4a2f-b10b-50e433ce439c" returned: 0 in 0.244s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:19 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-9373c87a-5f90-43dc-9f4d-2ad6b1c48586 tempest-ProjectMemberTests-359761515 None] Lock "cinder-quobyte-1ecced69-65b6-4a2f-b10b-50e433ce439c" released by "delete_volume" :: held 0.639s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:33:19 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-9373c87a-5f90-43dc-9f4d-2ad6b1c48586 tempest-ProjectMemberTests-359761515 None] Created reservations ['8ffdb39e-1652-4c68-b66a-e661a507728b', '9804e6ed-39a0-4ad7-8359-743d883bad6f', '09009c46-6aa2-4347-8885-2527a45dd1d7', '1d003a6e-5169-4cae-a10b-d5b3b4405575'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:33:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9373c87a-5f90-43dc-9f4d-2ad6b1c48586 tempest-ProjectMemberTests-359761515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:33:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9373c87a-5f90-43dc-9f4d-2ad6b1c48586 tempest-ProjectMemberTests-359761515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:33:19 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-9373c87a-5f90-43dc-9f4d-2ad6b1c48586 tempest-ProjectMemberTests-359761515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:33:19 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-9373c87a-5f90-43dc-9f4d-2ad6b1c48586 tempest-ProjectMemberTests-359761515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:33:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-9373c87a-5f90-43dc-9f4d-2ad6b1c48586 tempest-ProjectMemberTests-359761515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:33:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9373c87a-5f90-43dc-9f4d-2ad6b1c48586 tempest-ProjectMemberTests-359761515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:19 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:33:19 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:19 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:19 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-9373c87a-5f90-43dc-9f4d-2ad6b1c48586 tempest-ProjectMemberTests-359761515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.237s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:19 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-9373c87a-5f90-43dc-9f4d-2ad6b1c48586 tempest-ProjectMemberTests-359761515 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:33:19 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-9373c87a-5f90-43dc-9f4d-2ad6b1c48586 tempest-ProjectMemberTests-359761515 None] Deleted volume successfully. Aug 31 15:33:19 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-9373c87a-5f90-43dc-9f4d-2ad6b1c48586 tempest-ProjectMemberTests-359761515 None] Lock "cinder-1ecced69-65b6-4a2f-b10b-50e433ce439c-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:33:23 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9a200b0-fffb-45eb-b9c5-8d700400c1b7 tempest-ProjectReaderTests-270310627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:33:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b9a200b0-fffb-45eb-b9c5-8d700400c1b7 tempest-ProjectReaderTests-270310627 None] Flow 'volume_create_manager' (c57a05ae-2c79-488d-aaf4-eac313cd9fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:33:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b9a200b0-fffb-45eb-b9c5-8d700400c1b7 tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7edaa263-45b9-47f6-aa03-0f7a31aa1e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:33:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b9a200b0-fffb-45eb-b9c5-8d700400c1b7 tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7edaa263-45b9-47f6-aa03-0f7a31aa1e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-193487680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c45b3a4b-319e-4cfc-a708-7957ccccb4ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d00e2c9bd9ab4e59a15685f1ddc6f5ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:33:23Z,use_quota=True,user_id='013d907e479b4a51af1ae07d758dc986',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:33:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b9a200b0-fffb-45eb-b9c5-8d700400c1b7 tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcc2da2a-7b43-4af2-b71b-2a2ba14333df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:33:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b9a200b0-fffb-45eb-b9c5-8d700400c1b7 tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcc2da2a-7b43-4af2-b71b-2a2ba14333df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:33:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b9a200b0-fffb-45eb-b9c5-8d700400c1b7 tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7390510b-025d-49a6-9e66-72495e82a771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:33:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b9a200b0-fffb-45eb-b9c5-8d700400c1b7 tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7390510b-025d-49a6-9e66-72495e82a771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c45b3a4b-319e-4cfc-a708-7957ccccb4ea', 'volume_name': 'volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:33:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b9a200b0-fffb-45eb-b9c5-8d700400c1b7 tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a1dd0bd-0771-4f02-b3b0-38e5985f6bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:33:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b9a200b0-fffb-45eb-b9c5-8d700400c1b7 tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a1dd0bd-0771-4f02-b3b0-38e5985f6bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:33:23 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b9a200b0-fffb-45eb-b9c5-8d700400c1b7 tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6565788e-18a1-4b9b-a28a-887b6d21169a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:33:23 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-b9a200b0-fffb-45eb-b9c5-8d700400c1b7 tempest-ProjectReaderTests-270310627 None] Volume c45b3a4b-319e-4cfc-a708-7957ccccb4ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea', 'volume_size': 1} Aug 31 15:33:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b9a200b0-fffb-45eb-b9c5-8d700400c1b7 tempest-ProjectReaderTests-270310627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:33:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b9a200b0-fffb-45eb-b9c5-8d700400c1b7 tempest-ProjectReaderTests-270310627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:33:23 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-b9a200b0-fffb-45eb-b9c5-8d700400c1b7 tempest-ProjectReaderTests-270310627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-193487680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c45b3a4b-319e-4cfc-a708-7957ccccb4ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d00e2c9bd9ab4e59a15685f1ddc6f5ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:33:23Z,use_quota=True,user_id='013d907e479b4a51af1ae07d758dc986',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:33:23 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-b9a200b0-fffb-45eb-b9c5-8d700400c1b7 tempest-ProjectReaderTests-270310627 None] Creating volume c45b3a4b-319e-4cfc-a708-7957ccccb4ea {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:33:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b9a200b0-fffb-45eb-b9c5-8d700400c1b7 tempest-ProjectReaderTests-270310627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:33:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b9a200b0-fffb-45eb-b9c5-8d700400c1b7 tempest-ProjectReaderTests-270310627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:33:23 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-b9a200b0-fffb-45eb-b9c5-8d700400c1b7 tempest-ProjectReaderTests-270310627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:33:23 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-b9a200b0-fffb-45eb-b9c5-8d700400c1b7 tempest-ProjectReaderTests-270310627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:33:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b9a200b0-fffb-45eb-b9c5-8d700400c1b7 tempest-ProjectReaderTests-270310627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:33:23 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-b9a200b0-fffb-45eb-b9c5-8d700400c1b7 tempest-ProjectReaderTests-270310627 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:33:23 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-b9a200b0-fffb-45eb-b9c5-8d700400c1b7 tempest-ProjectReaderTests-270310627 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:33:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b9a200b0-fffb-45eb-b9c5-8d700400c1b7 tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:23 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea 1073741824 Aug 31 15:33:23 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:23 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b9a200b0-fffb-45eb-b9c5-8d700400c1b7 tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea 1073741824" returned: 0 in 0.399s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:23 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b9a200b0-fffb-45eb-b9c5-8d700400c1b7 tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:23 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea Aug 31 15:33:23 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:24 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-b9a200b0-fffb-45eb-b9c5-8d700400c1b7 tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea" returned: 0 in 0.235s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:24 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-b9a200b0-fffb-45eb-b9c5-8d700400c1b7 tempest-ProjectReaderTests-270310627 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:33:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-b9a200b0-fffb-45eb-b9c5-8d700400c1b7 tempest-ProjectReaderTests-270310627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:33:24 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b9a200b0-fffb-45eb-b9c5-8d700400c1b7 tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6565788e-18a1-4b9b-a28a-887b6d21169a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:33:24 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b9a200b0-fffb-45eb-b9c5-8d700400c1b7 tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (362af914-fcdf-4fe1-adb2-dc85c9f4ac8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:33:24 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-b9a200b0-fffb-45eb-b9c5-8d700400c1b7 tempest-ProjectReaderTests-270310627 None] Volume volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea (c45b3a4b-319e-4cfc-a708-7957ccccb4ea): created successfully Aug 31 15:33:24 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b9a200b0-fffb-45eb-b9c5-8d700400c1b7 tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (362af914-fcdf-4fe1-adb2-dc85c9f4ac8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:33:24 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-b9a200b0-fffb-45eb-b9c5-8d700400c1b7 tempest-ProjectReaderTests-270310627 None] Flow 'volume_create_manager' (c57a05ae-2c79-488d-aaf4-eac313cd9fea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:33:24 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-b9a200b0-fffb-45eb-b9c5-8d700400c1b7 tempest-ProjectReaderTests-270310627 None] Created volume successfully. Aug 31 15:33:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-cbd5a815-8643-4bd3-9935-2097f369fb4c tempest-ProjectReaderTests-270310627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:33:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-cbd5a815-8643-4bd3-9935-2097f369fb4c tempest-ProjectReaderTests-270310627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:33:24 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-cbd5a815-8643-4bd3-9935-2097f369fb4c tempest-ProjectReaderTests-270310627 None] Creating offline snapshot 534b140b-8ed7-4609-bea8-59ffac0518ff of volume c45b3a4b-319e-4cfc-a708-7957ccccb4ea {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:33:24 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce66160-dd08-4d84-8908-d7b9b01be7ec]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:33:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cbd5a815-8643-4bd3-9935-2097f369fb4c tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:24 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea Aug 31 15:33:24 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:24 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cbd5a815-8643-4bd3-9935-2097f369fb4c tempest-ProjectReaderTests-270310627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea" returned: 0 in 0.337s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:24 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cbd5a815-8643-4bd3-9935-2097f369fb4c tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea.534b140b-8ed7-4609-bea8-59ffac0518ff 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:24 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea.534b140b-8ed7-4609-bea8-59ffac0518ff 1G Aug 31 15:33:24 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:25 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cbd5a815-8643-4bd3-9935-2097f369fb4c tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea.534b140b-8ed7-4609-bea8-59ffac0518ff 1G" returned: 0 in 0.364s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cbd5a815-8643-4bd3-9935-2097f369fb4c tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea.534b140b-8ed7-4609-bea8-59ffac0518ff {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:25 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea.534b140b-8ed7-4609-bea8-59ffac0518ff Aug 31 15:33:25 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:25 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cbd5a815-8643-4bd3-9935-2097f369fb4c tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea.534b140b-8ed7-4609-bea8-59ffac0518ff" returned: 0 in 0.279s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:25 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-cbd5a815-8643-4bd3-9935-2097f369fb4c tempest-ProjectReaderTests-270310627 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea.534b140b-8ed7-4609-bea8-59ffac0518ff is being set with open permissions: ugo+rw Aug 31 15:33:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cbd5a815-8643-4bd3-9935-2097f369fb4c tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea.534b140b-8ed7-4609-bea8-59ffac0518ff {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:25 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea.534b140b-8ed7-4609-bea8-59ffac0518ff Aug 31 15:33:25 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:25 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cbd5a815-8643-4bd3-9935-2097f369fb4c tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea.534b140b-8ed7-4609-bea8-59ffac0518ff" returned: 0 in 0.234s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:25 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cbd5a815-8643-4bd3-9935-2097f369fb4c tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:25 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea.info Aug 31 15:33:25 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:26 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cbd5a815-8643-4bd3-9935-2097f369fb4c tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea.info" returned: 0 in 0.257s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:26 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-cbd5a815-8643-4bd3-9935-2097f369fb4c tempest-ProjectReaderTests-270310627 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea.info is being set with open permissions: ugo+rw Aug 31 15:33:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cbd5a815-8643-4bd3-9935-2097f369fb4c tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:26 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea.info Aug 31 15:33:26 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:26 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cbd5a815-8643-4bd3-9935-2097f369fb4c tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea.info" returned: 0 in 0.245s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-cbd5a815-8643-4bd3-9935-2097f369fb4c tempest-ProjectReaderTests-270310627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.788s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:33:26 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-cbd5a815-8643-4bd3-9935-2097f369fb4c tempest-ProjectReaderTests-270310627 None] Create snapshot completed successfully Aug 31 15:33:26 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e1169d94-e1bf-4361-bac5-5feff5c9acac tempest-ProjectReaderTests-270310627 None] Acquiring lock "cinder-534b140b-8ed7-4609-bea8-59ffac0518ff-delete_snapshot" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:33:26 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e1169d94-e1bf-4361-bac5-5feff5c9acac tempest-ProjectReaderTests-270310627 None] Lock "cinder-534b140b-8ed7-4609-bea8-59ffac0518ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:33:26 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e1169d94-e1bf-4361-bac5-5feff5c9acac tempest-ProjectReaderTests-270310627 None] Acquiring lock "cinder-quobyte-c45b3a4b-319e-4cfc-a708-7957ccccb4ea" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:33:26 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e1169d94-e1bf-4361-bac5-5feff5c9acac tempest-ProjectReaderTests-270310627 None] Lock "cinder-quobyte-c45b3a4b-319e-4cfc-a708-7957ccccb4ea" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:33:26 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e1169d94-e1bf-4361-bac5-5feff5c9acac tempest-ProjectReaderTests-270310627 None] Acquiring lock "cinder-quobyte-534b140b-8ed7-4609-bea8-59ffac0518ff" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:33:26 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e1169d94-e1bf-4361-bac5-5feff5c9acac tempest-ProjectReaderTests-270310627 None] Lock "cinder-quobyte-534b140b-8ed7-4609-bea8-59ffac0518ff" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:33:26 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-e1169d94-e1bf-4361-bac5-5feff5c9acac tempest-ProjectReaderTests-270310627 None] Deleting offline snapshot 534b140b-8ed7-4609-bea8-59ffac0518ff of volume c45b3a4b-319e-4cfc-a708-7957ccccb4ea {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:33:26 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-e1169d94-e1bf-4361-bac5-5feff5c9acac tempest-ProjectReaderTests-270310627 None] snapshot_file for this snap is: volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea.534b140b-8ed7-4609-bea8-59ffac0518ff {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:33:26 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a8363c-7b28-4642-8f01-80accfdcd544]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:33:26 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e1169d94-e1bf-4361-bac5-5feff5c9acac tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea.534b140b-8ed7-4609-bea8-59ffac0518ff {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:26 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea.534b140b-8ed7-4609-bea8-59ffac0518ff Aug 31 15:33:26 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:27 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e1169d94-e1bf-4361-bac5-5feff5c9acac tempest-ProjectReaderTests-270310627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea.534b140b-8ed7-4609-bea8-59ffac0518ff" returned: 0 in 0.348s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:27 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-e1169d94-e1bf-4361-bac5-5feff5c9acac tempest-ProjectReaderTests-270310627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:33:27 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61dad6a-b27d-48f1-ae6e-1455b48d769e]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:33:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e1169d94-e1bf-4361-bac5-5feff5c9acac tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:27 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea Aug 31 15:33:27 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:27 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e1169d94-e1bf-4361-bac5-5feff5c9acac tempest-ProjectReaderTests-270310627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea" returned: 0 in 0.338s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e1169d94-e1bf-4361-bac5-5feff5c9acac tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea.534b140b-8ed7-4609-bea8-59ffac0518ff {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:27 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea.534b140b-8ed7-4609-bea8-59ffac0518ff Aug 31 15:33:27 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:27 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e1169d94-e1bf-4361-bac5-5feff5c9acac tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea.534b140b-8ed7-4609-bea8-59ffac0518ff" returned: 0 in 0.343s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:27 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e1169d94-e1bf-4361-bac5-5feff5c9acac tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea.534b140b-8ed7-4609-bea8-59ffac0518ff {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:27 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea.534b140b-8ed7-4609-bea8-59ffac0518ff Aug 31 15:33:27 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:28 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:28 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e1169d94-e1bf-4361-bac5-5feff5c9acac tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea.534b140b-8ed7-4609-bea8-59ffac0518ff" returned: 0 in 0.238s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:28 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e1169d94-e1bf-4361-bac5-5feff5c9acac tempest-ProjectReaderTests-270310627 None] Lock "cinder-quobyte-534b140b-8ed7-4609-bea8-59ffac0518ff" released by "_delete_snapshot" :: held 1.343s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:33:28 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e1169d94-e1bf-4361-bac5-5feff5c9acac tempest-ProjectReaderTests-270310627 None] Lock "cinder-quobyte-c45b3a4b-319e-4cfc-a708-7957ccccb4ea" released by "delete_snapshot" :: held 1.363s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:33:28 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-e1169d94-e1bf-4361-bac5-5feff5c9acac tempest-ProjectReaderTests-270310627 None] Created reservations ['8df1618f-eeb4-47c0-9ca5-9fd6b3482b31', 'f219047c-72b1-40d0-b7a2-9adfb5df8ae3', '6301f9c4-4648-4f6a-b5e8-c2645c3aa185', '171b932f-41fd-492d-ae90-f997b7c10885'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:33:28 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-e1169d94-e1bf-4361-bac5-5feff5c9acac tempest-ProjectReaderTests-270310627 None] Delete snapshot completed successfully. Aug 31 15:33:28 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e1169d94-e1bf-4361-bac5-5feff5c9acac tempest-ProjectReaderTests-270310627 None] Lock "cinder-534b140b-8ed7-4609-bea8-59ffac0518ff-delete_snapshot" released by "delete_snapshot" :: held 1.488s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:33:28 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-ffe2f44f-02d5-4408-b648-2c6165a215a1 tempest-ProjectReaderTests-270310627 None] Acquiring lock "cinder-c45b3a4b-319e-4cfc-a708-7957ccccb4ea-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:33:28 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-ffe2f44f-02d5-4408-b648-2c6165a215a1 tempest-ProjectReaderTests-270310627 None] Lock "cinder-c45b3a4b-319e-4cfc-a708-7957ccccb4ea-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:33:29 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-ffe2f44f-02d5-4408-b648-2c6165a215a1 tempest-ProjectReaderTests-270310627 None] Acquiring lock "cinder-quobyte-c45b3a4b-319e-4cfc-a708-7957ccccb4ea" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:33:29 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-ffe2f44f-02d5-4408-b648-2c6165a215a1 tempest-ProjectReaderTests-270310627 None] Lock "cinder-quobyte-c45b3a4b-319e-4cfc-a708-7957ccccb4ea" acquired by "delete_volume" :: waited 0.015s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:33:29 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[efba12fc-2767-4707-aa02-1ddd64a0d71c]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:33:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ffe2f44f-02d5-4408-b648-2c6165a215a1 tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:29 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea Aug 31 15:33:29 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:29 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ffe2f44f-02d5-4408-b648-2c6165a215a1 tempest-ProjectReaderTests-270310627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea" returned: 0 in 0.358s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ffe2f44f-02d5-4408-b648-2c6165a215a1 tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:29 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea Aug 31 15:33:29 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:29 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ffe2f44f-02d5-4408-b648-2c6165a215a1 tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c45b3a4b-319e-4cfc-a708-7957ccccb4ea" returned: 0 in 0.254s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:29 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-ffe2f44f-02d5-4408-b648-2c6165a215a1 tempest-ProjectReaderTests-270310627 None] Lock "cinder-quobyte-c45b3a4b-319e-4cfc-a708-7957ccccb4ea" released by "delete_volume" :: held 0.667s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:33:29 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-ffe2f44f-02d5-4408-b648-2c6165a215a1 tempest-ProjectReaderTests-270310627 None] Created reservations ['02aff4d8-e2d0-4909-856a-986e0732771c', '19156e70-69a6-4838-bca6-ab26acae2d9f', '54ece223-f859-4e78-ac73-ac41814c00c0', 'fcfe05f0-7118-479e-9206-b6ae61efd46c'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:33:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ffe2f44f-02d5-4408-b648-2c6165a215a1 tempest-ProjectReaderTests-270310627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:33:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ffe2f44f-02d5-4408-b648-2c6165a215a1 tempest-ProjectReaderTests-270310627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:33:29 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-ffe2f44f-02d5-4408-b648-2c6165a215a1 tempest-ProjectReaderTests-270310627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:33:29 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-ffe2f44f-02d5-4408-b648-2c6165a215a1 tempest-ProjectReaderTests-270310627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:33:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ffe2f44f-02d5-4408-b648-2c6165a215a1 tempest-ProjectReaderTests-270310627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:33:29 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ffe2f44f-02d5-4408-b648-2c6165a215a1 tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:29 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:33:29 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:30 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ffe2f44f-02d5-4408-b648-2c6165a215a1 tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.238s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:30 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-ffe2f44f-02d5-4408-b648-2c6165a215a1 tempest-ProjectReaderTests-270310627 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:33:30 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-ffe2f44f-02d5-4408-b648-2c6165a215a1 tempest-ProjectReaderTests-270310627 None] Deleted volume successfully. Aug 31 15:33:30 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-ffe2f44f-02d5-4408-b648-2c6165a215a1 tempest-ProjectReaderTests-270310627 None] Lock "cinder-c45b3a4b-319e-4cfc-a708-7957ccccb4ea-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:33:30 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-504e4202-5806-4221-a54b-dfdd405d413c tempest-ProjectReaderTests-270310627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:33:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-504e4202-5806-4221-a54b-dfdd405d413c tempest-ProjectReaderTests-270310627 None] Flow 'volume_create_manager' (a8448551-c9ff-43a8-b03e-26f6577e65ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:33:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-504e4202-5806-4221-a54b-dfdd405d413c tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6bbb20b-2f59-4df3-b2a1-ee847bff00e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:33:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-504e4202-5806-4221-a54b-dfdd405d413c tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6bbb20b-2f59-4df3-b2a1-ee847bff00e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1591083632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=931bfba5-481c-4bf3-9bc2-72f072de8b86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d00e2c9bd9ab4e59a15685f1ddc6f5ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:33:31Z,use_quota=True,user_id='013d907e479b4a51af1ae07d758dc986',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:33:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-504e4202-5806-4221-a54b-dfdd405d413c tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d11dd791-0837-4abd-9f17-5ac4b1d94111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:33:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-504e4202-5806-4221-a54b-dfdd405d413c tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d11dd791-0837-4abd-9f17-5ac4b1d94111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:33:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-504e4202-5806-4221-a54b-dfdd405d413c tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df21a277-c994-4d24-b5da-e458df99561a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:33:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-504e4202-5806-4221-a54b-dfdd405d413c tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df21a277-c994-4d24-b5da-e458df99561a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '931bfba5-481c-4bf3-9bc2-72f072de8b86', 'volume_name': 'volume-931bfba5-481c-4bf3-9bc2-72f072de8b86', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:33:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-504e4202-5806-4221-a54b-dfdd405d413c tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd2699b-c52d-421a-aae6-cb8891e54407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:33:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-504e4202-5806-4221-a54b-dfdd405d413c tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd2699b-c52d-421a-aae6-cb8891e54407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:33:30 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-504e4202-5806-4221-a54b-dfdd405d413c tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb4accb-4157-4629-91c5-075eaf1374ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:33:30 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-504e4202-5806-4221-a54b-dfdd405d413c tempest-ProjectReaderTests-270310627 None] Volume 931bfba5-481c-4bf3-9bc2-72f072de8b86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-931bfba5-481c-4bf3-9bc2-72f072de8b86', 'volume_size': 1} Aug 31 15:33:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-504e4202-5806-4221-a54b-dfdd405d413c tempest-ProjectReaderTests-270310627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:33:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-504e4202-5806-4221-a54b-dfdd405d413c tempest-ProjectReaderTests-270310627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:33:30 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-504e4202-5806-4221-a54b-dfdd405d413c tempest-ProjectReaderTests-270310627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1591083632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=931bfba5-481c-4bf3-9bc2-72f072de8b86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d00e2c9bd9ab4e59a15685f1ddc6f5ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:33:31Z,use_quota=True,user_id='013d907e479b4a51af1ae07d758dc986',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:33:30 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-504e4202-5806-4221-a54b-dfdd405d413c tempest-ProjectReaderTests-270310627 None] Creating volume 931bfba5-481c-4bf3-9bc2-72f072de8b86 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:33:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-504e4202-5806-4221-a54b-dfdd405d413c tempest-ProjectReaderTests-270310627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:33:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-504e4202-5806-4221-a54b-dfdd405d413c tempest-ProjectReaderTests-270310627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:33:30 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-504e4202-5806-4221-a54b-dfdd405d413c tempest-ProjectReaderTests-270310627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:33:30 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-504e4202-5806-4221-a54b-dfdd405d413c tempest-ProjectReaderTests-270310627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:33:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-504e4202-5806-4221-a54b-dfdd405d413c tempest-ProjectReaderTests-270310627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:33:30 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-504e4202-5806-4221-a54b-dfdd405d413c tempest-ProjectReaderTests-270310627 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:33:30 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-504e4202-5806-4221-a54b-dfdd405d413c tempest-ProjectReaderTests-270310627 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:33:30 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-504e4202-5806-4221-a54b-dfdd405d413c tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:30 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86 1073741824 Aug 31 15:33:30 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:31 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-504e4202-5806-4221-a54b-dfdd405d413c tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86 1073741824" returned: 0 in 0.400s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-504e4202-5806-4221-a54b-dfdd405d413c tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:31 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86 Aug 31 15:33:31 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:31 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-504e4202-5806-4221-a54b-dfdd405d413c tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86" returned: 0 in 0.251s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:31 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-504e4202-5806-4221-a54b-dfdd405d413c tempest-ProjectReaderTests-270310627 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:33:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-504e4202-5806-4221-a54b-dfdd405d413c tempest-ProjectReaderTests-270310627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:33:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-504e4202-5806-4221-a54b-dfdd405d413c tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb4accb-4157-4629-91c5-075eaf1374ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-931bfba5-481c-4bf3-9bc2-72f072de8b86', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:33:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-504e4202-5806-4221-a54b-dfdd405d413c tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10fcf56a-b035-47f8-9e0c-89ccf25fbe71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:33:31 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-504e4202-5806-4221-a54b-dfdd405d413c tempest-ProjectReaderTests-270310627 None] Volume volume-931bfba5-481c-4bf3-9bc2-72f072de8b86 (931bfba5-481c-4bf3-9bc2-72f072de8b86): created successfully Aug 31 15:33:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-504e4202-5806-4221-a54b-dfdd405d413c tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10fcf56a-b035-47f8-9e0c-89ccf25fbe71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:33:31 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-504e4202-5806-4221-a54b-dfdd405d413c tempest-ProjectReaderTests-270310627 None] Flow 'volume_create_manager' (a8448551-c9ff-43a8-b03e-26f6577e65ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:33:31 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-504e4202-5806-4221-a54b-dfdd405d413c tempest-ProjectReaderTests-270310627 None] Created volume successfully. Aug 31 15:33:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e546ca54-0974-499a-827f-0e84a15c5214 tempest-ProjectReaderTests-270310627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:33:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e546ca54-0974-499a-827f-0e84a15c5214 tempest-ProjectReaderTests-270310627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:33:31 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-e546ca54-0974-499a-827f-0e84a15c5214 tempest-ProjectReaderTests-270310627 None] Creating offline snapshot bf4a5166-386b-4fec-a95b-e4e98d9e94bc of volume 931bfba5-481c-4bf3-9bc2-72f072de8b86 {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:33:31 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f84dc6-0e6f-4ee6-9aeb-aa74b4782496]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:33:31 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e546ca54-0974-499a-827f-0e84a15c5214 tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:31 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86 Aug 31 15:33:31 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:32 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e546ca54-0974-499a-827f-0e84a15c5214 tempest-ProjectReaderTests-270310627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86" returned: 0 in 0.350s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e546ca54-0974-499a-827f-0e84a15c5214 tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86.bf4a5166-386b-4fec-a95b-e4e98d9e94bc 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:32 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86.bf4a5166-386b-4fec-a95b-e4e98d9e94bc 1G Aug 31 15:33:32 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:32 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e546ca54-0974-499a-827f-0e84a15c5214 tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86.bf4a5166-386b-4fec-a95b-e4e98d9e94bc 1G" returned: 0 in 0.381s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e546ca54-0974-499a-827f-0e84a15c5214 tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-931bfba5-481c-4bf3-9bc2-72f072de8b86 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86.bf4a5166-386b-4fec-a95b-e4e98d9e94bc {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:32 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-931bfba5-481c-4bf3-9bc2-72f072de8b86 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86.bf4a5166-386b-4fec-a95b-e4e98d9e94bc Aug 31 15:33:32 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:32 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e546ca54-0974-499a-827f-0e84a15c5214 tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-931bfba5-481c-4bf3-9bc2-72f072de8b86 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86.bf4a5166-386b-4fec-a95b-e4e98d9e94bc" returned: 0 in 0.287s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:32 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-e546ca54-0974-499a-827f-0e84a15c5214 tempest-ProjectReaderTests-270310627 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86.bf4a5166-386b-4fec-a95b-e4e98d9e94bc is being set with open permissions: ugo+rw Aug 31 15:33:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e546ca54-0974-499a-827f-0e84a15c5214 tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86.bf4a5166-386b-4fec-a95b-e4e98d9e94bc {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:32 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86.bf4a5166-386b-4fec-a95b-e4e98d9e94bc Aug 31 15:33:32 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:32 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:32 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e546ca54-0974-499a-827f-0e84a15c5214 tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86.bf4a5166-386b-4fec-a95b-e4e98d9e94bc" returned: 0 in 0.235s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e546ca54-0974-499a-827f-0e84a15c5214 tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:33 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86.info Aug 31 15:33:33 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:33 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e546ca54-0974-499a-827f-0e84a15c5214 tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86.info" returned: 0 in 0.277s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:33 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-e546ca54-0974-499a-827f-0e84a15c5214 tempest-ProjectReaderTests-270310627 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86.info is being set with open permissions: ugo+rw Aug 31 15:33:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e546ca54-0974-499a-827f-0e84a15c5214 tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:33 devstack sudo[106867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86.info Aug 31 15:33:33 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:33 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e546ca54-0974-499a-827f-0e84a15c5214 tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86.info" returned: 0 in 0.243s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-e546ca54-0974-499a-827f-0e84a15c5214 tempest-ProjectReaderTests-270310627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.896s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:33:33 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-e546ca54-0974-499a-827f-0e84a15c5214 tempest-ProjectReaderTests-270310627 None] Create snapshot completed successfully Aug 31 15:33:33 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-324ed69e-410e-40aa-8248-fa95c5a14196 tempest-ProjectReaderTests-270310627 None] Acquiring lock "cinder-bf4a5166-386b-4fec-a95b-e4e98d9e94bc-delete_snapshot" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:33:33 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-324ed69e-410e-40aa-8248-fa95c5a14196 tempest-ProjectReaderTests-270310627 None] Lock "cinder-bf4a5166-386b-4fec-a95b-e4e98d9e94bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:33:33 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-324ed69e-410e-40aa-8248-fa95c5a14196 tempest-ProjectReaderTests-270310627 None] Acquiring lock "cinder-quobyte-931bfba5-481c-4bf3-9bc2-72f072de8b86" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:33:33 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-324ed69e-410e-40aa-8248-fa95c5a14196 tempest-ProjectReaderTests-270310627 None] Lock "cinder-quobyte-931bfba5-481c-4bf3-9bc2-72f072de8b86" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:33:33 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-324ed69e-410e-40aa-8248-fa95c5a14196 tempest-ProjectReaderTests-270310627 None] Acquiring lock "cinder-quobyte-bf4a5166-386b-4fec-a95b-e4e98d9e94bc" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:33:33 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-324ed69e-410e-40aa-8248-fa95c5a14196 tempest-ProjectReaderTests-270310627 None] Lock "cinder-quobyte-bf4a5166-386b-4fec-a95b-e4e98d9e94bc" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:33:33 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-324ed69e-410e-40aa-8248-fa95c5a14196 tempest-ProjectReaderTests-270310627 None] Deleting offline snapshot bf4a5166-386b-4fec-a95b-e4e98d9e94bc of volume 931bfba5-481c-4bf3-9bc2-72f072de8b86 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:33:33 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-324ed69e-410e-40aa-8248-fa95c5a14196 tempest-ProjectReaderTests-270310627 None] snapshot_file for this snap is: volume-931bfba5-481c-4bf3-9bc2-72f072de8b86.bf4a5166-386b-4fec-a95b-e4e98d9e94bc {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:33:33 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[576bcf5d-1dc5-4d7a-b0a4-ecbbe839f237]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:33:33 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-324ed69e-410e-40aa-8248-fa95c5a14196 tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86.bf4a5166-386b-4fec-a95b-e4e98d9e94bc {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:34 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86.bf4a5166-386b-4fec-a95b-e4e98d9e94bc Aug 31 15:33:34 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:34 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-324ed69e-410e-40aa-8248-fa95c5a14196 tempest-ProjectReaderTests-270310627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86.bf4a5166-386b-4fec-a95b-e4e98d9e94bc" returned: 0 in 0.365s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:34 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-324ed69e-410e-40aa-8248-fa95c5a14196 tempest-ProjectReaderTests-270310627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-931bfba5-481c-4bf3-9bc2-72f072de8b86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:33:34 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5b1a67-c5e6-48a7-825d-8d724632b936]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:33:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-324ed69e-410e-40aa-8248-fa95c5a14196 tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:34 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86 Aug 31 15:33:34 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:34 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-324ed69e-410e-40aa-8248-fa95c5a14196 tempest-ProjectReaderTests-270310627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86" returned: 0 in 0.360s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-324ed69e-410e-40aa-8248-fa95c5a14196 tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86.bf4a5166-386b-4fec-a95b-e4e98d9e94bc {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:34 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86.bf4a5166-386b-4fec-a95b-e4e98d9e94bc Aug 31 15:33:34 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:34 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-324ed69e-410e-40aa-8248-fa95c5a14196 tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86.bf4a5166-386b-4fec-a95b-e4e98d9e94bc" returned: 0 in 0.322s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:34 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-324ed69e-410e-40aa-8248-fa95c5a14196 tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86.bf4a5166-386b-4fec-a95b-e4e98d9e94bc {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:35 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86.bf4a5166-386b-4fec-a95b-e4e98d9e94bc Aug 31 15:33:35 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:35 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:35 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-324ed69e-410e-40aa-8248-fa95c5a14196 tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86.bf4a5166-386b-4fec-a95b-e4e98d9e94bc" returned: 0 in 0.240s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:35 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-324ed69e-410e-40aa-8248-fa95c5a14196 tempest-ProjectReaderTests-270310627 None] Lock "cinder-quobyte-bf4a5166-386b-4fec-a95b-e4e98d9e94bc" released by "_delete_snapshot" :: held 1.380s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:33:35 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-324ed69e-410e-40aa-8248-fa95c5a14196 tempest-ProjectReaderTests-270310627 None] Lock "cinder-quobyte-931bfba5-481c-4bf3-9bc2-72f072de8b86" released by "delete_snapshot" :: held 1.399s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:33:35 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-324ed69e-410e-40aa-8248-fa95c5a14196 tempest-ProjectReaderTests-270310627 None] Created reservations ['d1d11d79-d564-460f-9133-5e8d298ce732', '92646004-2b6b-43b0-9ae4-d5049e06e9ad', 'f8289ff2-eadd-4b1e-b7ce-d82911e8451e', '7ef801a8-87de-46d5-ab4a-82ed1f18c3de'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:33:35 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-324ed69e-410e-40aa-8248-fa95c5a14196 tempest-ProjectReaderTests-270310627 None] Delete snapshot completed successfully. Aug 31 15:33:35 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-324ed69e-410e-40aa-8248-fa95c5a14196 tempest-ProjectReaderTests-270310627 None] Lock "cinder-bf4a5166-386b-4fec-a95b-e4e98d9e94bc-delete_snapshot" released by "delete_snapshot" :: held 1.526s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:33:35 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-baa3ee36-8221-4645-8557-574ebe0f1d96 tempest-ProjectReaderTests-270310627 None] Acquiring lock "cinder-931bfba5-481c-4bf3-9bc2-72f072de8b86-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:33:35 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-baa3ee36-8221-4645-8557-574ebe0f1d96 tempest-ProjectReaderTests-270310627 None] Lock "cinder-931bfba5-481c-4bf3-9bc2-72f072de8b86-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:33:36 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-baa3ee36-8221-4645-8557-574ebe0f1d96 tempest-ProjectReaderTests-270310627 None] Acquiring lock "cinder-quobyte-931bfba5-481c-4bf3-9bc2-72f072de8b86" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:33:36 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-baa3ee36-8221-4645-8557-574ebe0f1d96 tempest-ProjectReaderTests-270310627 None] Lock "cinder-quobyte-931bfba5-481c-4bf3-9bc2-72f072de8b86" acquired by "delete_volume" :: waited 0.019s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:33:36 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[221b8663-84bd-4dad-b9eb-2582eb172148]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:33:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-baa3ee36-8221-4645-8557-574ebe0f1d96 tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:36 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86 Aug 31 15:33:36 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:36 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-baa3ee36-8221-4645-8557-574ebe0f1d96 tempest-ProjectReaderTests-270310627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86" returned: 0 in 0.351s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-baa3ee36-8221-4645-8557-574ebe0f1d96 tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:36 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86 Aug 31 15:33:36 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:36 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-baa3ee36-8221-4645-8557-574ebe0f1d96 tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-931bfba5-481c-4bf3-9bc2-72f072de8b86" returned: 0 in 0.240s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:36 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-baa3ee36-8221-4645-8557-574ebe0f1d96 tempest-ProjectReaderTests-270310627 None] Lock "cinder-quobyte-931bfba5-481c-4bf3-9bc2-72f072de8b86" released by "delete_volume" :: held 0.640s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:33:36 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-baa3ee36-8221-4645-8557-574ebe0f1d96 tempest-ProjectReaderTests-270310627 None] Created reservations ['76d58039-ce50-42f5-a61c-6a4b79ed8bf8', '7f8a65ff-b948-4e4c-b0cc-7ce36951d04c', 'be53a5c8-caa0-49f7-9251-32b0f67e4b7d', '6c338b49-d077-408b-85ce-779482f9c126'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:33:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-baa3ee36-8221-4645-8557-574ebe0f1d96 tempest-ProjectReaderTests-270310627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:33:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-baa3ee36-8221-4645-8557-574ebe0f1d96 tempest-ProjectReaderTests-270310627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:33:36 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-baa3ee36-8221-4645-8557-574ebe0f1d96 tempest-ProjectReaderTests-270310627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:33:36 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-baa3ee36-8221-4645-8557-574ebe0f1d96 tempest-ProjectReaderTests-270310627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:33:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-baa3ee36-8221-4645-8557-574ebe0f1d96 tempest-ProjectReaderTests-270310627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:33:36 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-baa3ee36-8221-4645-8557-574ebe0f1d96 tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:36 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:33:36 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:37 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-baa3ee36-8221-4645-8557-574ebe0f1d96 tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.235s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:37 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-baa3ee36-8221-4645-8557-574ebe0f1d96 tempest-ProjectReaderTests-270310627 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:33:37 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-baa3ee36-8221-4645-8557-574ebe0f1d96 tempest-ProjectReaderTests-270310627 None] Deleted volume successfully. Aug 31 15:33:37 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-baa3ee36-8221-4645-8557-574ebe0f1d96 tempest-ProjectReaderTests-270310627 None] Lock "cinder-931bfba5-481c-4bf3-9bc2-72f072de8b86-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:33:37 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd964914-dc0f-4a46-99b3-05f9d3310cbc tempest-ProjectReaderTests-270310627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:33:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-fd964914-dc0f-4a46-99b3-05f9d3310cbc tempest-ProjectReaderTests-270310627 None] Flow 'volume_create_manager' (98be87e6-bcfa-437d-a087-b7dfdb8f04dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:33:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-fd964914-dc0f-4a46-99b3-05f9d3310cbc tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (722af3ee-22cd-4ff0-ae89-1cdc94474f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:33:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-fd964914-dc0f-4a46-99b3-05f9d3310cbc tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (722af3ee-22cd-4ff0-ae89-1cdc94474f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2092362674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bf609a9-fc37-46ae-aada-9a9b99a129eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d00e2c9bd9ab4e59a15685f1ddc6f5ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:33:37Z,use_quota=True,user_id='013d907e479b4a51af1ae07d758dc986',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:33:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-fd964914-dc0f-4a46-99b3-05f9d3310cbc tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec44556-8af5-49a7-b919-3cd9541c9cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:33:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-fd964914-dc0f-4a46-99b3-05f9d3310cbc tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec44556-8af5-49a7-b919-3cd9541c9cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:33:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-fd964914-dc0f-4a46-99b3-05f9d3310cbc tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36615e2d-03c0-449b-9256-aab8242f65e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:33:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-fd964914-dc0f-4a46-99b3-05f9d3310cbc tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36615e2d-03c0-449b-9256-aab8242f65e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bf609a9-fc37-46ae-aada-9a9b99a129eb', 'volume_name': 'volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:33:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-fd964914-dc0f-4a46-99b3-05f9d3310cbc tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81f853e7-0d70-44fc-b601-d4dc223330c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:33:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-fd964914-dc0f-4a46-99b3-05f9d3310cbc tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81f853e7-0d70-44fc-b601-d4dc223330c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:33:37 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-fd964914-dc0f-4a46-99b3-05f9d3310cbc tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76d4f0c0-0658-4d61-af68-5ff1849d5112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:33:37 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-fd964914-dc0f-4a46-99b3-05f9d3310cbc tempest-ProjectReaderTests-270310627 None] Volume 1bf609a9-fc37-46ae-aada-9a9b99a129eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb', 'volume_size': 1} Aug 31 15:33:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-fd964914-dc0f-4a46-99b3-05f9d3310cbc tempest-ProjectReaderTests-270310627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:33:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-fd964914-dc0f-4a46-99b3-05f9d3310cbc tempest-ProjectReaderTests-270310627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:33:37 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-fd964914-dc0f-4a46-99b3-05f9d3310cbc tempest-ProjectReaderTests-270310627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2092362674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bf609a9-fc37-46ae-aada-9a9b99a129eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d00e2c9bd9ab4e59a15685f1ddc6f5ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:33:37Z,use_quota=True,user_id='013d907e479b4a51af1ae07d758dc986',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:33:37 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-fd964914-dc0f-4a46-99b3-05f9d3310cbc tempest-ProjectReaderTests-270310627 None] Creating volume 1bf609a9-fc37-46ae-aada-9a9b99a129eb {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:33:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-fd964914-dc0f-4a46-99b3-05f9d3310cbc tempest-ProjectReaderTests-270310627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:33:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-fd964914-dc0f-4a46-99b3-05f9d3310cbc tempest-ProjectReaderTests-270310627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:33:37 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-fd964914-dc0f-4a46-99b3-05f9d3310cbc tempest-ProjectReaderTests-270310627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:33:37 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-fd964914-dc0f-4a46-99b3-05f9d3310cbc tempest-ProjectReaderTests-270310627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:33:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-fd964914-dc0f-4a46-99b3-05f9d3310cbc tempest-ProjectReaderTests-270310627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:33:37 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-fd964914-dc0f-4a46-99b3-05f9d3310cbc tempest-ProjectReaderTests-270310627 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:33:37 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-fd964914-dc0f-4a46-99b3-05f9d3310cbc tempest-ProjectReaderTests-270310627 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:33:37 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-fd964914-dc0f-4a46-99b3-05f9d3310cbc tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:37 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb 1073741824 Aug 31 15:33:37 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:37 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-fd964914-dc0f-4a46-99b3-05f9d3310cbc tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb 1073741824" returned: 0 in 0.383s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-fd964914-dc0f-4a46-99b3-05f9d3310cbc tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:38 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb Aug 31 15:33:38 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:38 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-fd964914-dc0f-4a46-99b3-05f9d3310cbc tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb" returned: 0 in 0.235s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:38 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-fd964914-dc0f-4a46-99b3-05f9d3310cbc tempest-ProjectReaderTests-270310627 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:33:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-fd964914-dc0f-4a46-99b3-05f9d3310cbc tempest-ProjectReaderTests-270310627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:33:38 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-fd964914-dc0f-4a46-99b3-05f9d3310cbc tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76d4f0c0-0658-4d61-af68-5ff1849d5112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:33:38 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-fd964914-dc0f-4a46-99b3-05f9d3310cbc tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e43906fa-2714-46fd-961a-e136688f1635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:33:38 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-fd964914-dc0f-4a46-99b3-05f9d3310cbc tempest-ProjectReaderTests-270310627 None] Volume volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb (1bf609a9-fc37-46ae-aada-9a9b99a129eb): created successfully Aug 31 15:33:38 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-fd964914-dc0f-4a46-99b3-05f9d3310cbc tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e43906fa-2714-46fd-961a-e136688f1635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:33:38 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-fd964914-dc0f-4a46-99b3-05f9d3310cbc tempest-ProjectReaderTests-270310627 None] Flow 'volume_create_manager' (98be87e6-bcfa-437d-a087-b7dfdb8f04dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:33:38 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-fd964914-dc0f-4a46-99b3-05f9d3310cbc tempest-ProjectReaderTests-270310627 None] Created volume successfully. Aug 31 15:33:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bfba1e40-f8e6-49b7-9880-46690299246b tempest-ProjectReaderTests-270310627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:33:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bfba1e40-f8e6-49b7-9880-46690299246b tempest-ProjectReaderTests-270310627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:33:38 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-bfba1e40-f8e6-49b7-9880-46690299246b tempest-ProjectReaderTests-270310627 None] Creating offline snapshot 46f8e35f-6864-4b50-b0a2-9eebac5f1b53 of volume 1bf609a9-fc37-46ae-aada-9a9b99a129eb {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:33:38 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cab148-3a57-490f-b7c9-c4052f98e1ef]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:33:38 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bfba1e40-f8e6-49b7-9880-46690299246b tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:39 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb Aug 31 15:33:39 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:39 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bfba1e40-f8e6-49b7-9880-46690299246b tempest-ProjectReaderTests-270310627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb" returned: 0 in 0.362s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bfba1e40-f8e6-49b7-9880-46690299246b tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb.46f8e35f-6864-4b50-b0a2-9eebac5f1b53 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:39 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb.46f8e35f-6864-4b50-b0a2-9eebac5f1b53 1G Aug 31 15:33:39 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:39 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bfba1e40-f8e6-49b7-9880-46690299246b tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb.46f8e35f-6864-4b50-b0a2-9eebac5f1b53 1G" returned: 0 in 0.371s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bfba1e40-f8e6-49b7-9880-46690299246b tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb.46f8e35f-6864-4b50-b0a2-9eebac5f1b53 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:39 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb.46f8e35f-6864-4b50-b0a2-9eebac5f1b53 Aug 31 15:33:39 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:39 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bfba1e40-f8e6-49b7-9880-46690299246b tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb.46f8e35f-6864-4b50-b0a2-9eebac5f1b53" returned: 0 in 0.273s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:39 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-bfba1e40-f8e6-49b7-9880-46690299246b tempest-ProjectReaderTests-270310627 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb.46f8e35f-6864-4b50-b0a2-9eebac5f1b53 is being set with open permissions: ugo+rw Aug 31 15:33:39 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bfba1e40-f8e6-49b7-9880-46690299246b tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb.46f8e35f-6864-4b50-b0a2-9eebac5f1b53 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:40 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb.46f8e35f-6864-4b50-b0a2-9eebac5f1b53 Aug 31 15:33:40 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:40 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bfba1e40-f8e6-49b7-9880-46690299246b tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb.46f8e35f-6864-4b50-b0a2-9eebac5f1b53" returned: 0 in 0.223s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bfba1e40-f8e6-49b7-9880-46690299246b tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:40 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb.info Aug 31 15:33:40 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:40 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bfba1e40-f8e6-49b7-9880-46690299246b tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb.info" returned: 0 in 0.259s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:40 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-bfba1e40-f8e6-49b7-9880-46690299246b tempest-ProjectReaderTests-270310627 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb.info is being set with open permissions: ugo+rw Aug 31 15:33:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bfba1e40-f8e6-49b7-9880-46690299246b tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:40 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb.info Aug 31 15:33:40 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:40 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-bfba1e40-f8e6-49b7-9880-46690299246b tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb.info" returned: 0 in 0.231s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:40 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-bfba1e40-f8e6-49b7-9880-46690299246b tempest-ProjectReaderTests-270310627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.791s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:33:40 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-bfba1e40-f8e6-49b7-9880-46690299246b tempest-ProjectReaderTests-270310627 None] Create snapshot completed successfully Aug 31 15:33:41 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-0c184f07-635f-4632-bce6-8af512d5559b tempest-ProjectReaderTests-270310627 None] Acquiring lock "cinder-46f8e35f-6864-4b50-b0a2-9eebac5f1b53-delete_snapshot" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:33:41 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-0c184f07-635f-4632-bce6-8af512d5559b tempest-ProjectReaderTests-270310627 None] Lock "cinder-46f8e35f-6864-4b50-b0a2-9eebac5f1b53-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:33:41 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-0c184f07-635f-4632-bce6-8af512d5559b tempest-ProjectReaderTests-270310627 None] Acquiring lock "cinder-quobyte-1bf609a9-fc37-46ae-aada-9a9b99a129eb" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:33:41 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-0c184f07-635f-4632-bce6-8af512d5559b tempest-ProjectReaderTests-270310627 None] Lock "cinder-quobyte-1bf609a9-fc37-46ae-aada-9a9b99a129eb" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:33:41 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-0c184f07-635f-4632-bce6-8af512d5559b tempest-ProjectReaderTests-270310627 None] Acquiring lock "cinder-quobyte-46f8e35f-6864-4b50-b0a2-9eebac5f1b53" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:33:41 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-0c184f07-635f-4632-bce6-8af512d5559b tempest-ProjectReaderTests-270310627 None] Lock "cinder-quobyte-46f8e35f-6864-4b50-b0a2-9eebac5f1b53" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:33:41 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-0c184f07-635f-4632-bce6-8af512d5559b tempest-ProjectReaderTests-270310627 None] Deleting offline snapshot 46f8e35f-6864-4b50-b0a2-9eebac5f1b53 of volume 1bf609a9-fc37-46ae-aada-9a9b99a129eb {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:33:41 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-0c184f07-635f-4632-bce6-8af512d5559b tempest-ProjectReaderTests-270310627 None] snapshot_file for this snap is: volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb.46f8e35f-6864-4b50-b0a2-9eebac5f1b53 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:33:41 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3c7bb0-58d7-4e4e-aff9-5909b6ea744f]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:33:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0c184f07-635f-4632-bce6-8af512d5559b tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb.46f8e35f-6864-4b50-b0a2-9eebac5f1b53 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:41 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb.46f8e35f-6864-4b50-b0a2-9eebac5f1b53 Aug 31 15:33:41 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:41 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0c184f07-635f-4632-bce6-8af512d5559b tempest-ProjectReaderTests-270310627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb.46f8e35f-6864-4b50-b0a2-9eebac5f1b53" returned: 0 in 0.364s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:41 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-0c184f07-635f-4632-bce6-8af512d5559b tempest-ProjectReaderTests-270310627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:33:41 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaced4a8-cbd1-4a0f-aab5-152cfb69fc5a]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:33:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0c184f07-635f-4632-bce6-8af512d5559b tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:41 devstack sudo[106946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb Aug 31 15:33:41 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:41 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0c184f07-635f-4632-bce6-8af512d5559b tempest-ProjectReaderTests-270310627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb" returned: 0 in 0.339s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0c184f07-635f-4632-bce6-8af512d5559b tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb.46f8e35f-6864-4b50-b0a2-9eebac5f1b53 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:41 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb.46f8e35f-6864-4b50-b0a2-9eebac5f1b53 Aug 31 15:33:41 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:42 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0c184f07-635f-4632-bce6-8af512d5559b tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb.46f8e35f-6864-4b50-b0a2-9eebac5f1b53" returned: 0 in 0.337s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0c184f07-635f-4632-bce6-8af512d5559b tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb.46f8e35f-6864-4b50-b0a2-9eebac5f1b53 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:42 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb.46f8e35f-6864-4b50-b0a2-9eebac5f1b53 Aug 31 15:33:42 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:42 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:42 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-0c184f07-635f-4632-bce6-8af512d5559b tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb.46f8e35f-6864-4b50-b0a2-9eebac5f1b53" returned: 0 in 0.236s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:42 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-0c184f07-635f-4632-bce6-8af512d5559b tempest-ProjectReaderTests-270310627 None] Lock "cinder-quobyte-46f8e35f-6864-4b50-b0a2-9eebac5f1b53" released by "_delete_snapshot" :: held 1.359s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:33:42 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-0c184f07-635f-4632-bce6-8af512d5559b tempest-ProjectReaderTests-270310627 None] Lock "cinder-quobyte-1bf609a9-fc37-46ae-aada-9a9b99a129eb" released by "delete_snapshot" :: held 1.381s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:33:42 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-0c184f07-635f-4632-bce6-8af512d5559b tempest-ProjectReaderTests-270310627 None] Created reservations ['7b2f90fd-c5f5-41da-809f-be916b005367', '43e70f04-c326-4973-95a7-d8184b70181c', 'cefec895-eb27-4115-8f66-c79226e9d9c5', 'f8f7db85-45b1-47f5-8149-6f53b5fb5953'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:33:42 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-0c184f07-635f-4632-bce6-8af512d5559b tempest-ProjectReaderTests-270310627 None] Delete snapshot completed successfully. Aug 31 15:33:42 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-0c184f07-635f-4632-bce6-8af512d5559b tempest-ProjectReaderTests-270310627 None] Lock "cinder-46f8e35f-6864-4b50-b0a2-9eebac5f1b53-delete_snapshot" released by "delete_snapshot" :: held 1.504s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:33:43 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-ee4d9357-f5b3-477f-b2e4-bffaaab8c5df tempest-ProjectReaderTests-270310627 None] Acquiring lock "cinder-1bf609a9-fc37-46ae-aada-9a9b99a129eb-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:33:43 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-ee4d9357-f5b3-477f-b2e4-bffaaab8c5df tempest-ProjectReaderTests-270310627 None] Lock "cinder-1bf609a9-fc37-46ae-aada-9a9b99a129eb-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:33:43 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-ee4d9357-f5b3-477f-b2e4-bffaaab8c5df tempest-ProjectReaderTests-270310627 None] Acquiring lock "cinder-quobyte-1bf609a9-fc37-46ae-aada-9a9b99a129eb" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:33:43 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-ee4d9357-f5b3-477f-b2e4-bffaaab8c5df tempest-ProjectReaderTests-270310627 None] Lock "cinder-quobyte-1bf609a9-fc37-46ae-aada-9a9b99a129eb" acquired by "delete_volume" :: waited 0.015s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:33:43 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[effe51de-573f-4029-83c2-12d7fc5a9241]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:33:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ee4d9357-f5b3-477f-b2e4-bffaaab8c5df tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:43 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb Aug 31 15:33:43 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:43 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ee4d9357-f5b3-477f-b2e4-bffaaab8c5df tempest-ProjectReaderTests-270310627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb" returned: 0 in 0.356s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ee4d9357-f5b3-477f-b2e4-bffaaab8c5df tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:43 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb Aug 31 15:33:43 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:43 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:43 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ee4d9357-f5b3-477f-b2e4-bffaaab8c5df tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-1bf609a9-fc37-46ae-aada-9a9b99a129eb" returned: 0 in 0.233s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:43 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-ee4d9357-f5b3-477f-b2e4-bffaaab8c5df tempest-ProjectReaderTests-270310627 None] Lock "cinder-quobyte-1bf609a9-fc37-46ae-aada-9a9b99a129eb" released by "delete_volume" :: held 0.646s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:33:44 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-ee4d9357-f5b3-477f-b2e4-bffaaab8c5df tempest-ProjectReaderTests-270310627 None] Created reservations ['01021da1-c9d1-4351-b88e-ef36e341a005', 'd90f3225-7542-4bf1-9a48-46e24f78f89a', '5b380fca-ce2c-4161-a701-09a9a9999fa0', '664f3f29-2113-4ffa-9cb8-04803903e91c'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:33:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ee4d9357-f5b3-477f-b2e4-bffaaab8c5df tempest-ProjectReaderTests-270310627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:33:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ee4d9357-f5b3-477f-b2e4-bffaaab8c5df tempest-ProjectReaderTests-270310627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:33:44 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-ee4d9357-f5b3-477f-b2e4-bffaaab8c5df tempest-ProjectReaderTests-270310627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:33:44 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-ee4d9357-f5b3-477f-b2e4-bffaaab8c5df tempest-ProjectReaderTests-270310627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:33:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ee4d9357-f5b3-477f-b2e4-bffaaab8c5df tempest-ProjectReaderTests-270310627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:33:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ee4d9357-f5b3-477f-b2e4-bffaaab8c5df tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:44 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:33:44 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:44 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ee4d9357-f5b3-477f-b2e4-bffaaab8c5df tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.249s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:44 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-ee4d9357-f5b3-477f-b2e4-bffaaab8c5df tempest-ProjectReaderTests-270310627 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:33:44 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-ee4d9357-f5b3-477f-b2e4-bffaaab8c5df tempest-ProjectReaderTests-270310627 None] Deleted volume successfully. Aug 31 15:33:44 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-ee4d9357-f5b3-477f-b2e4-bffaaab8c5df tempest-ProjectReaderTests-270310627 None] Lock "cinder-1bf609a9-fc37-46ae-aada-9a9b99a129eb-delete_volume" released by "delete_volume" :: held 1.103s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:33:44 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:INSERT=41,cinder:UPDATE=153,cinder:SELECT=122,cinder:DELETE=14 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:33:44 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-414572ab-efea-4c01-8356-ea0836405f1f tempest-ProjectReaderTests-270310627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:33:44 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-414572ab-efea-4c01-8356-ea0836405f1f tempest-ProjectReaderTests-270310627 None] Flow 'volume_create_manager' (85d88154-d05d-4a87-885e-bafefaae0163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:33:44 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-414572ab-efea-4c01-8356-ea0836405f1f tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdfd7fe3-be6d-41c5-a0aa-ffab473dc1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:33:44 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-414572ab-efea-4c01-8356-ea0836405f1f tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdfd7fe3-be6d-41c5-a0aa-ffab473dc1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1740368675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c99841f6-c088-4617-a29f-cacd32acae8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d00e2c9bd9ab4e59a15685f1ddc6f5ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:33:45Z,use_quota=True,user_id='013d907e479b4a51af1ae07d758dc986',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:33:44 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-414572ab-efea-4c01-8356-ea0836405f1f tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d77b50c-d19d-49d9-bf4e-5d6b48e49b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:33:44 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-414572ab-efea-4c01-8356-ea0836405f1f tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d77b50c-d19d-49d9-bf4e-5d6b48e49b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:33:44 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-414572ab-efea-4c01-8356-ea0836405f1f tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16ec47fa-ac98-4c49-a7a9-1226833d23f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:33:44 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-414572ab-efea-4c01-8356-ea0836405f1f tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16ec47fa-ac98-4c49-a7a9-1226833d23f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c99841f6-c088-4617-a29f-cacd32acae8e', 'volume_name': 'volume-c99841f6-c088-4617-a29f-cacd32acae8e', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:33:44 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-414572ab-efea-4c01-8356-ea0836405f1f tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9998f003-7b59-4af2-aef9-bc0042ba7816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:33:44 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-414572ab-efea-4c01-8356-ea0836405f1f tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9998f003-7b59-4af2-aef9-bc0042ba7816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:33:44 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-414572ab-efea-4c01-8356-ea0836405f1f tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbd06eb2-0acb-4275-ae0c-48b710921a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:33:44 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-414572ab-efea-4c01-8356-ea0836405f1f tempest-ProjectReaderTests-270310627 None] Volume c99841f6-c088-4617-a29f-cacd32acae8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c99841f6-c088-4617-a29f-cacd32acae8e', 'volume_size': 1} Aug 31 15:33:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-414572ab-efea-4c01-8356-ea0836405f1f tempest-ProjectReaderTests-270310627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:33:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-414572ab-efea-4c01-8356-ea0836405f1f tempest-ProjectReaderTests-270310627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:33:44 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-414572ab-efea-4c01-8356-ea0836405f1f tempest-ProjectReaderTests-270310627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1740368675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c99841f6-c088-4617-a29f-cacd32acae8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d00e2c9bd9ab4e59a15685f1ddc6f5ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:33:45Z,use_quota=True,user_id='013d907e479b4a51af1ae07d758dc986',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:33:44 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-414572ab-efea-4c01-8356-ea0836405f1f tempest-ProjectReaderTests-270310627 None] Creating volume c99841f6-c088-4617-a29f-cacd32acae8e {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:33:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-414572ab-efea-4c01-8356-ea0836405f1f tempest-ProjectReaderTests-270310627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:33:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-414572ab-efea-4c01-8356-ea0836405f1f tempest-ProjectReaderTests-270310627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:33:44 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-414572ab-efea-4c01-8356-ea0836405f1f tempest-ProjectReaderTests-270310627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:33:44 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-414572ab-efea-4c01-8356-ea0836405f1f tempest-ProjectReaderTests-270310627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:33:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-414572ab-efea-4c01-8356-ea0836405f1f tempest-ProjectReaderTests-270310627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:33:44 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-414572ab-efea-4c01-8356-ea0836405f1f tempest-ProjectReaderTests-270310627 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:33:44 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-414572ab-efea-4c01-8356-ea0836405f1f tempest-ProjectReaderTests-270310627 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:33:44 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-414572ab-efea-4c01-8356-ea0836405f1f tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:44 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e 1073741824 Aug 31 15:33:44 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:45 devstack cinder-volume[86000]: DEBUG oslo_service.periodic_task [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86000) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:33:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:33:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:33:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:33:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:33:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:33:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:45 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:33:45 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:45 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-414572ab-efea-4c01-8356-ea0836405f1f tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e 1073741824" returned: 0 in 0.408s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:45 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:UPDATE=147,cinder:SELECT=105,cinder:INSERT=41,cinder:DELETE=11 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:33:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-414572ab-efea-4c01-8356-ea0836405f1f tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:45 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.257s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:45 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:33:45 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e Aug 31 15:33:45 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:45 devstack cinder-volume[86000]: DEBUG oslo_service.periodic_task [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] Running periodic task VolumeManager._thread_info {{(pid=86000) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 31 15:33:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] thread count: 28 {{(pid=86000) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 31 15:33:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-669bcd9b-74d1-432b-b305-8f59375084ed None None] thread info: [<_MainThread(MainThread, started 137631281086592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86000) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 31 15:33:45 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-414572ab-efea-4c01-8356-ea0836405f1f tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e" returned: 0 in 0.247s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-414572ab-efea-4c01-8356-ea0836405f1f tempest-ProjectReaderTests-270310627 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:33:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-414572ab-efea-4c01-8356-ea0836405f1f tempest-ProjectReaderTests-270310627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:33:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-414572ab-efea-4c01-8356-ea0836405f1f tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbd06eb2-0acb-4275-ae0c-48b710921a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c99841f6-c088-4617-a29f-cacd32acae8e', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:33:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-414572ab-efea-4c01-8356-ea0836405f1f tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf253aee-a27d-4f36-81cd-20cfac98885b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:33:45 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-414572ab-efea-4c01-8356-ea0836405f1f tempest-ProjectReaderTests-270310627 None] Volume volume-c99841f6-c088-4617-a29f-cacd32acae8e (c99841f6-c088-4617-a29f-cacd32acae8e): created successfully Aug 31 15:33:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-414572ab-efea-4c01-8356-ea0836405f1f tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf253aee-a27d-4f36-81cd-20cfac98885b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:33:45 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-414572ab-efea-4c01-8356-ea0836405f1f tempest-ProjectReaderTests-270310627 None] Flow 'volume_create_manager' (85d88154-d05d-4a87-885e-bafefaae0163) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:33:45 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-414572ab-efea-4c01-8356-ea0836405f1f tempest-ProjectReaderTests-270310627 None] Created volume successfully. Aug 31 15:33:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-322fdb34-dd4d-4497-8013-f51a75912558 tempest-ProjectReaderTests-270310627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:33:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-322fdb34-dd4d-4497-8013-f51a75912558 tempest-ProjectReaderTests-270310627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:33:45 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-322fdb34-dd4d-4497-8013-f51a75912558 tempest-ProjectReaderTests-270310627 None] Creating offline snapshot 4b4daf23-f2e5-4aed-a9a3-f10918123781 of volume c99841f6-c088-4617-a29f-cacd32acae8e {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:33:45 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[678fd15c-6b2d-43f7-b97b-4da13fe8ad4b]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:33:45 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-322fdb34-dd4d-4497-8013-f51a75912558 tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:46 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e Aug 31 15:33:46 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:46 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-322fdb34-dd4d-4497-8013-f51a75912558 tempest-ProjectReaderTests-270310627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e" returned: 0 in 0.377s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-322fdb34-dd4d-4497-8013-f51a75912558 tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e.4b4daf23-f2e5-4aed-a9a3-f10918123781 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:46 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e.4b4daf23-f2e5-4aed-a9a3-f10918123781 1G Aug 31 15:33:46 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:46 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-322fdb34-dd4d-4497-8013-f51a75912558 tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e.4b4daf23-f2e5-4aed-a9a3-f10918123781 1G" returned: 0 in 0.391s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:46 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-322fdb34-dd4d-4497-8013-f51a75912558 tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c99841f6-c088-4617-a29f-cacd32acae8e -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e.4b4daf23-f2e5-4aed-a9a3-f10918123781 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:46 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c99841f6-c088-4617-a29f-cacd32acae8e -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e.4b4daf23-f2e5-4aed-a9a3-f10918123781 Aug 31 15:33:46 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:47 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-322fdb34-dd4d-4497-8013-f51a75912558 tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c99841f6-c088-4617-a29f-cacd32acae8e -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e.4b4daf23-f2e5-4aed-a9a3-f10918123781" returned: 0 in 0.286s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:47 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-322fdb34-dd4d-4497-8013-f51a75912558 tempest-ProjectReaderTests-270310627 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e.4b4daf23-f2e5-4aed-a9a3-f10918123781 is being set with open permissions: ugo+rw Aug 31 15:33:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-322fdb34-dd4d-4497-8013-f51a75912558 tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e.4b4daf23-f2e5-4aed-a9a3-f10918123781 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:47 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e.4b4daf23-f2e5-4aed-a9a3-f10918123781 Aug 31 15:33:47 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:47 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-322fdb34-dd4d-4497-8013-f51a75912558 tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e.4b4daf23-f2e5-4aed-a9a3-f10918123781" returned: 0 in 0.248s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-322fdb34-dd4d-4497-8013-f51a75912558 tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:47 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e.info Aug 31 15:33:47 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:47 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-322fdb34-dd4d-4497-8013-f51a75912558 tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e.info" returned: 0 in 0.251s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:47 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-322fdb34-dd4d-4497-8013-f51a75912558 tempest-ProjectReaderTests-270310627 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e.info is being set with open permissions: ugo+rw Aug 31 15:33:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-322fdb34-dd4d-4497-8013-f51a75912558 tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:47 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e.info Aug 31 15:33:47 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:47 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-322fdb34-dd4d-4497-8013-f51a75912558 tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e.info" returned: 0 in 0.236s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:47 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-322fdb34-dd4d-4497-8013-f51a75912558 tempest-ProjectReaderTests-270310627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.868s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:33:47 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-322fdb34-dd4d-4497-8013-f51a75912558 tempest-ProjectReaderTests-270310627 None] Create snapshot completed successfully Aug 31 15:33:48 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e7b6b3c2-fd2f-464c-944e-6f64012b2b12 tempest-ProjectReaderTests-270310627 None] Acquiring lock "cinder-4b4daf23-f2e5-4aed-a9a3-f10918123781-delete_snapshot" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:33:48 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e7b6b3c2-fd2f-464c-944e-6f64012b2b12 tempest-ProjectReaderTests-270310627 None] Lock "cinder-4b4daf23-f2e5-4aed-a9a3-f10918123781-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:33:48 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e7b6b3c2-fd2f-464c-944e-6f64012b2b12 tempest-ProjectReaderTests-270310627 None] Acquiring lock "cinder-quobyte-c99841f6-c088-4617-a29f-cacd32acae8e" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:33:48 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e7b6b3c2-fd2f-464c-944e-6f64012b2b12 tempest-ProjectReaderTests-270310627 None] Lock "cinder-quobyte-c99841f6-c088-4617-a29f-cacd32acae8e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:33:48 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e7b6b3c2-fd2f-464c-944e-6f64012b2b12 tempest-ProjectReaderTests-270310627 None] Acquiring lock "cinder-quobyte-4b4daf23-f2e5-4aed-a9a3-f10918123781" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:33:48 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e7b6b3c2-fd2f-464c-944e-6f64012b2b12 tempest-ProjectReaderTests-270310627 None] Lock "cinder-quobyte-4b4daf23-f2e5-4aed-a9a3-f10918123781" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:33:48 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-e7b6b3c2-fd2f-464c-944e-6f64012b2b12 tempest-ProjectReaderTests-270310627 None] Deleting offline snapshot 4b4daf23-f2e5-4aed-a9a3-f10918123781 of volume c99841f6-c088-4617-a29f-cacd32acae8e {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:33:48 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-e7b6b3c2-fd2f-464c-944e-6f64012b2b12 tempest-ProjectReaderTests-270310627 None] snapshot_file for this snap is: volume-c99841f6-c088-4617-a29f-cacd32acae8e.4b4daf23-f2e5-4aed-a9a3-f10918123781 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:33:48 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7120c8c7-cda1-45fc-8936-260bd9be0300]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:33:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e7b6b3c2-fd2f-464c-944e-6f64012b2b12 tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e.4b4daf23-f2e5-4aed-a9a3-f10918123781 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:48 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e.4b4daf23-f2e5-4aed-a9a3-f10918123781 Aug 31 15:33:48 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:48 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e7b6b3c2-fd2f-464c-944e-6f64012b2b12 tempest-ProjectReaderTests-270310627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e.4b4daf23-f2e5-4aed-a9a3-f10918123781" returned: 0 in 0.365s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:48 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-e7b6b3c2-fd2f-464c-944e-6f64012b2b12 tempest-ProjectReaderTests-270310627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c99841f6-c088-4617-a29f-cacd32acae8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:33:48 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a948ea-deb6-4575-bac2-38cd4cf89aba]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:33:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e7b6b3c2-fd2f-464c-944e-6f64012b2b12 tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:48 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e Aug 31 15:33:48 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:48 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e7b6b3c2-fd2f-464c-944e-6f64012b2b12 tempest-ProjectReaderTests-270310627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e" returned: 0 in 0.351s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:48 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e7b6b3c2-fd2f-464c-944e-6f64012b2b12 tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e.4b4daf23-f2e5-4aed-a9a3-f10918123781 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:48 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e.4b4daf23-f2e5-4aed-a9a3-f10918123781 Aug 31 15:33:48 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:49 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e7b6b3c2-fd2f-464c-944e-6f64012b2b12 tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e.4b4daf23-f2e5-4aed-a9a3-f10918123781" returned: 0 in 0.335s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e7b6b3c2-fd2f-464c-944e-6f64012b2b12 tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e.4b4daf23-f2e5-4aed-a9a3-f10918123781 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:49 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e.4b4daf23-f2e5-4aed-a9a3-f10918123781 Aug 31 15:33:49 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:49 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:49 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-e7b6b3c2-fd2f-464c-944e-6f64012b2b12 tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e.4b4daf23-f2e5-4aed-a9a3-f10918123781" returned: 0 in 0.244s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:49 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e7b6b3c2-fd2f-464c-944e-6f64012b2b12 tempest-ProjectReaderTests-270310627 None] Lock "cinder-quobyte-4b4daf23-f2e5-4aed-a9a3-f10918123781" released by "_delete_snapshot" :: held 1.387s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:33:49 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e7b6b3c2-fd2f-464c-944e-6f64012b2b12 tempest-ProjectReaderTests-270310627 None] Lock "cinder-quobyte-c99841f6-c088-4617-a29f-cacd32acae8e" released by "delete_snapshot" :: held 1.412s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:33:49 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-e7b6b3c2-fd2f-464c-944e-6f64012b2b12 tempest-ProjectReaderTests-270310627 None] Created reservations ['884633cb-57c4-4384-8a30-e911cfd318d8', '94c39274-c091-4d68-bf23-b786f955531a', 'fc1bedda-a2bc-4e84-892d-0fd91de6cafe', '1c15f1f3-4e7a-49d6-98a9-fbc1861288b9'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:33:49 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-e7b6b3c2-fd2f-464c-944e-6f64012b2b12 tempest-ProjectReaderTests-270310627 None] Delete snapshot completed successfully. Aug 31 15:33:49 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-e7b6b3c2-fd2f-464c-944e-6f64012b2b12 tempest-ProjectReaderTests-270310627 None] Lock "cinder-4b4daf23-f2e5-4aed-a9a3-f10918123781-delete_snapshot" released by "delete_snapshot" :: held 1.536s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:33:50 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-cf8cbe7e-7889-4ac2-b945-005c1edfb624 tempest-ProjectReaderTests-270310627 None] Acquiring lock "cinder-c99841f6-c088-4617-a29f-cacd32acae8e-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:33:50 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-cf8cbe7e-7889-4ac2-b945-005c1edfb624 tempest-ProjectReaderTests-270310627 None] Lock "cinder-c99841f6-c088-4617-a29f-cacd32acae8e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:33:50 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-cf8cbe7e-7889-4ac2-b945-005c1edfb624 tempest-ProjectReaderTests-270310627 None] Acquiring lock "cinder-quobyte-c99841f6-c088-4617-a29f-cacd32acae8e" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:33:50 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-cf8cbe7e-7889-4ac2-b945-005c1edfb624 tempest-ProjectReaderTests-270310627 None] Lock "cinder-quobyte-c99841f6-c088-4617-a29f-cacd32acae8e" acquired by "delete_volume" :: waited 0.017s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:33:50 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86df22f-34dc-4d09-91ac-b21a400da13e]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:33:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cf8cbe7e-7889-4ac2-b945-005c1edfb624 tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:50 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e Aug 31 15:33:50 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:50 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cf8cbe7e-7889-4ac2-b945-005c1edfb624 tempest-ProjectReaderTests-270310627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e" returned: 0 in 0.354s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cf8cbe7e-7889-4ac2-b945-005c1edfb624 tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:50 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e Aug 31 15:33:50 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:50 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cf8cbe7e-7889-4ac2-b945-005c1edfb624 tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-c99841f6-c088-4617-a29f-cacd32acae8e" returned: 0 in 0.238s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:50 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-cf8cbe7e-7889-4ac2-b945-005c1edfb624 tempest-ProjectReaderTests-270310627 None] Lock "cinder-quobyte-c99841f6-c088-4617-a29f-cacd32acae8e" released by "delete_volume" :: held 0.649s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:33:51 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-cf8cbe7e-7889-4ac2-b945-005c1edfb624 tempest-ProjectReaderTests-270310627 None] Created reservations ['e4209e69-2cf7-446f-96de-e8aff59dbdec', '49d5a67a-96ce-4200-a9a2-0c3ebded4ac2', '3a46e21e-dc76-4ac1-840b-47eadf88c485', '1010be06-b057-4d93-8c9e-9e17ecceabf4'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:33:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-cf8cbe7e-7889-4ac2-b945-005c1edfb624 tempest-ProjectReaderTests-270310627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:33:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-cf8cbe7e-7889-4ac2-b945-005c1edfb624 tempest-ProjectReaderTests-270310627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:33:51 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-cf8cbe7e-7889-4ac2-b945-005c1edfb624 tempest-ProjectReaderTests-270310627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:33:51 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-cf8cbe7e-7889-4ac2-b945-005c1edfb624 tempest-ProjectReaderTests-270310627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:33:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-cf8cbe7e-7889-4ac2-b945-005c1edfb624 tempest-ProjectReaderTests-270310627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:33:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cf8cbe7e-7889-4ac2-b945-005c1edfb624 tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:51 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:33:51 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:51 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-cf8cbe7e-7889-4ac2-b945-005c1edfb624 tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.243s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:51 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-cf8cbe7e-7889-4ac2-b945-005c1edfb624 tempest-ProjectReaderTests-270310627 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:33:51 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-cf8cbe7e-7889-4ac2-b945-005c1edfb624 tempest-ProjectReaderTests-270310627 None] Deleted volume successfully. Aug 31 15:33:51 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-cf8cbe7e-7889-4ac2-b945-005c1edfb624 tempest-ProjectReaderTests-270310627 None] Lock "cinder-c99841f6-c088-4617-a29f-cacd32acae8e-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:33:51 devstack cinder-volume[86000]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbbfd966-9aeb-45f2-8272-24320d854f03 tempest-ProjectReaderTests-270310627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86000) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 31 15:33:51 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-fbbfd966-9aeb-45f2-8272-24320d854f03 tempest-ProjectReaderTests-270310627 None] Flow 'volume_create_manager' (ee17a585-e8eb-4e24-90ef-84d3f6e8a330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:33:51 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-fbbfd966-9aeb-45f2-8272-24320d854f03 tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4092a91-3bcc-4f88-bea6-7ccc4ee7b847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:33:51 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-fbbfd966-9aeb-45f2-8272-24320d854f03 tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4092a91-3bcc-4f88-bea6-7ccc4ee7b847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1377636352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=224bdb91-aeaf-4ef4-9677-39ed069f05a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d00e2c9bd9ab4e59a15685f1ddc6f5ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:33:52Z,use_quota=True,user_id='013d907e479b4a51af1ae07d758dc986',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:33:51 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-fbbfd966-9aeb-45f2-8272-24320d854f03 tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1ff3eda-df2a-419f-a324-e6d9e14d8dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:33:51 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-fbbfd966-9aeb-45f2-8272-24320d854f03 tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1ff3eda-df2a-419f-a324-e6d9e14d8dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:33:51 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-fbbfd966-9aeb-45f2-8272-24320d854f03 tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (423dbdf0-7757-4732-b43e-0a5ded0ea4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:33:51 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-fbbfd966-9aeb-45f2-8272-24320d854f03 tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (423dbdf0-7757-4732-b43e-0a5ded0ea4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '224bdb91-aeaf-4ef4-9677-39ed069f05a5', 'volume_name': 'volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:33:51 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-fbbfd966-9aeb-45f2-8272-24320d854f03 tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ec6be7f-3d77-4e72-b9b8-e90bc1f34069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:33:51 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-fbbfd966-9aeb-45f2-8272-24320d854f03 tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ec6be7f-3d77-4e72-b9b8-e90bc1f34069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:33:51 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-fbbfd966-9aeb-45f2-8272-24320d854f03 tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04fff087-ed81-4bde-987b-69bbef22463f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:33:51 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-fbbfd966-9aeb-45f2-8272-24320d854f03 tempest-ProjectReaderTests-270310627 None] Volume 224bdb91-aeaf-4ef4-9677-39ed069f05a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5', 'volume_size': 1} Aug 31 15:33:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-fbbfd966-9aeb-45f2-8272-24320d854f03 tempest-ProjectReaderTests-270310627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:33:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-fbbfd966-9aeb-45f2-8272-24320d854f03 tempest-ProjectReaderTests-270310627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:33:51 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-fbbfd966-9aeb-45f2-8272-24320d854f03 tempest-ProjectReaderTests-270310627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T13:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1377636352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=224bdb91-aeaf-4ef4-9677-39ed069f05a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d00e2c9bd9ab4e59a15685f1ddc6f5ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T13:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T13:33:52Z,use_quota=True,user_id='013d907e479b4a51af1ae07d758dc986',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e1ceeb2-51ff-4edf-9708-f3f5460e0068),volume_type_id=3e1ceeb2-51ff-4edf-9708-f3f5460e0068)}" {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 31 15:33:51 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-fbbfd966-9aeb-45f2-8272-24320d854f03 tempest-ProjectReaderTests-270310627 None] Creating volume 224bdb91-aeaf-4ef4-9677-39ed069f05a5 {{(pid=86000) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 31 15:33:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-fbbfd966-9aeb-45f2-8272-24320d854f03 tempest-ProjectReaderTests-270310627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:33:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-fbbfd966-9aeb-45f2-8272-24320d854f03 tempest-ProjectReaderTests-270310627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:33:51 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-fbbfd966-9aeb-45f2-8272-24320d854f03 tempest-ProjectReaderTests-270310627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:33:51 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-fbbfd966-9aeb-45f2-8272-24320d854f03 tempest-ProjectReaderTests-270310627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:33:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-fbbfd966-9aeb-45f2-8272-24320d854f03 tempest-ProjectReaderTests-270310627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:33:51 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-fbbfd966-9aeb-45f2-8272-24320d854f03 tempest-ProjectReaderTests-270310627 None] Selected osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 as target Quobyte volume. {{(pid=86000) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 31 15:33:51 devstack cinder-volume[86000]: INFO cinder.volume.drivers.remotefs [None req-fbbfd966-9aeb-45f2-8272-24320d854f03 tempest-ProjectReaderTests-270310627 None] casted to osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77 Aug 31 15:33:51 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-fbbfd966-9aeb-45f2-8272-24320d854f03 tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5 1073741824 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:51 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5 1073741824 Aug 31 15:33:51 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:52 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-fbbfd966-9aeb-45f2-8272-24320d854f03 tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5 1073741824" returned: 0 in 0.415s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-fbbfd966-9aeb-45f2-8272-24320d854f03 tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:52 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5 Aug 31 15:33:52 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:52 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-fbbfd966-9aeb-45f2-8272-24320d854f03 tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5" returned: 0 in 0.241s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:52 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-fbbfd966-9aeb-45f2-8272-24320d854f03 tempest-ProjectReaderTests-270310627 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'} {{(pid=86000) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 31 15:33:52 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-fbbfd966-9aeb-45f2-8272-24320d854f03 tempest-ProjectReaderTests-270310627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:33:52 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-fbbfd966-9aeb-45f2-8272-24320d854f03 tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04fff087-ed81-4bde-987b-69bbef22463f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5', 'volume_size': 1}' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:33:52 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-fbbfd966-9aeb-45f2-8272-24320d854f03 tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e0d2b78-5956-4bfc-8b6c-6ded1a1d39c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 31 15:33:52 devstack cinder-volume[86000]: INFO cinder.volume.flows.manager.create_volume [None req-fbbfd966-9aeb-45f2-8272-24320d854f03 tempest-ProjectReaderTests-270310627 None] Volume volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5 (224bdb91-aeaf-4ef4-9677-39ed069f05a5): created successfully Aug 31 15:33:52 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-fbbfd966-9aeb-45f2-8272-24320d854f03 tempest-ProjectReaderTests-270310627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e0d2b78-5956-4bfc-8b6c-6ded1a1d39c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86000) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 31 15:33:52 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-fbbfd966-9aeb-45f2-8272-24320d854f03 tempest-ProjectReaderTests-270310627 None] Flow 'volume_create_manager' (ee17a585-e8eb-4e24-90ef-84d3f6e8a330) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86000) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 31 15:33:52 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-fbbfd966-9aeb-45f2-8272-24320d854f03 tempest-ProjectReaderTests-270310627 None] Created volume successfully. Aug 31 15:33:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ea3cf5d9-9e22-4610-a5fd-1b4d6c5c2e0c tempest-ProjectReaderTests-270310627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:33:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ea3cf5d9-9e22-4610-a5fd-1b4d6c5c2e0c tempest-ProjectReaderTests-270310627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:33:53 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-ea3cf5d9-9e22-4610-a5fd-1b4d6c5c2e0c tempest-ProjectReaderTests-270310627 None] Creating offline snapshot 062f0657-46e1-48c6-a158-3b786a0b96b5 of volume 224bdb91-aeaf-4ef4-9677-39ed069f05a5 {{(pid=86000) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 31 15:33:53 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[795eb38a-be3c-47d7-9664-76041d4d2192]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:33:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ea3cf5d9-9e22-4610-a5fd-1b4d6c5c2e0c tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:53 devstack sudo[107047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5 Aug 31 15:33:53 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:53 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ea3cf5d9-9e22-4610-a5fd-1b4d6c5c2e0c tempest-ProjectReaderTests-270310627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5" returned: 0 in 0.357s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ea3cf5d9-9e22-4610-a5fd-1b4d6c5c2e0c tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5.062f0657-46e1-48c6-a158-3b786a0b96b5 1G {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:53 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5.062f0657-46e1-48c6-a158-3b786a0b96b5 1G Aug 31 15:33:53 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:53 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ea3cf5d9-9e22-4610-a5fd-1b4d6c5c2e0c tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5.062f0657-46e1-48c6-a158-3b786a0b96b5 1G" returned: 0 in 0.383s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:53 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ea3cf5d9-9e22-4610-a5fd-1b4d6c5c2e0c tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5.062f0657-46e1-48c6-a158-3b786a0b96b5 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:53 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5.062f0657-46e1-48c6-a158-3b786a0b96b5 Aug 31 15:33:53 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:54 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ea3cf5d9-9e22-4610-a5fd-1b4d6c5c2e0c tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5 -F qcow2 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5.062f0657-46e1-48c6-a158-3b786a0b96b5" returned: 0 in 0.288s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:54 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-ea3cf5d9-9e22-4610-a5fd-1b4d6c5c2e0c tempest-ProjectReaderTests-270310627 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5.062f0657-46e1-48c6-a158-3b786a0b96b5 is being set with open permissions: ugo+rw Aug 31 15:33:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ea3cf5d9-9e22-4610-a5fd-1b4d6c5c2e0c tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5.062f0657-46e1-48c6-a158-3b786a0b96b5 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:54 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5.062f0657-46e1-48c6-a158-3b786a0b96b5 Aug 31 15:33:54 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:54 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ea3cf5d9-9e22-4610-a5fd-1b4d6c5c2e0c tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5.062f0657-46e1-48c6-a158-3b786a0b96b5" returned: 0 in 0.244s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ea3cf5d9-9e22-4610-a5fd-1b4d6c5c2e0c tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:54 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5.info Aug 31 15:33:54 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:54 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ea3cf5d9-9e22-4610-a5fd-1b4d6c5c2e0c tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5.info" returned: 0 in 0.245s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:54 devstack cinder-volume[86000]: WARNING cinder.volume.drivers.remotefs [None req-ea3cf5d9-9e22-4610-a5fd-1b4d6c5c2e0c tempest-ProjectReaderTests-270310627 None] /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5.info is being set with open permissions: ugo+rw Aug 31 15:33:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ea3cf5d9-9e22-4610-a5fd-1b4d6c5c2e0c tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5.info {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:54 devstack sudo[107068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5.info Aug 31 15:33:54 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:54 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-ea3cf5d9-9e22-4610-a5fd-1b4d6c5c2e0c tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5.info" returned: 0 in 0.235s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:54 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-ea3cf5d9-9e22-4610-a5fd-1b4d6c5c2e0c tempest-ProjectReaderTests-270310627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.828s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:33:54 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-ea3cf5d9-9e22-4610-a5fd-1b4d6c5c2e0c tempest-ProjectReaderTests-270310627 None] Create snapshot completed successfully Aug 31 15:33:55 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-f297f993-440a-4a86-8eff-d0dfc419c5db tempest-ProjectReaderTests-270310627 None] Acquiring lock "cinder-062f0657-46e1-48c6-a158-3b786a0b96b5-delete_snapshot" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:33:55 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-f297f993-440a-4a86-8eff-d0dfc419c5db tempest-ProjectReaderTests-270310627 None] Lock "cinder-062f0657-46e1-48c6-a158-3b786a0b96b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:33:55 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-f297f993-440a-4a86-8eff-d0dfc419c5db tempest-ProjectReaderTests-270310627 None] Acquiring lock "cinder-quobyte-224bdb91-aeaf-4ef4-9677-39ed069f05a5" by "delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:33:55 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-f297f993-440a-4a86-8eff-d0dfc419c5db tempest-ProjectReaderTests-270310627 None] Lock "cinder-quobyte-224bdb91-aeaf-4ef4-9677-39ed069f05a5" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:33:55 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-f297f993-440a-4a86-8eff-d0dfc419c5db tempest-ProjectReaderTests-270310627 None] Acquiring lock "cinder-quobyte-062f0657-46e1-48c6-a158-3b786a0b96b5" by "_delete_snapshot" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:33:55 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-f297f993-440a-4a86-8eff-d0dfc419c5db tempest-ProjectReaderTests-270310627 None] Lock "cinder-quobyte-062f0657-46e1-48c6-a158-3b786a0b96b5" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:33:55 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-f297f993-440a-4a86-8eff-d0dfc419c5db tempest-ProjectReaderTests-270310627 None] Deleting offline snapshot 062f0657-46e1-48c6-a158-3b786a0b96b5 of volume 224bdb91-aeaf-4ef4-9677-39ed069f05a5 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 31 15:33:55 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-f297f993-440a-4a86-8eff-d0dfc419c5db tempest-ProjectReaderTests-270310627 None] snapshot_file for this snap is: volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5.062f0657-46e1-48c6-a158-3b786a0b96b5 {{(pid=86000) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 31 15:33:55 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4505692f-4637-43f3-bd25-f2400697eb10]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:33:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f297f993-440a-4a86-8eff-d0dfc419c5db tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5.062f0657-46e1-48c6-a158-3b786a0b96b5 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:55 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5.062f0657-46e1-48c6-a158-3b786a0b96b5 Aug 31 15:33:55 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:55 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f297f993-440a-4a86-8eff-d0dfc419c5db tempest-ProjectReaderTests-270310627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5.062f0657-46e1-48c6-a158-3b786a0b96b5" returned: 0 in 0.356s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:55 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.remotefs [None req-f297f993-440a-4a86-8eff-d0dfc419c5db tempest-ProjectReaderTests-270310627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86000) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 31 15:33:55 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c25a56-b176-4f26-94b3-a0f2d3c71246]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:33:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f297f993-440a-4a86-8eff-d0dfc419c5db tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:55 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5 Aug 31 15:33:55 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:55 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f297f993-440a-4a86-8eff-d0dfc419c5db tempest-ProjectReaderTests-270310627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5" returned: 0 in 0.357s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:55 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f297f993-440a-4a86-8eff-d0dfc419c5db tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5.062f0657-46e1-48c6-a158-3b786a0b96b5 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:55 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5.062f0657-46e1-48c6-a158-3b786a0b96b5 Aug 31 15:33:55 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:56 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f297f993-440a-4a86-8eff-d0dfc419c5db tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5.062f0657-46e1-48c6-a158-3b786a0b96b5" returned: 0 in 0.327s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f297f993-440a-4a86-8eff-d0dfc419c5db tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5.062f0657-46e1-48c6-a158-3b786a0b96b5 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:56 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5.062f0657-46e1-48c6-a158-3b786a0b96b5 Aug 31 15:33:56 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:56 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:56 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-f297f993-440a-4a86-8eff-d0dfc419c5db tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5.062f0657-46e1-48c6-a158-3b786a0b96b5" returned: 0 in 0.239s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:56 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-f297f993-440a-4a86-8eff-d0dfc419c5db tempest-ProjectReaderTests-270310627 None] Lock "cinder-quobyte-062f0657-46e1-48c6-a158-3b786a0b96b5" released by "_delete_snapshot" :: held 1.369s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:33:56 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-f297f993-440a-4a86-8eff-d0dfc419c5db tempest-ProjectReaderTests-270310627 None] Lock "cinder-quobyte-224bdb91-aeaf-4ef4-9677-39ed069f05a5" released by "delete_snapshot" :: held 1.389s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:33:56 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-f297f993-440a-4a86-8eff-d0dfc419c5db tempest-ProjectReaderTests-270310627 None] Created reservations ['b21290ea-d5d0-43b6-a3b6-22e919e1e5d8', 'dd2096ca-85f0-4281-9d6b-1e84db0634a6', '1a7daf7d-1ac1-4395-9680-99d8e672db42', '2f634eae-904a-4d9e-ad60-d614aab655dc'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:33:56 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-f297f993-440a-4a86-8eff-d0dfc419c5db tempest-ProjectReaderTests-270310627 None] Delete snapshot completed successfully. Aug 31 15:33:56 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-f297f993-440a-4a86-8eff-d0dfc419c5db tempest-ProjectReaderTests-270310627 None] Lock "cinder-062f0657-46e1-48c6-a158-3b786a0b96b5-delete_snapshot" released by "delete_snapshot" :: held 1.540s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:33:57 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-2e63f36b-1e8f-47b0-a843-f19023ea94c1 tempest-ProjectReaderTests-270310627 None] Acquiring lock "cinder-224bdb91-aeaf-4ef4-9677-39ed069f05a5-delete_volume" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:33:57 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-2e63f36b-1e8f-47b0-a843-f19023ea94c1 tempest-ProjectReaderTests-270310627 None] Lock "cinder-224bdb91-aeaf-4ef4-9677-39ed069f05a5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:33:57 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-2e63f36b-1e8f-47b0-a843-f19023ea94c1 tempest-ProjectReaderTests-270310627 None] Acquiring lock "cinder-quobyte-224bdb91-aeaf-4ef4-9677-39ed069f05a5" by "delete_volume" {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 31 15:33:57 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-2e63f36b-1e8f-47b0-a843-f19023ea94c1 tempest-ProjectReaderTests-270310627 None] Lock "cinder-quobyte-224bdb91-aeaf-4ef4-9677-39ed069f05a5" acquired by "delete_volume" :: waited 0.017s {{(pid=86000) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 31 15:33:57 devstack cinder-volume[86000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2cc42f-12e2-4635-8317-e74c0d843d33]: (4, 'qcow2') {{(pid=87685) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 31 15:33:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2e63f36b-1e8f-47b0-a843-f19023ea94c1 tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:57 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5 Aug 31 15:33:57 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:57 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2e63f36b-1e8f-47b0-a843-f19023ea94c1 tempest-ProjectReaderTests-270310627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5" returned: 0 in 0.346s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2e63f36b-1e8f-47b0-a843-f19023ea94c1 tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5 {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:57 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5 Aug 31 15:33:57 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:57 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:57 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2e63f36b-1e8f-47b0-a843-f19023ea94c1 tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e/volume-224bdb91-aeaf-4ef4-9677-39ed069f05a5" returned: 0 in 0.234s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:58 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-2e63f36b-1e8f-47b0-a843-f19023ea94c1 tempest-ProjectReaderTests-270310627 None] Lock "cinder-quobyte-224bdb91-aeaf-4ef4-9677-39ed069f05a5" released by "delete_volume" :: held 0.633s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:33:58 devstack cinder-volume[86000]: DEBUG cinder.quota [None req-2e63f36b-1e8f-47b0-a843-f19023ea94c1 tempest-ProjectReaderTests-270310627 None] Created reservations ['9dc8fcfe-fee7-42a7-9d7f-3b4ad5a8adb1', 'b8796849-f488-4785-8faf-a5662e55158d', 'e1365a90-7b66-4c28-a3d5-face6ed254dd', 'be17ac9f-ae91-4508-8e01-901f1571a424'] {{(pid=86000) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 31 15:33:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-2e63f36b-1e8f-47b0-a843-f19023ea94c1 tempest-ProjectReaderTests-270310627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 31 15:33:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-2e63f36b-1e8f-47b0-a843-f19023ea94c1 tempest-ProjectReaderTests-270310627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 31 15:33:58 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-2e63f36b-1e8f-47b0-a843-f19023ea94c1 tempest-ProjectReaderTests-270310627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77': None} {{(pid=86000) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 31 15:33:58 devstack cinder-volume[86000]: DEBUG cinder.volume.drivers.quobyte [None req-2e63f36b-1e8f-47b0-a843-f19023ea94c1 tempest-ProjectReaderTests-270310627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3a17908e-3bdb-43f6-88a3-facbf1bfbf77'] {{(pid=86000) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 31 15:33:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-2e63f36b-1e8f-47b0-a843-f19023ea94c1 tempest-ProjectReaderTests-270310627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86000) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 31 15:33:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2e63f36b-1e8f-47b0-a843-f19023ea94c1 tempest-ProjectReaderTests-270310627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 31 15:33:58 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e Aug 31 15:33:58 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 31 15:33:58 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Aug 31 15:33:58 devstack cinder-volume[86000]: DEBUG oslo_concurrency.processutils [None req-2e63f36b-1e8f-47b0-a843-f19023ea94c1 tempest-ProjectReaderTests-270310627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d13beb5cca9c92eb02db469b69f902e" returned: 0 in 0.239s {{(pid=86000) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 31 15:33:58 devstack cinder-volume[86000]: DEBUG cinder.manager [None req-2e63f36b-1e8f-47b0-a843-f19023ea94c1 tempest-ProjectReaderTests-270310627 None] Notifying Schedulers of capabilities ... {{(pid=86000) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 31 15:33:58 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-2e63f36b-1e8f-47b0-a843-f19023ea94c1 tempest-ProjectReaderTests-270310627 None] Deleted volume successfully. Aug 31 15:33:58 devstack cinder-volume[86000]: DEBUG cinder.coordination [None req-2e63f36b-1e8f-47b0-a843-f19023ea94c1 tempest-ProjectReaderTests-270310627 None] Lock "cinder-224bdb91-aeaf-4ef4-9677-39ed069f05a5-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=86000) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 31 15:34:08 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:UPDATE=39,cinder:DELETE=3,cinder:SELECT=25,cinder:INSERT=11 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 31 15:34:08 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writing DB stats cinder:SELECT=29,cinder:INSERT=9,cinder:UPDATE=31,cinder:DELETE=3 {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}